DPS schools pilot early warning system

When ninth-graders show up at East High School, their data precedes them.

How often were they absent in middle school? Did they ever fail a math or English class? Did they bomb the CSAP? Did they get in enough trouble to warrant a suspension?

East High School students Ayana Mclean and Eshe Walker talk about special programs that help them stay on top of their classes.

One of these factors may or may not be a problem, but combine a few and this student – statistically – has a much greater chance of dropping out of school.

And so, when this student enters school she may be immediately placed in one of 24 remedial support classes. She may be assigned to meet with a counselor who can offer emotional support due to troubles at home, and encourage her to sign up for an extracurricular activity.

Staff at East know what she needs because of the “risk score” she was assigned based upon what happened in middle school. With a little luck and a lot of support from East’s teachers and staff, the hope is she will graduate with her peers.

Early warning pilot schools
  • Abraham Lincoln
  • DCIS at Montbello
  • East
  • Hill Middle
  • MLK Jr. Early College
  • Skinner Middle

“We try to greet them at the door with an intervention that meets their needs,” said Mark Calhoun, who teaches one calculus class but spends most of his time running the school’s cutting-edge Response to Intervention program.

Response to Intervention, or RtI, is an increasingly common way school districts across Colorado are using data to meet individual student needs. The idea is to target specific help to kids early so they stay on track to graduate. The strategy is popular though results can be difficult to monitor.

East is among six Denver schools participating in one RtI component, a two-year pilot program called ABC Toolkit that is funded by a nearly $800,000, 2.5-year grant from the Michael and Susan Dell Foundation. ABC stands for “attendance, behavior and curriculum.”

Early warning signs based on dropout study

ABC Toolkit grew out of a pivotal 2009 report that documented common traits of Denver high school dropouts.

By the numbers: Red flags
  • Researchers analyzed data from 3,657 Denver dropouts in 2006-07:
  • As ninth graders, most had gotten at least one F, a third had four or more F’s and two-thirds had 20 or more absences
  • As early as the sixth grade, a third of the dropouts were failing at least one class
  • 44 percent of dropouts had more than 20 absences in middle school
  • One in five of the dropouts had at least one suspension

Johns Hopkins University researchers analyzed data from 3,657 Denver students who dropped out of school in the 2006-07 school year. 
The report found that in the ninth grade, most of the dropouts had gotten at least one F, a third had four or more F’s in a single semester and two-thirds had missed 20 or more days of school.

But signs of trouble were evident as early as sixth grade, researchers found. A third of the dropouts were failing at least one class in sixth grade, 44 percent had missed more than 20 days in middle school, and one in five had at least one suspension. Most of the dropouts were male, 61 percent were Latino, and 84 percent quit in high school, mostly in ninth grade.

The pilot program began one year ago with classroom and school observations, said Regina Rider, the DPS project manager of the ABC Toolkit.

“In a lot of cases, (the schools) were not using any data,” Rider said, noting that schools relied mostly on staff referrals when dealing with struggling students. “We came back with an action plan and said, ‘Here’s what we’re seeing. Here are the gaps. Here’s an action plan for helping close those gaps.’”

The ABC Toolkit ultimately will provide school leaders and staff with data to help them target instruction and improve student performance, along with ways to track progress on the new goals. Rider said it’s too early to document results of program.

But there are some bright spots at East, which is considered to be on the leading edge of the RtI movement. East is one of the few schools with a teacher who devotes most of his time to coordinating RtI efforts at the school. East started its overall RtI efforts two years ago.

East takes intervention seriously but results mixed

“Immediately we had a pretty good spike in the number of students on track to graduate after the first semester of freshman year and after freshman year,” Calhoun said, noting the school’s on-track-to-graduate rate “has steadily improved – until this year.”

East High School teacher Mark Calhoun spoke about intervention efforts this month to a national group of education writers.

Calhoun said the percentage of freshmen on track to graduate – meaning students with at least 60 course credits, including required classes – was at 76 percent at the end of 2008-09. The school set a goal of 90 percent.

Once RtI initiatives began, the rate shot up to 84 percent the following year, which is where it has hovered. In fact, at the middle of this year, the freshman on-track-to-graduate rate was still at 84 percent – and expected to dip by year’s end.

Calhoun believes the federal No Child Left Behind legislation could be to blame – since the law recently required East to take students from a couple other low-performing high schools.

Still, Calhoun is a firm believer in RtI – even if the evidence of its effectiveness is anecdotal.

East daily attendance
  • 2006-07: 86 percent
  • 2009-10: 89.8 percent
  • 2010-11: 90.4 percent
  • 2011-12*: 91.7 percent

*First semester only

“We’re increasing our average daily attendance, and decreasing the number of out-of-school suspensions,” Calhoun said. “While (RtI) hasn’t been directly focused on those, we feel RtI has positively contributed. It allows us to target our kids who need support from day one.”

Students who miss classes may be sent to lunch-time detention. If the problem is chronic, the student may face in-school suspension, where he is isolated from his peers all day. Then, there’s after-school detention and Saturday school – none appealing options for teens.

If things get really bad on the attendance front, a special meeting is called at a neutral location with the student, parents, school staff and a community member. Sometimes, the answer is as simple as a bus pass. Other times, it’s a complicated set of issues, from family problems to a need for mental health counseling.

In early May each year, transition teams from middle and high schools meet to exchange information about high-risk students so that interventions can be planned for the following year.

Assigning risk factors to students based on past history

While the school is collecting ever-increasing amounts of data, Calhoun said, the struggle is analyzing it in a way that reveals what interventions are working with East’s 2,000-plus students.

On track to graduate
  • Students entering East as freshmen are assigned a risk score based on past academic, attendance and behavior issues – zero means no risk factors
  • Of those students with zero risk factors, 93 percent were on track to graduate at the end of their freshmen year
  • The more risk factors, the less likely the students were to remain on track:
  • Risk score of 1 – 81 percent on track to graduate
  • Risk score of 2 – 68 percent on track to graduate
  • Risk score of 3 – 48 percent on track to graduate
  • Risk score of 4 – 25 percent on track to graduate
  • The idea is that East officials assign interventions for incoming freshmen based on risk scores

He creates daily or otherwise regular reports for teachers and staff that document attendance, behavior issues and coursework all in one place – something that never happened in the past.

Students are rated based on course credits and grades, attendance and behavior.

A zero means a student is entering East as a ninth-grader with no risk factors. Of those students, 93 percent made it to 10th grade on time.

Conversely, of the students entering East with four risk factors, only 25 percent made it to 10th grade on time, Calhoun said.

Sophomore Eshe Walker said she was struggling in school due to some personal issues. So she was assigned a mentor and is working hard to stay on top of her schoolwork now. She attends an academic support class, which meets once a week. Discussion focuses on what students can do to improve their grades.  At this point, she wants to become a nurse.

“We feel we’re onto something good,” Calhoun said. “We feel like we’re providing much better support than we were.

“One of the challenges is a time challenge – finding the time to do the kind of tracking to determine which interventions are really having an impact and where they’re having that impact.”

Early warning model to include elementary schools

Four University of Denver graduate students – some working toward becoming school psychologists – are assisting the six pilot schools. They collect the data and are creating systems for data collection and analysis for each school community.

Learn more

“The students collect information for them, instead of giving teachers extra work,” Rider said.

DPS has also signed on to SchoolNet, which offers a suite of data-driven education software. The first two schools to use the software are East and MLK.

Soon, the pilot will be rolled out at select elementary schools, said Kelli Pfaff, director of PSR Strategic Initiatives in the DPS Office of Post-Secondary Readiness.

Schools will collect data, create interventions and pass the information on to the students’ next schools if help is still needed.

“We’re excited we’re ahead of the curve on a lot of this,” Pfaff said. “We are able to identify who those students are that maybe would be under the radar in a lot of ways. This is helping us get tighter about the type of intervention we should be doing.”

call out

Our readers had a lot to say in 2017. Make your voice heard in 2018.

PHOTO: Chris Hill/Whitney Achievement School
Teacher Carl Schneider walks children home in 2015 as part of the after-school walking program at Whitney Achievement Elementary School in Memphis. This photograph went viral and inspired a First Person reflection from Schneider in 2017.

Last year, some of our most popular pieces came from readers who told their stories in a series that we call First Person.

For instance, Carl Schneider wrote about the 2015 viral photograph that showed him walking his students home from school in a low-income neighborhood of Memphis. His perspective on what got lost in the shuffle continues to draw thousands of readers.

First Person is also a platform to influence policy. Recent high school graduate Anisah Karim described the pressure she felt to apply to 100 colleges in the quest for millions of dollars in scholarships. Because of her piece, the school board in Memphis is reviewing the so-called “million-dollar scholar” culture at some high schools.

Do you have a story to tell or a point to make? In 2018, we want to give an even greater voice to students, parents, teachers, administrators, advocates and others who are trying to improve public education in Tennessee. We’re looking for essays of 500 to 750 words grounded in personal experience.

Whether your piece is finished or you just have an idea to discuss, drop a line to Community Editor Caroline Bauman at

But first, check out these top First Person pieces from Tennesseans in 2017:

My high school told me to apply to 100 colleges — and I almost lost myself in the process

“A counselor never tried to determine what the absolute best school for me would be. I wasted a lot of time, money and resources trying to figure that out. And I almost lost myself in the process.” —Anisah Karim     

Why I’m not anxious about where my kids go to school — but do worry about the segregation that surrounds us

“In fact, it will be a good thing for my boys to learn alongside children who are different from them in many ways — that is one advantage they will have that I did not, attending parochial schools in a lily-white suburb.” —Mary Jo Cramb

I covered Tennessee’s ed beat for Chalkbeat. Here’s what I learned.

“Apathy is often cited as a major problem facing education. That’s not the case in Tennessee.” —Grace Tatter

I went viral for walking my students home from school in Memphis. Here’s what got lost in the shuffle.

“When #blacklivesmatter is a controversial statement; when our black male students have a one in three chance of facing jail time; when kids in Memphis raised in the bottom fifth of the socioeconomic bracket have a 2.6 percent chance of climbing to the top fifth — our walking students home does not fix that, either.” —Carl Schneider

I think traditional public schools are the backbone of democracy. My child attends a charter school. Let’s talk.

“It was a complicated choice to make. The dialogue around school choice in Nashville, though, doesn’t often include much nuance — or many voices of parents like me.” —Aidan Hoyal

I grew up near Charlottesville and got a misleading education about Civil War history. Students deserve better.

“In my classroom discussions, the impetus for the Civil War was resigned to a debate over the balance of power between federal and state governments. Slavery was taught as a footnote to the cause of the war.” —Laura Faith Kebede

Weekend Reads

Need classroom decor inspiration? These educators have got you covered.

This school year, students will spend about 1,000 hours in school —making their classrooms a huge part of their learning experience.

We’re recognizing educators who’ve poured on the pizazz to make students feel welcome. From a 9th-grade “forensics lab” decked out in caution tape to a classroom stage complete with lights to get first graders pumped about public speaking, these crafty teachers have gone above and beyond to create great spaces.

Got a classroom of your own to show off? Know someone that should be on this list? Let us know!

Jaclyn Flores, First Grade Dual Language, Rochester, New York
“Having a classroom that is bright, cheerful, organized and inviting allows my students to feel pride in their classroom as well as feel welcome. My students look forward to standing on the stage to share or sitting on special chairs to dive into their learning. This space is a safe place for my students and we take pride in what it has become.”

Jasmine, Pre-K, Las Vegas, Nevada
“My classroom environment helps my students because providing calming colors and a home-like space makes them feel more comfortable in the classroom and ready to learn as first-time students!”


Oneika Osborne, 10th Grade Reading, Miami Southridge Senior High School, Miami, Florida
“My classroom environment invites all of my students to constantly be in a state of celebration and self-empowerment at all points of the learning process. With inspirational quotes, culturally relevant images, and an explosion of color, my classroom sets the tone for the day every single day as soon as we walk in. It is one of optimism, power, and of course glitter.”

Kristen Poindexter, Kindergarten, Spring Mill Elementary School, Indianapolis, Indiana
“I try very hard to make my classroom a place where memorable experiences happen. I use songs, finger plays, movement, and interactive activities to help cement concepts in their minds. It makes my teacher heart so happy when past students walk by my classroom and start their sentence with, “Remember when we…?”. We recently transformed our classroom into a Mad Science Lab where we investigated more about our 5 Senses.”


Brittany, 9th Grade Biology, Dallas, Texas
“I love my classroom environment because I teach Biology, it’s easy to relate every topic back to Forensics and real-life investigations! Mystery always gets the students going!”


Ms. Heaton, First Grade, Westampton, New Jersey
“As an educator, it is my goal to create a classroom environment that is positive and welcoming for students. I wanted to create a learning environment where students feel comfortable and in return stimulates student learning. A classroom is a second home for students so I wanted to ensure that the space was bright, friendly, and organized for the students to be able to use each and every day.”

D’Essence Grant, 8th Grade ELA, KIPP Houston, Houston, Texas
“Intentionally decorating my classroom was my first act of showing my students I care about them. I pride myself on building relationships with my students and them knowing I care about them inside and outside of the classroom. Taking the time to make the classroom meaningful and creative as well building a safe place for our community helps establish an effective classroom setting.”


Jayme Wiertzema, Elementary Art, Worthington, Minnesota
“I’m looking forward to having a CLASSROOM this year. The past two years I have taught from a cart and this year my amazing school district allowed me to have a classroom in our school that is busting at the seams! I’m so excited to use my classroom environment to inspire creativity in my students, get to know them and learn from their amazing imaginations in art class!”


Melissa Vecchio, 4th Grade, Queens, New York
“Since so much of a student’s time is spent inside their classroom, the environment should be neat, organized, easy to move around in but most of all positive. I love to use a theme to reinforce great behavior. I always give the students a choice in helping to design bulletin boards and desk arrangements. When they are involved they take pride in the classroom, and enjoy being there.”