Taking Stock

Few principals statewide gave teachers low marks in first round of evaluations

PHOTO: Chalkbeat
A New York City principal takes notes on her computer during classroom observation for new teacher evaluations. New state data, excluding New York City teachers, show that teachers performed better on observations than student test-based portions.

Few principals across New York state gave their teachers low scores in the 2012-13 school year as they implemented a new evaluation system that calls for in-depth classroom observations, according to data released by the state on Thursday.

Ninety-eight percent of teachers statewide received top ratings, “effective” or “highly effective,” on the 60 percent of their evaluations made up primarily of observations, the data shows. Less than 1 percent of teachers earned the lowest rating on their observations.

Nearly nine times as many teachers, or about 4 percent, received low ratings on the 40 percent of their evaluations that use a combination of state and local tests. The difference is likely spark a debate over what parts of an evaluation should be used to measure teacher quality—and what parts are the most accurate.

Overall, more than 123,000 teachers and 3,000 principals received ratings in the 2012-13 school year. The results did not include New York City’s 75,000 teachers and 1,100 principals because of a labor dispute that caused the city to implement its system a year late.

In total, 94 percent of teachers and 92 percent of principals earned one of the top two ratings and the high marks quickly drew criticism from supporters of stronger accountability measures.

The data, which includes a breakdown of how teachers and principals were rated based on their districts and schools, as well as their subjects and grades taught, is the fullest picture yet of how one of the state’s biggest efforts to improve teacher quality played out in its first year. The release does not include data from New York City, which was was the only district that did not implement teacher evaluations until the 2013-14 school year.

The average statewide distribution masked the fact that there was a far more variable mix in urban districts, according to Capital New York, which reported that poor urban districts Rochester and Buffalo rated 40 percent of teachers in the lowest two categories of “developing” and “ineffective.”

The new teacher evaluation system was meant to better distinguish teacher quality, and its supporters said that the evaluations would help resolve the disconnect between teachers’ almost uniformly high ratings and the low number of students who graduate high school prepared for college-level coursework. The evaluations’ proponents also said they would also help districts root out the lowest-performing teachers by allowing districts to use ratings to fire or deny job protections.

Whether schools are any closer to achieving either goal remains unclear.

Teachers unions have fought the use of student test scores in the evaluation system, arguing that they aren’t an accurate reflection of teaching skills. Critics have said scores earned in recent years are especially unreliable because they’ve come as the state has adopted tests aligned to new learning standards.

“The data does not support any valid conclusions about teachers, students, schools, or school districts because of the flawed implementation of the Common Core,” New York State United Teachers spokesperson Carl Korn said.

But supporters of tougher teacher evaluations said the data was proof that state test scores should play an even bigger role in evaluations. Many districts had no teachers who were rated ineffective or developing, a sign that the State Education Department should have greater oversight in determining how districts structure the evaluations, StudentsFirstNY Executive Director Jenny Sedlis said.

“Any part of the teacher evaluation system that finds zero percent of teachers to be ineffective, when less than a third of students are on grade level, raises serious questions,” Sedlis said.

State Education Department spokesperson Dennis Tompkins did not say in a statement if the results reflected an accurate look of teacher quality across the state. He noted that since 80 percent of evaluation plans were negotiated between school districts and their local union, the results could be subject to variety.

“It is important to remember that each APPR plan is locally negotiated and unique,” he said.

 

churning not learning

New research shows just how much losing a teacher midyear hurts students

PHOTO: Cyrus McCrimmon/Denver Post
Brown International Academy teacher Kate Tynan-Ridgeway works with a student.

The consequences of teacher churn were apparent to Esperanza Vazquez, a mother of two from New York City.

I had an experience with my son where he had a new teacher every week in math,” she told Chalkbeat recently. “That doesn’t help students.”

Now new research backs up Vazquez’s experience, documenting for perhaps the first time the steep consequences for students after teachers leave a classroom in middle of the school year.

The finding comes in a trio of new studies focusing on North Carolina. Together, they suggest that ill effects of teacher turnover identified in previous research may be driven largely by midyear departures; that those consequences extend even to students in the same grade whose teachers stay on; and that midyear turnover may be more common than previously thought, especially in schools serving more students of color and those from low-income families.

“While it is possible for turnover to be beneficial for school systems, an extensive body of research points to the ways that teacher turnover disrupts … the continuity of a child’s learning experiences, particularly in underserved schools,” write researchers Gary Henry of Vanderbilt and Christopher Redding of the University of Florida in one of the papers.

Henry and Redding’s three studies — two of which were published earlier this year in peer-reviewed journals, with the other is set to be published in coming weeks — home in on the rarely studied phenomenon of midyear teacher turnover.

Using recent data from North Carolina, two of the papers focus on the prevalence of the phenomenon. Annually 4.6 percent of teachers in the state departed midyear; among teachers in their first three years the rate jumped to 6 percent. The number was higher in schools deemed “underserved,” meaning they had more students of color and students in poverty, as well as lower test scores and fewer resources. Turnover was lower when principals were rated as more effective by teachers. It was higher among teachers who were less effective, those eligible for retirement benefits, and high school and middle school teachers.

Roughly a quarter of all teacher turnover in the state occurred in the middle of the school year.

The third study uses data from 2008 to 2014 to examine the consequences of midyear teacher attrition on elementary and middle school students’ test scores. In both math and English, students saw drops in learning as a result, controlling for a number of other factors. The decline in math scores was nearly as large as the difference in performance between an average teacher and an excellent one — a difference that has motivated dramatic policy changes in many places.

Impacts were smaller in English and in middle school, but also consistently negative. Students in the same grade level, but not class, of teachers were also harmed, but again less so.

The negative results are consistent with research on the effects of hiring teachers after the school year starts, in some ways a mirror image of the phenomenon.

The paper suggests three things that might explain the results: disruption in classrooms where teachers leave, instability in a school where teachers are exiting midyear, and less effective teachers replacing those who depart. The study suggests the first two theories seem to be clearly at play, since it was relatively ineffective teachers who were particularly likely to leave.

“When multiple teachers exit a school during the year, it can become increasingly difficult for teachers to maintain a work environment with a high degree of collaboration,” the researchers say.

The study did reach some surprising results: Students of color, students in poverty and students with lower prior test scores, generally did not suffer more as a result of midyear turnover; if anything, they suffered less in English. It may be that their schools were better prepared for midyear exits since they happen more frequently; it could also be that those students were simply “not well served by the teacher who departed,” the paper hypothesizes.

Another counterintuitive result: Unlike midyear turnover, departure of teachers at the end of the school year did not lead to declines in student learning, and even led to small benefits in some cases. That’s surprising in light of past research — and conventional wisdom — suggesting that teacher turnover harms students. (Prior studies generally have not distinguished between midyear and end-of-year turnover.)

The latest research does come with a key caveat: Test scores might be lower in classes where teachers leave midyear for other reasons — perhaps a particularly disruptive class causes both a teacher to quit and students to learn less in school. The authors attempt to account for this by comparing how the same student did in years when their teacher does not turnover.

The studies also look at just a single state, so it’s unclear whether the results would look similar elsewhere.

The researchers point out that some churn is inevitable, even healthy. “Many of the personal factors driving within-year teacher turnover are unlikely to be amenable to change: a teacher takes time in the middle of the school year for parental leave; a veteran teacher retires midyear; a beginning teacher leaves a few months into the school year after realizing teaching is a poor occupational fit,” write Henry and Redding. Indeed, female teachers between the ages of 26 and 40 years old were particularly likely to exit mid-year, indicating that parental leave plays a significant role in the results.

But the studies collectively conclude that students could benefit from combating midyear departures — although the best way to do that is not clear.

In Detroit, some schools have adopted a crude — and some would say cruel — approach, imposing financial penalties for teachers who left midyear. Studies focusing on turnover in general have found that higher pay, better working conditions, and more effective principals can make a difference.

At the same, time Henry and Redding argue that policymakers ought to make extensive efforts to avoid midyear teacher turnover when possible. For instance, they point out that information from teacher evaluation systems, including “value-added” test scores measures, aren’t always available until after the school year has begun. Finalizing those results before classes are underway could decrease midyear exits, they speculate.

“All measures of teachers’ performance, including their value-added scores, should be provided during the summer to allow teachers and administrators to attend to employment decisions without disrupting classes that have already begun,” the researchers conclude.

First Person

Staying ‘neutral’ after the Jason Van Dyke verdict was a tough ask of Chicago teachers like me

PHOTO: Joshua Lott/Getty Images
A woman holds a sign outside the courthouse after a murder verdict is handed down in the trial of Chicago Police Officer Jason Van Dyke.

At the beginning of every school year, I introduce myself to my students with a very personal presentation.

I show them pictures of where I grew up, my family, and the students I’ve taught at two other Chicago schools. I’m a human, not a robot, I tell them, earning a couple of laughs with my corny robot impression. At the end, I show them a signed copy of John Lewis’s “March,” the graphic novel that illustrates his experiences as a Civil Rights Movement leader. I talk about seeing Lewis speak at a Chicago Public Schools event years ago, and how he inspired me to speak up when I saw injustice.

In return, I ask my students to introduce themselves. They bring pictures of their lives, families, friends, and travels, and they talk about who they want to become. These presentations help to turn the library and writing center I oversee into a community.

The connection I have with my students isn’t out of the ordinary in Chicago. I’d be hard-pressed to find a teacher in the three very different high schools I’ve taught in and in schools all across the city who didn’t have strong ties to the students they teach. That’s why it felt so problematic that my district, CPS, asked its teachers to remain “neutral” about the Van Dyke case — the trial of a Chicago police officer, Jason Van Dyke, who was convicted of second-degree murder for shooting a Chicago teenager.

Two days before the Van Dyke decision came down, amid warnings that riots could follow a “not guilty” decision, the district sent an email advising teachers about how to handle discussions surrounding the verdict. I applaud the email for its initial statement: “It is critical that educators are prepared and provide space for students should they and their students choose to engage in this critical and timely public issue,” it read.

But in the next paragraph, the district said that teachers “must remain neutral.” The email cited a 2007 Indiana circuit court decision, Mayer v. Monroe County Schools, that ruled that “teachers do not have the constitutional right to introduce their own political views to students, ‘but must stick to the prescribed curriculum.’”

That left me with several questions. First, is an opinion on the Van Dyke trial truly a political view? Many of my students, now juniors and seniors, were just becoming teenagers when they watched the dash-cam video where 16 bullets riddle Laquan McDonald’s 17-year-old body.  The opinion CPS is concerned about me sharing, presumably, is that Van Dyke should face consequences.

I have taught many students like Laquan McDonald, students who have grown up in foster homes, who have failed out of the very school I taught in, whose city literally left them behind. When I saw Laquan McDonald in that video, I saw their faces grimacing on the ground, their bodies writhing. To me, his death, the subsequent cover-up, and the verdict, is personal, not political.

Asking me to “stay neutral” as a white teacher in a classroom full of African-American and Latinx students is asking me to send a message that I am indifferent to their experiences and to have them see me as a stereotype of whiteness. I am on their side. I don’t think there is anything wrong with having them know this. But the message I received implies that my district does.

In the court case evidently used as proof for why staying neutral is mandatory, students asked their teacher whether she ever protested. She told them that she honked her car horn at demonstrators calling for peace at an anti-Iraq War demonstration. The teacher believed she was fired because of this discussion. The court ruled in favor of the school district, stating, “the First Amendment does not entitle primary and secondary teachers, when conducting the education of captive audiences, to cover topics, or advocate viewpoints, that depart from the curriculum adopted by the school system.”

How this applies in my situation is confusing, since every year in my career I have either had the freedom to construct or co-construct curriculum for my classroom. It also reminds me of what Holocaust survivor and award-winning author Elie Wiesel said in his speech when winning the Nobel Peace Prize: “Neutrality helps the oppressor, never the victim. Silence encourages the tormentor, never the tormented. Sometimes we must interfere.”

Asking teachers to remain neutral when discussing Laquan McDonald teaches my students something I don’t want them ever to learn: that my connections with them, and my pursuit of justice for our shared community, are not my highest priority.

Gina Caneva is a 15-year Chicago Public Schools veteran who works as a teacher-librarian and Writing Center Director at Lindblom Math and Science Academy.  She is a National Board Certified teacher and Teach Plus Teaching Policy Fellowship alum. Follow her on Twitter @GinaCaneva.