on tape

For 20 percent of city teachers, observations come after a film screening

A video still shot of Danielle Lerro's English language arts class at I.S. 303 in the South Bronx. Lerro and Assistant Principal Monica Brady will be discussing how video can enhance the classroom observation process at a Feb. 25 event hosted by Chalkbeat New York and New America NYC.

As one of just two people certified to do classroom observations at I.S. 303, Assistant Principal Monica Brady’s workload is getting pretty backed up.

She and the principal together must observe the South Bronx middle school’s 29 teachers 174 times as part of their new teacher evaluation plans.

“I’m fairly behind on getting mine all done,” Brady said. “There’s just not enough hours in the day.”

But Brady has a plan to catch up. All of the teachers at I.S. 303 allowed administrators to film their lessons, so she can watch the tapes later rather than see them teach in person.

It’s a tool that 20 percent of city teachers opted into this year, the first under new evaluation rules that require many more observations than in the past. Brady and Danielle Lerro, one of her teachers, will be discussing how they use video in observations at a panel discussion that we’re co-hosting Feb. 25 with New America NYC. (RSVP for a free seat here.)

New York City is one of just 10 districts in the state to offer the video option for teachers, according to the State Education Department. City officials said one in five teachers authorized their administrators to film their classes.

The option was made available in the city’s evaluation plan imposed last year by State Education Commissioner John King, who has encouraged the use of video as a way to provide good feedback to teachers about their instruction. State law requires subjective measures such as observations to count for 60 percent of each teacher’s evaluation, and King required city administrators to rate teachers on all 22 elements of the Danielson Framework for Teaching.

King also gave teachers a choice between having one pre-announced period-length observation and three shorter ones, or at least six shorter and less formal observations.

At I.S. 303, all teachers chose the second option. But they soon saw that pulling it off would be logistically complicated.

“We realized it was really impossible to expect them to get into the classroom six times over the course of the year,” said Lerro, an eighth-grade English language arts teacher.

The United Federation of Teachers supports the observation-by-video option as long as teachers sign off on it beforehand. The union also prefers that teachers give consent when their classes are used to provide feedback, not inform an observation.

Brady and Lerro said using video as part of classroom observations, even for high-stakes evaluative purposes, is promising for more reasons than just saving time. I.S. 303 has taped dozens of hours of instruction in recent years to help teachers reflect on their own work and improve.

“When you’re viewing yourself, that can be really helpful,” Lerro said.

Brady said she’s able to pick up on more, because she can watch the tapes multiple times and notice different aspects of the class and the teacher’s instruction each time.

And having an objective record of a class is helpful when administrators and teachers debrief afterwards, she said, because their impressions of the class can often differ.

“You and I can see things very differently,” Brady said of how real-time perceptions inside a classroom differ. One person could see evidence of high engagement, something that the Danielson Framework demands, in a class where students eagerly raise their hands and shout out answers, she said. But another person might see the same class and think that the teacher struggled with classroom management.

Lerro said one reason that using video has worked at I.S. 303 is because teachers and administrators have a strong relationship already. And she said that since the school had been using video for its professional development for years, opting into using it for high-stakes teacher evaluations was not a big concern.

“People felt comfortable because they felt real trust with the administration,” Lerro said. “They know that the evaluations are being used to really make us better.”

And Brady said the time-saving appeal of using video instead of observing classes in person does result in some loss. “The best of both worlds,” she said, would be if administrators were present in the classroom for the observation and taped it at the same time, enabling both the administrator and teacher to use the footage to confirm or revise their first impressions about how the lesson went.

And Brady said video can be limiting for another reason: While videotaped lessons allow observers to see clearly what the teacher is doing, the camera’s placement in the back of the classroom makes it hard to tell how students are reacting.

“You can’t see if they’re having an ‘Aha!’ moment,” she said.

Incentives

Westminster district will give bonuses if state ratings rise, teachers wonder whether performance pay system is coming

PHOTO: Nicholas Garcia
Students work on an English assignment at M. Scott Carpenter Middle School in Westminster.

Teachers and employees in Westminster Public Schools will be able to earn a bonus if they help the struggling district improve its state ratings next year.

The district’s school board on Tuesday unanimously approved the $1.7 million plan for the one-year performance stipends, the district’s latest attempt to lift the quality of its schools.

School employees can earn $1,000 if their school meets a district-set score, or up to $2,000 if they reach a more ambitious goal the school sets. District employees, including the superintendent, can earn $1,000 if the district as a whole jumps up a rating next year.

“We recognize that everyone plays a critical role in increasing student achievement and we decided that if a particular school or the district as a whole can reach that next academic accreditation level, the employees directly responsible should be rewarded,” board president Dino Valente said in a statement.

The district is one of five that was flagged by the state for chronic low performance and was put on a state-ordered improvement plan this spring.

District officials have disputed state ratings, claiming the state’s system is not fairly assessing the performance of Westminster schools. Middle school teacher Melissa Duran, who also used to be president of the teacher’s union, drew a connection between that stance and the new stipends, saying any extra pay she gets would be based on one score.

“The district has gone to the state saying, ‘Why are you rating us on these tests, look at all the other things we’re doing’” Duran said. “Well, it’s the same thing for teachers. They’re still basing our effectiveness on a test score.”

Teachers interviewed Thursday said their first thoughts upon learning of the plan was that it sounded like the beginnings of performance pay.

“I already get the point that we are in need of having our test scores come up,” said math teacher Andy Hartman, who is also head of negotiations for the teacher’s union. “Putting this little carrot out there isn’t going to change anything. I personally do not like performance pay. It’s a very slippery slope.”

District leaders say they talked to all district principals after the announcement Wednesday, and heard positive feedback.

“A lot of the teachers think this is a good thing,” said Steve Saunders, the district’s spokesman.

National studies on the effectiveness of performance pay stipends and merit pay have shown mixed results. One recent study from Vanderbilt University concluded that they can be effective, but that the design of the systems makes a difference.

In Denver Public Schools, the district has a performance-pay system to give raises and bonuses to teachers in various situations. Studies of that model have found that some teachers don’t completely understand the system and that it’s not always tied to better student outcomes.

Westminster officials said they have never formally discussed performance pay, and said that these stipends are being funded for one year with an unanticipated IRS refund.

Westminster teachers said they have ideas for other strategies that could make a quick impact, such as higher pay for substitutes so teachers aren’t losing their planning periods filling in for each other when subs are difficult to find.

Waiting on a bonus that might come next year is not providing any new motivation, teachers said.

“It’s a slap in the face,” Duran said. “It’s not like we are not already working hard enough. Personally, I already give 110 percent. I’ve always given 110 percent.”

Last month, the school board also approved a new contract for teachers and staff. Under the new agreement, teachers and staff got a raise of at least 1 percent. They received a similar raise last year.

teacher diversity

Efforts to ‘raise the bar’ for becoming a teacher are running headlong into efforts to diversify the profession. Now what?

PHOTO: Meghan Mangrum

Education advocates and policymakers want to have it both ways: they want more teachers of color and to “raise the bar” for the profession with measures that disproportionately screen out certain groups.

The two aims, both widely popular in the education policy circles, aren’t just on a collision course. They’ve already collided. In Baltimore, for instance, a highly-rated black teacher may lose her job because of a licensing exam.

This the third story in a three-part series on the relationship between certification and teacher diversity in America. Read part one and part two.

But there has been only limited discussion of the fact that these two objectives — diversifying the profession and making it harder to enter — are often at cross purposes, although certification rules are hardly the only reason for limited diversity among teachers.

“You need to think pretty comprehensively if you’re going to accomplish both those goals,” said Dan Goldhaber, a professor at the University of Washington and a leading researcher on teacher certification. “Some of the things you do to accomplish one goal work against the other.”

A report released Thursday by the Center for American Progress, a progressive think tank, acknowledges the tension but argues that it’s possible for schools to have it all.

It suggests states confront the issue on multiple levels, investing more in recruiting potential teachers of color while also making the profession more appealing to everyone by raising salaries and subsidizing training. All of that should coincide with the development of better tools for judging whether a prospective teacher will be effective, which could replace current requirements like GPA cut-offs, CAP argues.

“Rigorous recruitment and thoughtful selection processes can achieve increased diversity and selectivity simultaneously,” the report says.

The paper offers one blueprint for policymakers. Others say states ought to take the opposite approach and actually lower the bar for entry into the profession, then carefully measure teachers’ performance once they’re in the classroom.

But right now, there isn’t much obvious political will to implement any of it, or clear research on the best approach.

Some states really have raised the bar

Between 2011 and 2015, nearly half of all states have ratcheted up testing or GPA requirements for entering teacher training programs. The raise-the-bar message has become policy, and teachers of color are the most affected.

At the same time, the push to increase the diversity of the overwhelmingly white teaching force has grown more urgent in the wake of recent studies.

“There’s clear qualitative and quantitative research that points to the added value for students of color when taught by a teacher of color,” said Travis Bristol, a professor at Boston University.

States have created an array of task forces to figure out how to recruit more teachers of color; the federal government has repeatedly made the case for doing so. Think tanks and policy groups have issued reports and held panel discussions. Many of those same groups have also called for raising the bar to enter the profession.

Meanwhile, states continue to grapple with how many hoops teachers should have to jump through before reaching the classroom. New York recently eliminated one exam required to become a teacher largely because of concerns about its impact on diversity, and is also considering dramatically reducing requirements for teachers at certain charter schools.

CAP offers a variety of solutions

The CAP paper points to a handful of states and teacher training programs that have prioritized both teacher diversity and high standards, like the Boston Teacher Residency.

It concludes by recommending improving recruitment for teachers of color, increasing teacher pay, using multiple measures for evaluating prospective teachers, and researching better metrics for predicting teacher effectiveness.

Goldhaber says a comprehensive approach is necessary.

“If you only [raise the bar], that’s going to be probably harmful to workforce diversity,” he said. “If you do that in connection with some other things, like raising salaries and reaching out to different kinds of people — those initiatives in conjunction with one another could work to both increase the diversity of the workforce and raise the bar.”

Of course, many of these ideas, like paying teachers more, cost money. As of 2014, many states were spending less on education than they were prior to the Great Recession.

Finding better measures for predicting who will be successful in the classroom may also be challenging, as existing metrics have proven limited and there isn’t a consistent definition of quality teaching.

Some research suggests that using a combination of metrics may be a useful tactic. Catherine Brown of CAP says teachers should be judged on a greater variety of skills without as much weight put on one test.

“One single test is not enough to tell you who will be a good teacher,” she said. “You need to look at the entirety of the candidate and that includes their interpersonal skills, and their ability to control a classroom, and their cultural competency with students.”

PHOTO: Shaina Cavazos

New tests and new kinds of training

Some are optimistic about a new breed of exam, including the edTPA, for directly measuring teachers’ effectiveness and reducing racial disparities in performance. The edTPA aims to examine a teacher’s practice, and it shows smaller racial gaps than paper-and-pencil certification tests — though substantial differences still exist between black and white candidates.

“I think that performance-based assessments [like edTPA] really give us an insight into how someone is able to perform on the job,” said Bristol.

Research on whether edTPA predicts effectiveness is only in its infancy. One analysis in North Carolina had promising results: a score on the performance assessment was a moderately strong predictor of teachers’ ability to raise student achievement, as well as how they were rated by their principals. Another study in Washington state was more measured — the ability to pass the edTPA was modestly related to effectiveness for English, but not math, teachers.

Another potential solution, favored by CAP and Bristol, are teacher residency programs, which offer intensive, practical training and the cost is usually heavily subsidized.

Indeed, research has found that teacher residency programs do attract and retain more teachers of color. But one aspect of the model that makes it especially attractive — generous funding to ensure candidates don’t have to go into debt — also makes it difficult to sustain and scale.

A different approach: lower the bar for entry, raise it for staying

To some critics, a better solution is to simply stop trying to divine which teachers will be effective before they reach the classroom — eliminating the possibility of incorrectly screening out qualified people, including prospective teachers of color.

“The current rules end up preventing a significant number and a disproportionate number of candidates of color from being able to teach kids, in spite of their demonstrated ability to do so in the classroom,” said Dan Weisberg, who argues that existing rules are poor proxies for performance.

Weisberg, whose group TNTP runs fast-track training programs for teachers, argues for observing teachers in action and looking at their impact on student test scores instead.

Whether teacher certification status and the associated tests actually predict teacher effectiveness is the subject of a lot of debate. Some educational economists have floated the idea of essentially eliminating certification requirements and focusing on initial performance instead.

Some studies find that certified teachers, and those who score higher on licensing exams, perform somewhat better in the classroom, though the differences are often quite small. (These studies measure teacher performance by their impact on student test scores.)

One advantage to traditional certification: teachers who go through that pathway are much more likely to stay in the classroom. If a different system increased teacher turnover, that could bring its own negative effects.

Goldhaber is not sure it makes sense to simply eliminate certification rules.

“I think you’d likely get more uneven outcomes,” he said. “There are places where that might benefit school systems … but then there are also places where they would not and might select people who are quite ineffective.”