light of day

City releases Teacher Data Reports — and a slew of caveats

When the Department of Education’s embargo of Teacher Data Reports details lifted at noon today, news organizations across the city rushed to make the data available.

The Teacher Data Reports are “value-added” assessments of teachers’ effectiveness that were produced from 2008 to 2010 for reading and math teachers in grades 3 to 8.

This morning, department officials including Chancellor Dennis Walcott and Chief Academic Officer Shael Polakow-Suransky met with reporters to offer caution about how the data reports should be used. They emphasized the reports’ wide margins of error — 35 percentage points for math teachers and 53 percentage points for reading teachers, on average — and that the reports reflect only a small portion of teachers’ work.

“We would never advise anyone — parent, reporter, principal, teacher — to draw a conclusion based on this score alone,” Polakow-Suransky said.

Most of the news organizations that filed Freedom of Information Law requests for the ratings plan to publish them in searchable or streamlined databases, with the teachers’ names attached. GothamSchools does not plan to publish the data with teachers’ names or identifying characteristics included because of concerns about the data’s reliability.

At least two other news organizations that cover education are also not publishing the data: the local affiliate of Fox News, according to a representative of Fox, and the nonprofit school information website Insideschools.

Department officials are asking schools not to release the reports to parents. They issued a guide today advising principals about how to handle parents who demand that their child be removed from the class of a teacher rated ineffective.

“Resist changing student/teacher assignments mid-year, as doing so is disruptive to all students’ learning,” the guide advises.

“We definitely will not be moving kids around based on a data point that is two years old,” Polakow-Suransky said today.

Joel Klein, who was chancellor when the reports were launched, was a public champion of the idea that releasing teacher ratings would empower parents to demand better schools and teachers for their children. He argued publicly that the ratings of individual teachers should be released after news organizations filed legal requests for them.

But Walcott began distancing himself from that position almost immediately after becoming chancellor last year. And last fall, his administration announced it had stopped producing the reports, citing a new state teacher evaluation system that will include value-added measures. Walcott explained in a Daily News column today that he is not thrilled that teachers “might be denigrated” as a result of the data dump.

Today, Walcott and Polakow-Suransky argued that Klein’s initial stance was justified — at the time. “What we’re looking at in 2012 is quite different from what Joel was looking at in 2010,” Polakow-Suransky said.

Because New York City adopted value-added measures relatively early, he said, the ratings were in fact among the most sophisticated measures available at the time. But even at the time, the ratings were not meant for public consumption or to be used in high-stakes decision-making, he said.

Polakow-Suransky acknowledged one exception to the high-stakes decision ban: School officials did use value-added ratings to inform decisions about whether to grant some teachers tenure.

We reported last year that principals said they were being prevented from granting tenure to teachers whose students had low test scores, particularly if they were among the roughly 12,000 teachers annually to receive a data report.

Polakow-Suransky said today that 133 teachers up for tenure last year were flagged because of low value-added scores. More than a third of the flagged teachers received tenure after their principals and superintendents determined that other factors carried more weight, he said.

The city released reports for about 18,000 different teachers over the course of the three school years during which they were produced. About 12,000 teachers received reports in each of the 2008-2009 and 2009-2010 school years, and about half of them received two because they taught both reading and math. (A smaller pilot group received reports in 2007-2008.)

Because many teachers’ students were tested in both math and English, some teachers were given two different value-added ratings for a single year — below average in one subject and above average in the other.

The reports also indicate whether teachers were found to have done especially well at boosting the test scores of particular types of students, such as students with disabilities, low-income students, or students who are considered English language learners.

Department officials said 77 percent of the teachers who received reports are still working in the city schools.

Next week, ratings will be released for teachers in schools for students with severe disabilities and for charter school teachers. The release of charter school teachers’ data reports reverses the department’s earlier decision not to release them because charter schools had opted into the Teacher Data Report program voluntarily.

Officials cautioned that the scores were especially unreliable for teachers with relatively few students. That group includes elementary school teachers, who typically had fewer than 30 students factor into their scores.

They also said reports are less reliable for teachers whose students were either all high-performing or mostly low-performing. The difference is due to the nature of the state tests, which were designed to distinguish among middle-level students — those just above and below the state’s proficiency cutoff. As a result, small differences among students at the top and bottom had an outsized impact on a teachers’ rating, Polakow-Suransky said.

The issue was one of several lessons learned that Polakow-Suransky said the city has flagged for the State Education Department, which is building its own value-added algorithm to be used as a part of new teacher evaluations.

The state is working with the American Institute of Research to build its model; the city’s model was designed by a research center at the University of Wisconsin.

Other lessons Polakow-Suransky identified include the importance of publishing value-added scores in the context of their margins of error and the need to create a way for teachers and principals to verify data.

The city introduced a verification system that teachers could use two years into the Teacher Data Report project. Less than 40 percent of teachers signed in to use it, but a significant number of them found major errors. For example, three percent of the teachers who signed in discovered that they had been marked as teaching classes that they had not actually taught.

In their lawsuit attempting to stop the ratings from being released, United Federation of Teachers officials identified more than 200 such errors. UFT President Michael Mulgrew said today that the errors showed that the city had not been respectful of teachers in developing or releasing the ratings.

“This was a complete debacle in terms of how the DOE has handled [the reports] and the mismanagement of the data inside of the system,” he said.

Asked whether he thought the state’s model would avoid the pitfalls the UFT identified in the city’s reports, Mulgrew said, “I’m not confident.”

But he said the state’s evaluation requirements are an improvement over the Teacher Data Reports because the new evaluations will showcase the value-added calculations alongside other measures of teacher quality.

Weighing in

Parents rally to demand a voice in the search for New York City schools chief

PHOTO: Courtesy/Shino Tanikawa
Parents and ddvocates rallied on the steps of the New York City education department headquarters to call for a say in the search for a new schools chancellor.

The education department has made it a mission to boost parent involvement in schools. Now, parents are demanding a bigger role elsewhere: In the search for a new schools chancellor.

Parent leaders from across New York City took to the steps of the education department’s headquarters to demand that Mayor Bill de Blasio allow them to have a say in the process.

“For the mayor to deny parents the opportunity to represent the interests of our children in this critical decision is to ignore the voices of our most vulnerable, underrepresented New Yorkers,” Jessamyn Lee, co-chair of the Chancellor’s Parent Advisory Council, said in a statement.

Organizers say about 30 members from a range of parent groups gathered in the rain to call on de Blasio to follow through on a campaign promise made during his first run for mayor.

Before he was was first elected, de Blasio said the city needed a school leader who would be “presented to the public, not just forced down our throat.” But he went on to conduct a hushed search, pulling department veteran Carmen Fariña from retirement to become chancellor.

De Blasio recently won reelection for a second term, and, in December, Fariña announced plans to head back to retirement. This time around, the mayor has committed to a quiet, internal deliberation.

Among the organizations represented at the rally were the Chancellor’s Parent Advisory Council, which is made of leaders from school parent organizations; the Education Council Consortium, which represents members of the local Community and Citywide Education Councils; and the NYCKids PAC, a parent-led political committee. Those are not the only groups seeking more access and transparency in the hiring process. Advocates for different causes, including school integration efforts, have all called for the opportunity to weigh in.

One of those calls came this weekend in an online petition asking de Blasio to consider a well regarded state education official for the job. And the Coalition for Educational Justice, which held its own rally on Tuesday outside City Hall, is calling on the city to appoint a chancellor who “has a strong vision for racial justice in schools.” The organization has called on the city to focus on making sure that teachers have anti-bias training and that classrooms reflect all students’ cultures.

pre-k for all

New York City will add dual language options in pre-K to attract parents and encourage diversity

PHOTO: Christina Veiga
Schools Chancellor Carmen Fariña, back right, visits a Mandarin pre-K dual language program at P.S. 20 Anna Silver on the Lower East Side.

Education Department officials on Wednesday announced the addition of 33 dual language pre-K programs in the 2018-19 school year, more than doubling the bilingual opportunities available for New York City’s youngest learners.

The expansion continues an aggressive push under the current administration, which has added 150 new bilingual programs to date. Popular with parents — there were 2,900 applications for about 600 pre-K dual language seats last year — the programs can also be effective in boosting the performance of students who are learning English as a new language.

Another possible benefit: creating more diverse pre-K classrooms, which research has shown are starkly segregated in New York City.

Schools Chancellor Carmen Fariña said the new programs reflect the city’s commitment to serving all students, even as a national debate rages over immigration reform.

“It’s important to understand that immigrants or people who speak a second language are an asset,” Fariña said. She called bilingual education “a gift that I think all schools should have.”

Included in the expansion are the city’s first dual language pre-K programs in Bengali and Russian, which will open in Jamaica, Queens, and the Upper West Side, Manhattan, respectively. The other additions will build on programs in Spanish, Mandarin and Italian. Every borough is represented in the expansion, with 11 new programs in Manhattan, nine in Brooklyn, six in Queens, five in the Bronx, and two on Staten Island.

In the dual-language model, students split their time between instruction in English and another language. At P.S. 20 Anna Silver, where the recent expansion was announced, pre-K students start the morning in English and transition to Mandarin after nap time. Experts say the model works best when the class includes an equal mix of students who are proficient in each language so they can learn from each other as well as the teacher, though it can often be difficult to strike that balance.

Officials and some advocates view dual-language programs as a tool for integration by drawing middle-class families eager to have their children speak two languages into neighborhood schools that they otherwise may not have considered. Research has shown that New York City’s pre-K classrooms tend to be more segregated than kindergarten. In one in six pre-K classrooms, more than 90 percent of students are from a single racial or ethnic background. That’s compared with one in eight kindergarten classrooms, according to a 2016 report by The Century Foundation.

Sharon Stapel, a mother from Brooklyn, said she knew early on that she wanted her daughter to learn another language and strike relationships across cultures. So she travels to the Lower East Side with her four-year-old, Finch, to attend the Mandarin dual-language pre-K program at P.S. 20 Anna Silver. On Wednesday, the city announced it will add a Spanish dual language program at the school.

“We really see it as how you build community with your neighbors and your friends,” Stapel said. “It was also an opportunity for Finch to become involved and engage in the cultures and in the differences that she could see in the classrooms — and really celebrate that difference.”

Citywide, about 13 percent of students are learning English as a new language. That number does not include pre-K since the state does not have a way to identify students’ language status before kindergarten. However, based on census data, it is estimated that 30 percent of three- and four-year-olds in New York are English learners.

Dual-language programs can benefit students who are still learning English — more so than English-only instruction. Nationally and in New York City, students who are learning English are less likely to pass standardized tests and graduate from high school. In one study, students who enrolled in dual-language courses in kindergarten gained the equivalent of one year of reading instruction by eighth grade, compared with their peers who received English-only instruction.

The city has been under pressure to improve outcomes for English learners. Under the previous administration, New York City was placed on a state “corrective action plan” that required the education department to open 125 new bilingual programs by 2013. Though the city fell short of that goal, the current administration has agreed to place every English learner in a bilingual program by the 2018-19 school year.

Among the greatest barriers to achieving that is finding qualified teachers, Fariña said. In some cases, it can be hard to find teachers who are fluent in the target language. In others, teachers who are native in a foreign language may only be certified in their home country, and it can be hard to transfer that certification to New York.

In order to open an Urdu program recently, Fariña said, the teacher, who holds a degree from another country, went through Teaching Fellows, an alternative certification program that usually caters to career-changers or recent college grads.

“I think the biggest challenge we have right now is ensuring our teacher preparation courses are keeping up with our need and demand for teachers who can teach another language,” she said.