study says...

In new study of school-district effectiveness, New York City falls just below national average

PHOTO: Stephanie Snyder

Each year, state test scores offer a snapshot of how much New York City students have learned. But they say little about how the city’s schools stack up against other districts’, in part because the raw scores largely reflect student demographics — wealthier districts tend to have higher scores.

Now, a major new analysis of several years of test scores from across the country provides a better way to judge and compare districts: Instead of looking at a single moment, it shows how well school systems help students grow their skills over time.

Based on that measure, New York City falls just below the middle of the pack: In the five years from third to eighth grade, its students collectively make about 4.6 grade levels of progress — landing New York in the 35th percentile of districts nationally. By contrast, Chicago students advance the equivalent of six grades within those five years, giving the district one of the highest growth rates in the country.

Still, New York is slightly above average when compared to other large districts with many students from low-income families. And it trounces the state’s other urban districts — including Yonkers, Syracuse, and Rochester, which have some of the nation’s worst growth rates.

“Among big poor districts, it’s better than average,” said Sean Reardon, the Stanford University researcher who conducted the analysis. “In the grand scheme, it’s pretty middle-of-the-road.”

Reardon’s analysis — based on 300 million standardized tests taken by students across more than 11,000 school districts from 2009 to 2015 — is the largest of its kind. It looks both at student proficiency on third-grade math and English tests (that is, what share of students earned a score deemed “proficient”) and student growth between grades three and eight (how much their scores improved over time). Reardon’s research was supported by several foundations, including the Bill and Melinda Gates Foundation, which also provides funding to Chalkbeat.

The analysis controls for the differences in tests across states and over time by converting scores into a common scale that measures growth in grade levels, making it possible to compare nearly every district in the country to one another. (It excludes New York’s scores from 2015 and some grades in 2014 because of the high number of students who boycotted the state tests those years. However, each district’s five-year growth rates is actually an average of its year-over-year growth, so Reardon was still able to calculate a five-year rate for New York.)

Experts generally prefer growth rates over proficiency as a way to evaluate school quality, since growth measures the progress students make in school rather than where they started. Even if a district enrolls many poor students who are less likely than their affluent peers to hit the “proficiency” benchmark, its schools can still help them advance at a rate comparable to or even better than schools filled with wealthier students.

“Growth is way better than achievement,” said Douglas Ready, an education and public policy professor at Teachers College, Columbia University. “We know low-income students start school behind — the question is what do school districts do with the kids they get?”

New York’s growth rate falls just below the national median of 4.8 grade levels. Among big districts, its students made gains similar to those in Dallas and Detroit, and greater than students in Los Angeles, Miami, and Indianapolis.

By contrast, Rochester ranks rock-bottom nationally. In that high-poverty district, where the median income among families with children in the public schools is $26,000, students advanced about three grade levels in five years. Yonkers’ $48,000 median income is much higher, yet its schools barely do better, with students moving just 3.5 grade levels. (Among New York City public-school parents, the median income is $42,000.)

Reardon emphasized that test scores provide an important but incomplete picture of student learning, and growth rates are an imperfect measure of school effectiveness since factors outside of the classroom also influence how much students learn over time.

Still, he argued that officials who rate schools and parents who choose them would do much better to look at a school’s growth rate over its average test scores. In fact, he said, a focus on growth rates could theoretically drive down socioeconomic segregation since higher-income parents might be willing to enroll their children in schools with many poor students and low overall test scores if the schools nonetheless had outstanding growth rates.

Ready, however, pointed out that even when schools and districts are highly effective at helping students make progress, they are still unlikely to close the yawning achievement gaps that separate most poor and wealthier students from the time they start school. Reardon came to the same conclusion.

“The large gaps in students’ academic skills between low- and higher-[socioeconomic status] districts are so large,” Reardon’s analysis says, “that even the highest growth rate in the country would be insufficient to close even half of the gap by eighth grade.”

In response to the analysis, New York City education department officials pointed to the National Assessment of Educational Progress, a standardized test taken by a representative sample of students in each state and certain districts, including New York. Only one other district among the country’s 10 largest cities performed better in reading and math than New York, which had the highest share of low-income students reach the proficient level on the reading test.

“Our schools are the strongest they’ve ever been, with record-high graduation and college enrollment rates, and improving state test scores,” said the district’s spokesman, Will Mantell.

first steps

Superintendent León secures leadership team, navigates evolving relationship with board

PHOTO: Patrick Wall
Superintendent Roger León at Tuesday's school board meeting.

As Newark’s new superintendent prepares for the coming academic year, the school board approved the final members of his leadership team Tuesday and began piecing together a roadmap to guide his work.

The board confirmed three assistant superintendents chosen by Superintendent Roger León: Jose Fuentes, the principal of First Avenue School in the North Ward; Sandra Rodriguez, a Hoboken principal who previously oversaw Newark Public Schools’ early childhood office; and Mario Santos, principal of East Side High School in the East Ward. They join three other assistant superintendents León selected for his team, along with a deputy superintendent, chief of staff, and several other officials.

The three assistant superintendents confirmed Tuesday had first come before the board in June, but at that time none of them secured enough votes to be approved. During last month’s meeting, the board assented to several of León’s leadership picks and to his decision to remove many people from the district’s central office, but it also blocked him from ousting several people.

This week, Board Chair Josephine Garcia declined to comment on the board’s reversal, and León did not respond to a request for comment.

What is clear is that the board and León are still navigating their relationship.

In February, the board regained local control of the district 22 years after the state seized control of the district due to poor performance and mismanagement. The return to local control put the board back in charge of setting district policy and hiring the superintendent, who previously answered only to the state. Still, the superintendent, not the board, is responsible for overseeing the district’s day-to-day operations.

During a board discussion Tuesday, Garcia hinted at that delicate balance of power.

“Now that we’re board members, we want to make sure that, of course, yes, we’re going to have input and implementation,” but that they don’t overstep their authority, she said.

Under state rules, the board is expected to develop district goals and policies, which the superintendent is responsible for acting on. But León — a former principal who spent the past decade serving as an assistant superintendent — has his own vision for the district, which he hopes to convince the board to support, he said in a recent interview on NJTV.

“It’s my responsibility as the new superintendent of schools to compel them to assist the district moving in the direction that I see as appropriate,” he said.

Another matter still being ironed out by the board and superintendent is communication.

León did not notify the full board before moving to force out 31 district officials and administrators, which upset some members. And he told charter school leaders in a closed-door meeting that he plans to keep intact the single enrollment system for district and charter schools — a controversial policy the board is still reviewing.

The district has yet to make a formal announcement about the staff shake-up, including the appointment of León’s new leadership team. And when the board voted on the new assistant superintendents Tuesday, it used only the appointed officials’ initials — not their full names. However, board member Leah Owens stated the officials’ full names when casting her vote.

The full names, titles and salaries of public employees are a matter of public record under state law.

Earlier, board member Yambeli Gomez had proposed improved communication as a goal for the board.

“Not only communication within the board and with the superintendent,” she said, “but also communication with the public in a way that’s more organized.”

The board spent much of Tuesday’s meeting brainstorming priorities for the district.

Members offered a grab bag of ideas, which were written on poster paper. Under the heading “student achievement,” they listed literacy, absenteeism, civics courses, vocational programs, and teacher quality, among other topics. Under other “focus areas,” members suggested classroom materials, parent involvement, and the arts.

Before the school year begins in September, León is tasked with shaping the ideas on that poster paper into specific goals and an action plan.

After the meeting, education activist Wilhelmina Holder said she hopes the board will focus its attention on a few key priorities.

“There was too much of a laundry list,” she said.

early dismissals

Top Newark school officials ousted in leadership shake-up as new superintendent prepares to take over

PHOTO: Patrick Wall
Incoming Newark Public Schools Superintendent Roger León

Several top Newark school officials were given the option Friday to resign or face termination, in what appeared to be an early move by incoming Superintendent Roger León to overhaul the district’s leadership.

The shake-up includes top officials such as the chief academic officer and the head of the district’s controversial enrollment system, as well as lower-level administrators — 31 people in total, according to documents and district employees briefed on the overhaul. Most of the officials were hired or promoted by the previous two state-appointed superintendents, Cami Anderson and Christopher Cerf, a sign that León wants to steer the district in a new direction now that it has returned to local control.

The officials were given the option to resign by Tuesday and accept buyouts or face the prospect of being fired by the school board at its meeting that evening. The buyouts offer a financial incentive to those who resign voluntarily on top of any severance included in their contracts. In exchange for accepting the buyouts, the officials must sign confidentiality agreements and waive their right to sue the district.

Earlier this week, León submitted a list of his choices to replace the ousted cabinet-level officials, which the board must approve at its Tuesday meeting. It’s not clear whether he has people lined up to fill the less-senior positions.

It’s customary for incoming superintendents to appoint new cabinet members and reorganize the district’s leadership structure, which usually entails replacing some personnel. However, many staffers were caught off guard by Friday’s dismissals since León has given little indication of how he plans to restructure the central office — and he does not officially take the reins of the district until July 1.

A district spokeswoman and the school board chair did not immediately respond to emails on Friday about the shake-up.

Some staffers speculated Friday that the buyout offers were a way for León to replace the district’s leadership without securing the school board’s approval because, unlike with terminations, the board does not need to sign off on resignations. However, it’s possible the board may have to okay any buyout payments. And it could also be the case that the buyouts were primarily intended to help shield the district from legal challenges to the dismissals.

León was not present when the staffers learned Friday afternoon that they were being let go, the employees said. Instead, the interim superintendent, Robert Gregory, and other top officials broke the news, which left some stunned personnel crying and packing their belongings into boxes. They received official separation letters by email later that day.

The people being ousted include Chief Academic Officer Brad Haggerty and Gabrielle Ramos-Solomon, who oversees enrollment. Also included are top officials in the curriculum, early childhood, and finance divisions, among others, according to a list obtained by Chalkbeat.

In addition to the 31 being pushed out, several assistant superintendents are being demoted but will remain in the district, according to the district employees.

There was concern among some officials Friday about whether the turnover would disrupt planning for the coming school year.

“I don’t know how we’re going to open smoothly with cuts this deep,” one of the employees said. “Little to no communication was provided to the teams about what these cuts mean for the many employees who remain in their roles and need leadership guidance and direction Monday morning.”