study shows

The $100 million question: Did Newark’s school reforms work? New study finds big declines, then progress

PHOTO: TechCrunch/Creative Commons
Mark Zuckerberg

It was announced with much fanfare on Oprah in 2010: dramatic changes were coming to Newark’s schools, financed with $100 million from Facebook founder Mark Zuckerberg.

Those changes — including a new teachers’ contract and the expansion of charter schools — proved controversial and challenging to implement. But there hasn’t been a clear answer to the key question: Are students learning more now than they were then, thanks to the reform effort?

A new study, released Monday through the National Bureau of Economic Research, is among the first to try to answer.

It finds that by 2016, Newark students were making greater gains on English tests than they were in 2011. But the results are not uniformly positive. It finds no impact in math. And in both subjects, the reforms seem to have come with a cost: student achievement declined substantially in the first three years of the changes.

The study was funded by the Chan-Zuckerberg Initiative and conducted by a number of Harvard researchers, including Tom Kane, who said that the study’s results were independent of its funding source.

“This study confirms the progress that is being made in Newark schools,” Newark schools superintendent Chris Cerf said in a statement, “and shows that reforms undertaken — particularly in areas like citywide enrollment and expansion of high quality schools — are making a real difference for Newark students.”

Their findings have both educational and political import.

The 2010 announcement was heralded as a rare and powerful bipartisan alliance, with Democratic Mayor Cory Booker and Republican Governor Chris Christie united in their plan to make sweeping changes to Newark’s struggling schools and backed by Zuckerberg’s millions.

(The money — $100 million with another $100 million match — seemed eye-popping, though it only accounted for 4 percent of school spending in the city over the five years of the grant.)

The changes would include not only charter schools and performance-based pay for teachers, but also the closure of a number of district schools, and new enrollment system encompassing district and charter schools.

The initiatives soon came under scrutiny. Residents and students pushed back forcefully against some of the changes implemented by schools chief Cami Anderson. Ras Baraka, a school principal and sharp critic of Anderson, was elected mayor in 2014, beating Shavar Jeffries, who was more amenable to the reforms. Anderson was replaced by Cerf in June 2015.

Journalist Dale Russakoff wrote a largely critical account of changes that focused on how a large share of the Zuckerberg money went to high-paid consultants. Since, media reports have largely suggested that the approach failed and that the money was wasted.

Now, the central characters have largely moved on. But Zuckerberg and Booker, now a U.S. senator, are rumored to have national political ambitions, including potential runs for president in 2020.

Here are the key takeaways:

The overall effect of the reforms on student learning was mixed.

“By the fifth year of reform, Newark saw statistically significant gains in English and no significant change in math achievement growth,” the researchers conclude. “Perhaps due to the disruptive nature of the reforms, growth declined initially before rebounding in recent years.”

Source: “Assessing the Impact of the Newark Education Reforms”

The research, also released as a non-technical report, looks at two ways the reforms may have affected students: by making existing schools better and by moving students to more effective schools, including charters. Moving students to better schools did help, but existing schools didn’t consistently improve – and in the first three years got substantially worse in both subjects.

Something we still don’t know is what the cumulative impact of the reforms was on a student who attended Newark schools for five straight years. The study doesn’t answer that.

Another perhaps surprising finding, considering the common description of Newark schools as failing: The district had a growth rate before the changes that was about average for similar districts in New Jersey.

Students seemed to benefit from school closures.

The study finds students whose school was closed subsequently saw higher test score growth, particularly those moving into better schools. That’s consistent with other research. But Newark did not seem to close its worst schools, and even shut down a few schools that were average or above average. That might have limited the positive effects of closures.

Charter schools continued to outperform the district, but have grown less effective.

Part of the reform strategy was to expand Newark’s charter sector, since charter schools had been shown to substantially raise student test scores, relative to the district. The latest study found that charters continued to do better than the district, but the gap has essentially been cut in half.

That’s because charters’ effectiveness has decreased since 2011. It’s not clear why, but three times as many students attend charter schools in Newark now compared to 2010. That influx of new students and accompanying growing pains may be part of the explanation. 

The study also shows that charter schools serve different students than the district. Newark’s charter students are more likely to be African-American and female, and less likely to have a disability or limited proficiency in English.

The study comes with a few important caveats.

The spike in test-score growth toward the end of the five-year grant coincided with the introduction of a new test aligned with the Common Core, the PARCC. It also coincided with an increase in students opting out of state tests, both in Newark and statewide. The researchers try to account for this, but it’s not entirely clear if those changes skewed the findings.

Also, the researchers came to their conclusions by comparing test score growth of Newark’s students to students with similar backgrounds and in similar schools across New Jersey. That doesn’t guarantee that the study is able to isolate the effects of the reforms, but does allow for comparisons to places without the Zuckerberg money or attention.

The results don’t show whether the reforms “worked” — because that’s a complicated question.

The study is focused on standardized test scores, a significant limitation that means it doesn’t speak to other effects of the reforms on students. A separate analysis, funded by the Community Foundation of New Jersey and also released Monday, points out that high school graduation rates in Newark rose substantially in 2016 and 2017, after remaining flat between 2012 and 2015. Enrollment in the city schools has also trended upward in recent years. 

Source: “Moving Up: Progress in Newark’s Schools from 2010 to 2017”

The results also don’t account for political turmoil or the sense that the reforms were done to — rather than with — the community in Newark, whose schools had been under state control for a over two decades. An agreement was finalized in September to return them to community control.

“Ultimately we’re giving the parents the opportunity to have their democratic rights back,” Baraka told NPR, who argued in the same interview that the Zuckerberg dollars had not improved the school district. “There is no real kind of causal relationship between that money and the development of the traditional public schools in Newark.”

Priority schools

Struggling Tennessee schools find out Friday if they could face state intervention

PHOTO: Marta W. Aldrich
Tennessee's 2018 list of priority schools will chart the state's school improvement strategies, investments, and interventions for at least the next year. The state issued earlier priority lists in 2012 and 2014.

School communities hovering at the bottom on student achievement have been watching anxiously to see how they could fare under Tennessee’s new system for holding schools and districts accountable.

They’ll find out on Friday when the Education Department releases its 2018 list of “priority schools” in Tennessee’s bottom 5 percent, the threshold for determining state investments such as extra money — and interventions as harsh as takeover and even closure.

The unveiling will come as the state Board of Education signs off on the list during a specially called meeting.

The 2018 priority list will be the state’s first in four years, as well as the first under a new accountability system developed in response to a 2015 federal education law. The roster will chart the state’s school improvement strategies, investments, and interventions for at least the next year.

Underperforming charter schools could face the toughest consequences. Those making the list will be shuttered next spring if they were authorized by local school districts. (Tennessee has state-authorized charters too, but those schools face closure only if they rank at the bottom in both 2018 and 2021.)

Calculating this year’s priority list — which initially was supposed to factor in the last three years of student test scores — has not been simple.

Because technical problems marred Tennessee’s return to online testing this spring, state lawmakers passed legislation ordering that the most recent scores can’t be used to place new schools on the priority list or move them into the state’s Achievement School District for assignment to charter networks. Instead, the newest priority schools are based mostly on student achievement from the two prior school years. However, a school on the 2014 list could potentially come off the new roster if its scores were good this year.

The legislation doesn’t mean that some repeat priority schools can’t be taken over by the state based on previous years’ test results. However, most of those are expected to continue under their current state-monitored school improvement plans. Schools that are new to the list will have to develop similar plans in collaboration with the Education Department.


READ: One state, three lists of troubled schools — another consequence of Tennessee’s testing mess


The newest priority lineup will be among a flurry of school accountability lists being released on Friday. The State Board also will sign off on “reward schools” that have achieved the highest performance or made extraordinary progress since last year, as well as a district roster that rates 145 Tennessee school systems based on a multitude of new measures under the state’s education plan as part of the federal Every Student Succeeds Act, or ESSA.

You can find the list of schools at risk of making the newest priority list here.

next steps

Adams 14 pledges ‘transformational change’ as Colorado revisits school improvement plans

Aris Mocada-Orjas, left, and Abel Albarran work on a math problem at Hanson Elementary in Commerce City. (Denver Post file photo)

Two Colorado school districts face critical hearings this fall that will determine how much autonomy they’ll retain after failing to turn around years of dismal performance.

Two schools in the Pueblo 60 district in southern Colorado, Adams City High School, and the entire Adams 14 district based in Commerce City are now in their eighth year on a state watchlist and will need to come back before the State Board of Education in November to explain why improvement plans approved last year didn’t generate the hoped-for progress in student achievement.

These hearings will mark the first time state officials revisit the school and district improvement plans. While state takeover isn’t on the table, as it has been in other states, they could tell school administrators to keep working on their plans, make small tweaks, or order more drastic intervention, including closing schools, turning over management to outside organizations or even dissolving districts, though that last option would be politically challenging.

A spokesman for the Adams 14 district said leaders there recognize they need to make “transformational change.”

“We will have to prove to the state board that we are serious this time,” said Alex Sanchez, the district spokesman. “We’ve been at this eight years, and we need to be reflective of those eight years and make sure we are moving forward with an actual plan that will truly address the needs of Adams 14 children.”

The Colorado Department of Education released preliminary school ratings based on spring test scores and other data late last month. Adams 14 remained on “priority improvement,” the second lowest tier in the state’s five-tiered rating system for districts.

Through multiple school boards and three superintendents, the district did not meet promises to raise scores enough to escape from the state’s watchlist — also known as the accountability clock. The State Board of Education last year gave Adams 14 just one year to demonstrate progress. Most other schools and districts on the list got at least two years to see if their plans yielded better outcomes.

In test scores and then ratings released in August, Adams 14 showed some areas of improvement, but not enough to raise the state’s overall rating for the district.

Schools and districts can appeal their ratings, and they don’t become final until December.

Adams 14 may appeal the ratings of up to three schools, and that could change the district’s overall rating. But Sanchez said Superintendent Javier Abrego, his new leadership team, and the school board recognize that the district needs to make large-scale changes regardless of the outcome of those appeals.

“It’s not about going after a decimal of a point here and there,” Sanchez said. “We really need to address the hard realities.”

State education officials don’t want to wait too long before looking at next steps for struggling schools and districts.

“We’re moving forward,” Colorado Department of Education Deputy Commissioner Alyssa Pearson told the state board earlier this month.

Colorado Department of Education

A state review panel will visit Adams 14 schools and make recommendations by October. The state also plans to solicit written feedback from community members before the next hearing.

State accountability officials want the state board to render a decision on the same day as the hearing.

The quick turnaround is intended to allow plenty of planning time if the state board wants to order more substantial changes. The first time the state board reviewed improvement plans, in spring 2017, it largely accepted districts’ proposals and shied away from more aggressive interventions.

But some board members complained that the short time frame essentially gave them no choice. How, for example, were they to order turning over school management to a charter organization for the next school year if no potential operator had been identified in the spring?

Will the state board press for more changes this time? That remains to be seen. State board member Jane Goff asked skeptically if her fellow board members want districts to “start from scratch” and suggested these meetings would be a “check-in” rather than a full hearing.

Board member Val Flores said pushing for too much change can hurt kids.

“We want change for the better, but change can hurt — and the people who hurt the most are kids,” she said. “We can’t hurry along a process that is going to take time.”

The improvement plan for the 7,500-student Adams 14 district includes a partnership with Beyond Textbooks, an Arizona-based nonprofit now also working in the Sheridan district. The nonprofit’s role in Adams 14 includes training teachers to help students reach state standards and to better work with students who don’t grasp material the first time, as well as train coaches for teachers.

The improvement plan was partly tied to a biliteracy program that the district has put on hold, a source of ongoing disagreement and frustration in the district, which has one of the highest percentages of English language learners in the state.

The pressures of turnaround work have frayed relationships with the community and with district staff, with parents pushing back against the loss of the biliteracy program, cuts to recess, and other changes. The top leadership team saw extensive turnover in the past year, and the board president resigned.

Communication has not always been smooth either. State officials went to Adams 14 board meetings throughout the year to provide updates, often alerting the school board that the district was not on track to meet targets. School board members were sometimes surprised to hear the news. After hearing the concerns of one state official at a meeting in February, board members argued about whose responsibility it was to keep up progress toward the state-ordered plan.

Sanchez said district officials and board members know they need to work with the state and that the district may need outside help to make big changes.

“Moving forward, we have to think big, we have to think bold, we have to think transformational change,” he said. “It will take many resources and many strategic partners to get that work done.”

Chair Angelika Schroeder said the state board will be focused on the needs of students.

“Poor education hurts kids,” she said. “The kids are why we’re thinking about intervening in a district.”

Reporter Yesenia Robles contributed.