This is the most important post you will read today or this week, maybe this month, if you care about the future of American public schools. It’s about the importance of honest research; it’s about debunking false narratives. It’s about the media printing inaccurate stories without the necessity of fact-checking. It’s about irresponsible journalism.
The Washington Post published an article loaded with inflated claims by a British journalist, Ian Birrell, about the “miracle” in New Orleans that followed the devastation caused by Hurricane Katrina in 2005.
Five years later, Obama’s Secretary of Education Arne Duncan boldly said that the hurricane was “the best thing that happened to the education system in New Orleans.” Birrell agrees with him.
In 2018, Betsy DeVos’ Department of Education allocated $10 million to fund the National Center for Research on Education Access and Choice at Tulane University (REACH). In 2023, two of the nation’s leading advocates of choice–the Walton Foundation and the City Fund–gave REACH $1 million “to jointly support a three-year research project on the system-level effects of charter schools at the national level. The goal is to learn how charter schools improve student outcomes and better understand the role of policy in fueling these changes.”
After Katrina, the state converted New Orleans into an (almost) all-charter district. All of the district’s teachers were fired, and their union dissolved. Charter chains and TFA poured into the district as did funding by the federal government and major foundations. About one-third of the students never returned after the hurricane.
Linda Darling-Hammond and her Stanford colleagues Frank Adamson and Channa Cook-Harvey studied the charterization of New Orleans in 2015. Unlike most other studies, they looked closely at student experiences as well as data. They concluded that the district was not only highly segregated by race and class, but was “one of the lowest-performing districts in one of the lowest-performing states in the nation,” not a model to be replicated.
Rutgers’ scholar Bruce Baker examined the advocates’ claims in 2019 and concluded that they overlooked or minimized two significant factors: one, demographic changes (a reduction in concentrated poverty), and two, a huge infusion of external funding.
But Birrell is not an education journalist so he seems not to have looked for views that countered the charter enthusiasts.
Gary Rubenstein, former member of TFA and career high school mathematics teacher, did the research that Birrell failed to do. He explained why there was no “miracle” in New Orleans:
It has been 20 years since Hurricane Katrina wiped out the New Orleans schools system causing it to be replaced with all charter schools. And it has been over 15 years since former Secretary of Education Arne Duncan said, based on what he considered early evidence of the success of those charter schools that Katrina was “the best thing that happened to the education system in New Orleans.” And it has been also about 15 years since educational researchers have been continuously debunking the New Orleans educational miracle.
So I was quite surprised to see that The Washington Post just published an opinion piece with the headline “‘Never seen before’: How Katrina set off an education revolution — Twenty years after the hurricane, taking stock of the miracle in New Orleans Schools.”
Reading this Op Ed was a strange experience for me. Supposedly based on recent research, it basically trotted out all the old bogus claims that I hadn’t heard anyone claim in at least ten years. Since it was The Washington Post, I figured it had to be Jay Matthews who has been known to write puff pieces (and books) about KIPP and Michelle Rhee. But these talking points were so antiquated that it would have been odd even for him to use them. No, this anachronistic Op Ed was not from any of the usual suspects but from a name I had never seen before: Ian Birrell.
Reading up on the biography of Ian Birrell, things made a bit more sense. Ian Birrell is a British journalist who has mainly written about international affairs. I’m sure he is a very competent journalist but this is his first foray into education reporting. So he heard about the New Orleans ‘miracle’ for the first time, got a totally biased ‘research’ report from Doug Harris supporting the miracle and, not knowing that there has been an ongoing battle over education reform in this country where the ‘reformers’ have all kinds of tricks for misrepresenting data to advance their agenda. So, thinking he has discovered something incredible, of course he wants to write something about it. But what he writes is completely naive since he doesn’t know the right questions to explore to get to the truth. It’s kind of like if I decided to become a nature reporter and wrote a thing about Big Foot based on just photoshopped images and unreliable first hand accounts.
The New Orleans Miracle is pretty easy to debunk if you know the right questions to ask.
So the first thing to look at is the Louisiana AP scores. Even though AP tests and the way they are sometimes misused, are not the only thing that matters in looking at a state’s education quality, colleges do look at AP scores so it is a bit of a measure of ‘college readiness.’ From the College Board website, it can be seen that Louisiana has the third worst AP passing rate in the country.
In the Washington Post Op Ed, Birrell describes the interventions after Katrina as follows: “They fired all 7,000 teachers, sidelined unions, invited ambitious experts to run the schools and offered parents almost total freedom over where to send their children.”
If he knew the full history of this he would know that the “ambitious experts to run the schools” included KIPP, the famous charter chain created by two Teach For America alums. So to measure the size of the miracle twenty years later, just check to see how the KIPP Booker T. Washington High School students are doing academically. For this I went to the recent US News & World Report data.
So the gold standard charter network in the miracle city of New Orleans has an 11% Math proficiency, a 21% Reading proficiency, and a 10% Science proficiency.
As far as AP scores at the top charter chain in the miracle city of New Orleans, the exam pass rate is just 2%.
But maybe you think I am cherry picking a KIPP school that was never mentioned in the Op Ed. In it Birrell writes about a specific ambitious expert “Among those watching the horrific Katrina news footage 20 years ago was a former corporate financier with Boeing who was planning to move into education. Ben Kleban told me in a 2010 interview how, soon after the disaster, at age 26, he moved to the city from New York to set up a school, starting in a refurbished building with 120 pupils ages 11 to 15. His venture grew fast, took over a nearby failing school, improved proficiency tests and won a national medal for its successes. “For too long,” he said, “the public school system found excuses rather than being properly accountable to parents.” He explained how he relied on “basic business practices” with a daily flow of data on attendance, discipline and classroom performance.”
So I looked up Ben Kleban to see how his school was doing. It is a little confusing but it seems like the entire charter chain he created was shut down in 2018 except maybe one school which is called Walter L. Cohen High School. For them, there are no AP passing scores reported. For their test scores, they are a little better than KIPP for math and reading but lower on science.
So what evidence did Birrell see that convinced him that the New Orleans miracle was authentic? Doug Harris has some nice graphs that shows test scores in New Orleans scores now compared to test scores in New Orleans 20 years ago. But of course this is not the proper comparison to make. The way a scientific experiment works is that if you want to measure the impact of an effect, you try to take a group and split it in half and apply the impact to half of the subjects and make the rest the ‘control group.’ So in this situation, had they not made all the New Orleans schools into charter schools but instead randomly picked half the schools and made them charters and left the other half under local control, then you could compare the results of the two groups after 20 years and, as long as the groups continued to be randomly distributed, that could be a useful way to make a comparison.
But that is not what happened since unfortunately there is no control group to compare to. It is quite possible that the scores now are lower than they would have been had Katrina never happened and the New Orleans charter experiment had never happened. But even without anything to compare to, the data from that one gold standard KIPP is, in my opinion, pretty good evidence against the miracle. Just like the way you can check the temperature of a Thanksgiving turkey by putting a meat thermometer into one spot of the Turkey, looking at what is supposed to be the best charter school is a good measure of all the schools since the KIPP is surely better than the average school there.
I thought I’d never have to debunk the New Orleans miracle again, but I guess I’m going to have to every five or ten years for each milestone anniversary of “the best thing that happened to the education system in New Orleans.”
My view: Gary Rubenstein is a national treasure. The major editorial boards should check with him before they publish stories about a “miracle” school or “miracle” district.
دیدگاهتان را بنویسید