Exclusive: Independent Review of ESSA Plans Rates States Strong on Accountability, Weak on Counting All Kids
Bellwether Education Partners and the Collaborative for Student Success brought together more than 30 advocates from across the ideological spectrum to evaluate plans from the 16 states and Washington, D.C., which filed their submissions with the U.S. Department of Education in April.
Some states whose plans received high marks include Louisiana and New Mexico, while plans submitted by Michigan, Arizona, and Massachusetts were among those seen as weak in multiple areas. ESSA replaces No Child Left Behind, the former federal K-12 law, and was deliberately crafted to shift decision-making and power back to the states and away from the federal government.
Overall, the reviewers were pleased with the breadth of indicators states are using to evaluate schools.
鈥淲e鈥檙e definitely seeing states broaden their accountability systems beyond static proficiency rates in reading and math,鈥 said Chad Aldeman, a principal at Bellwether Education Partners who led the review.
Some had measures in areas like science, social studies, and even physical education. All 17 jurisdictions that submitted in the first round had a measure on student growth, helpful for measuring schools鈥 progress with students who start school behind their peers.
鈥淚t鈥檚聽not just a conversation about status and proficiency; it鈥檚 a conversation about both and the interplay between them as a much more dependable measure of a student鈥檚 progress,鈥 said Gavin Payne, a consultant who previously worked for the Bill & Melinda Gates Foundation and as California鈥檚 chief deputy superintendent of public instruction.
The analysis is aimed both at helping states improve the plans that have been submitted and at serving as a resource for the majority of states, which will file theirs during a second review window in September.
A group of three to five generalist reviewers looked at each state鈥檚 plan, as did a reviewer focused on students with disabilities and one focused on English language learners. They rated each plan in nine areas, on a scale of 1 to 5.
The nine ratings areas were: goals, standards and assessments, indicators, academic progress, all students, identifying schools, supporting schools, exiting improvement status (improving enough to no longer need state interventions), and continuous improvement (learning from implementation and modifying the plan going forward).
(蜜桃影视: Meet the 29 Experts Joining Forces to Give State ESSA Plans a Harder Accountability Look)
Each state went through an 鈥渆xhaustive鈥 stakeholder review process, and this feedback will be one more piece to consider, said Chris Minnich, executive director of the Council of Chief State School Officers, which represents the state education leaders responsible for writing the ESSA plans.
鈥淪tates are going to take this feedback. I know they鈥檙e going to take it seriously,鈥 he said.
New Mexico had high ratings in the most categories, achieving a 5 in five of the nine categories. Reviewers praised it for its strong standards and assessment; simple, high-quality indicators of school success; and a clear list of possible interventions in underperforming schools, among other areas.
Louisiana also had high ratings, achieving a 5 in two categories.
In general, the foundation of Louisiana鈥檚 plan was 鈥渞eally strong,鈥 said Gini Pupo-Walker, director of education policy and strategic growth at Conexi贸n Am茅ricas, a nonprofit that works with Latinos, including on education, in Tennessee.
鈥淔or me, it was this great combination of high expectations, a lot of clarity, very easy-to-understand indicators, [and] an easy-to-understand school improvement scenario continuum,鈥 she said.
She also praised the state鈥檚 use of an A鈥揊 letter grade for schools and accountability measures that shift to higher standards over the years.
鈥淲hat鈥檚 an A today is not an A in three to five years, which is good,鈥 she said.
Pupo-Walker did, however, say that Louisiana鈥檚 plan, like those of many other states, could be improved for English language learners.
The Louisiana plan embeds English language learners鈥 language proficiency test results in broader measures of test scores, so it鈥檚 hard to tell immediately how well schools are doing with those students. It also allows former English language learners, those who mastered English within the past four years, to count toward measures of current English language learners. That blending together could mask the poor performance of some ELLs, she said.
A representative of the Louisiana Department of Education referred to a column by 74 contributor Conor Williams praising the state for finding ways to include small populations of English learners across the state.
Each of the 17 plans submitted is different, of course, but reviewers generally said the plans were lacking detail, particularly in how they鈥檒l make sure the performance of all students is counted in school accountability measures and how states will intervene in those that don鈥檛 perform well.
States will go further than what鈥檚 in the plans, Minnich of CCSSO said.
鈥淚 don鈥檛 think everything that鈥檚 in these plans is the entirety of what a state is going to do,鈥 he said. 鈥淚 don鈥檛 think it鈥檚 fair to think just the federal plan is going to be the only thing a state is going to do to help their kids.鈥
The Education Department will give feedback to states, though ESSA in most cases requires the department to approve state plans, making them eligible for federal education funds. Education Secretary Betsy DeVos has generally said she鈥檒l take a hands-off approach so long as states abide by the law, though staff in her department gave what was seen as tougher-than-expected feedback to three states earlier this month.
(蜜桃影视: ESSA Takes Shape: Feds Give Surprisingly Strong Feedback on Delaware, Nevada & New Mexico Plans)
Reviewers also cautioned that the state plans are turning to a 鈥渘ormative-based accountability鈥 system 鈥 that is, how well schools are doing in relation to one another, rather than against a set benchmark.
Some of that is because ESSA requires states to identify the bottom 5 percent of schools for intervention, Aldeman said. But it also sets a standard where a school in that bottom 5 percent might not actually improve, but could move out of that intervention status so long as other schools dropped more.
Nevada鈥檚 plan is better, he said, in that it requires both a ranking improvement and some other objective criteria to exit that status.
鈥淭hat combination, our peers felt, was a good way to balance both of those things,鈥 he said.
Minnich also noted that the normative identification requirement could sweep up schools that have improved dramatically but remain in that bottom 5 percent, which could prove demoralizing for those schools.
鈥淪tates are going to have to work on this, but the law itself is written in a normative way,鈥 he noted.
Interventions in low-performing schools generally was a problem, both Aldeman and Payne said.
Many proposed generic 鈥渘eeds assessments鈥 or professional development, suggesting they haven鈥檛 learned that 鈥渨eak鈥 interventions don鈥檛 improve schools, Aldeman said.
Payne noted that there鈥檚 no real 鈥渟tate of the art鈥 in terms of turnaround, though it would be a helpful area for states to learn from one another.
鈥淚 think it鈥檚 honestly the hardest struggle. Some of the problems are so intractable, either from a policy perspective or an actual program perspective, it鈥檚 the hardest nut to crack,鈥 he added.
Minnich, too, raised the issue of a lack of best practices in the area.
鈥淚f we knew exactly how to turn around schools, we would do it. It鈥檚 less important to me what words states write; it鈥檚 more important to me what states do to help these schools,鈥 he said.
No state received the top score in 鈥渁ll students,鈥 the measure of whether a state plan masks the performance of some subgroups of students or has adequate checks in place to ensure all students receive a high-quality education.
Advocates earlier this year said some state plans obscured the performance of children of color, English language learners, low-income kids, or students with disabilities. They did so by setting low expectations for those groups, or requiring them to be low-performing by every metric before intervening. Others set high 鈥渘-sizes,鈥 a wonky term for the minimum number of students that would have to be in a particular subgroup before their results were separated out and reported for accountability purposes.
States should be trying to include as many students as possible without violating their privacy, Minnich said.
Many are doing so, and in some cases actually counting more students than they did under old accountability standards, he said.
鈥淚 don鈥檛 think it鈥檚 appropriate for us to just sort of universally say states aren鈥檛 doing as well on subgroups,鈥 Minnich said.
Among specific states, Michigan had the lowest ratings, getting a 1 in seven of the nine categories. Four other states 鈥斅燗rizona, Connecticut, Maine, and Vermont 鈥斅爀ach received a 1 in four of the nine categories.
Michigan鈥檚 plan stood out for its lack of details 鈥 it even proposes three possible accountability systems, only one of which would meet ESSA鈥檚 requirements, without naming which one it plans to use, the reviewers said.
鈥淎s presented, Michigan鈥檚 plan is missing key elements that are required in order for the state to receive federal education funding,鈥 the reviewers wrote in their final assessment.
(蜜桃影视: ESSA as Campaign Issue? Michigan Lt. Gov. Wants Plan Back in New Debate on Counting Special Ed Kids)
The lack of detail and transparency in Michigan鈥檚 plan was 鈥渟tartling,鈥 said Kerry Moll, vice president of policy and advocacy at Stand for Children.
On goals, for instance, the state aims to be among the top 10 in the country, but it doesn鈥檛 provide details of what that means or how it will get there, Moll said.
鈥淥n a surface level, they鈥檙e directionally right. I think they need to get perhaps more support,鈥 she said.
Michigan Department of Education representatives did not respond to requests for comment. U.S. Education Secretary Betsy DeVos is from Michigan; her department has not released any public feedback on Michigan鈥檚 plan.
Massachusetts, too, was short on detail in a way that surprised many reviewers, given its long history as a top-performing state in public education.
鈥淲hile there are a few bright spots, Massachusetts鈥 plan largely lacks the clarity and detail that are necessary to give the state the best opportunity to improve outcomes in the classroom,鈥 Jim Cowen, executive director of the Collaborative for Student Success, said in a press release.
Massachusetts鈥檚 plan would measure growth by comparing students to one another rather than an objective standard, and growth and proficiency standards aren鈥檛 aligned to grade-level standards, the reviewers said. The plan lacks specifics on how low-performing schools will be identified, reviewers said.
Massachusetts is in the process of changing its assessment system and will set new baselines for grades 3鈥8 in English and math after this year鈥檚 results, with other standards to follow in later years, said Jacqueline Reis, a spokeswoman for the Massachusetts Department of Elementary and Secondary Education.
鈥淲hile we鈥檙e still awaiting feedback from USED, we appreciate Bellwether鈥檚 analysis of both the strengths of our proposal and the areas where more detail might be useful. We look forward to continuous improvement of our ESSA state plan through the amendment process as allowed under ESSA and in partnership with Massachusetts educators and USED,鈥 she said in an email.
Disclosure: The Bill & Melinda Gates Foundation provides financial support to 蜜桃影视.
Andy Rotherham co-founded Bellwether Education Partners. He sits on 蜜桃影视鈥檚 board of directors and serves as one of the site鈥檚 senior editors.聽
Did you use this article in your work?
We鈥檇 love to hear how 蜜桃影视鈥檚 reporting is helping educators, researchers, and policymakers.