Today we are summarizing where we are thus far with 2024 recovery.
Background
We initially began this Substack last year to track post-pandemic test score recovery. As most readers know, state-level test scores declined everywhere in ELA and math scores from 2019 to 2021 (the first post-pandemic testing year). Since then, recovery has been variable.
We have been sending posts as each state’s 2024 data becomes available, but today we’re sharing a summary for the states with 2024 data which we have already processed. This subset also is limited to states with data comparable to 2019 - in other words, we are excluding states with new state assessments since 2021, as we cannot make valid comparisons to pre-pandemic outcomes. If you want to look at the individual state posts, please visit the main page for this newsletter here.
Currently, we have 14 states that meet this criteria:
Colorado
Connecticut
Georgia
Idaho
Louisiana
Massachusetts
Michigan
Minnesota
Mississippi
North Dakota
South Carolina
Tennessee
Utah
West Virginia
Looking at Recovery in 2024
In the two graphs below, we present information for ELA and math outcomes by state for students in grades 3-8 in two ways:
First, we show the change in proficiency from 2019 to 2021 (for all states, this was a decline in both subjects), represented by the red dot for each state; and
Then, we show the change from 2019 to 2024, represented by a blue dot.
States with a negative value here remain below their 2019 rates
States with a positive value here have surpassed their 2019 rates
To discuss a concrete example: in Mississippi, in ELA, proficiency rates declined by 10.6 percentage points from 2019 to 2021. However, by 2024 the proficiency rates were 2.8 percentage points higher than in 2019. In Massachusetts, ELA pass rates declined by 6.2 percentage points from 2019 to 2021, but then further declined such that pass rates in 2024 were actually 13 percentage points lower than 2019.
As in 2023, the overall recovery pattern is significantly more varied in ELA than in math, which has shown more steady progress toward pre-pandemic proficiency rates for most states.
As a reminder, each state administers its own state assessment, so the number of students who are proficient in one state cannot be directly compared to another state, and is not the focus here. Rather, we believe there is value in reviewing patterns of academic recovery across states as a starting place for understanding where there are pockets of success to explore and build upon.
As more states release their 2024 data, we will periodically send out an updated version of these summary figures. And, as always, if the raw data are of value to you or your organization, please reach out and we are happy to help.
And, as always, you can ask Zelma to help explore your state’s assessment data for your state, district, or school, available at zelma.ai!
But…need to show overall proficiency rate, too. For example: Mississippi overall ELA proficient = 47.8%. Comparatively, Connecticut = 63.9%. So, while Mississippi may have a lot of growth (still under half, too), it is misleading to only present the start-finish, as the baseline (starting number) is critical to understanding/comparing data. Likewise, NY was 46, nearly comparable to Mississippi even with a decline from 2023 (and massive changes to test delivery, including a shift from paper to computer).
https://www.mdek12.org/sites/default/files/Offices/MDE/OEA/OPR/2024/maap_2024_results_executive_summary_final_8.15.24.pdf
https://portal.ct.gov/sde/press-room/press-releases/2024/improved-attendance-and-mathematics-and-science-scores
https://www.nysed.gov/news/2024/state-education-department-releases-preliminary-data-english-language-arts-mathematics-and-science-exams