๐ Class Preparation
2024/25 Autumn Term
๐บ๏ธ Context
This week, weโll do our first case study!
We are going to look in depth at the Ofqualโs A-levels โmutant algorithmโ fiasco - a pivotal case that illustrates the dangers of poor algorithmic design (Paulden 2020) (Kelly 2021) (Hern 2020).
In 2020, in response to the COVID-19 pandemic, both A-levels and GCSE exams were cancelled in England and Ofqual, the regulator of qualifications, exams and tests in England was tasked by the then secretary of state for education to โensure, as far as is possible, that qualification standards are maintained and the distribution of grades follows a similar profile to that in previous yearsโ.
Ofqual then produced an algorithm to compute the A-levels grades. After public outcry and criticism, the grades computed by the algorithm had to be withdrawn(Sabbagh 2020).
๐ Class Preparation
Step 1: Please read the following articles before the week 4 class.
๐๏ธ In the news
Sabbagh, Dan. 2020. โAlgorithm and blues: Gavin Williamsonโs week of A-level chaos.โ The Guardian, August.
Hern, Alex. 2020. โOfqualโs A-level algorithm: why did it fail to make the grade?โ The Guardian, August.
๐ Academic
- Kelly, Anthony. 2021. โA tale of two algorithms: The appeal and repeal of calculated grades systems in England and Ireland in 2020.โ British Educational Research Journal 47: 725โ741.
- Paulden, Tim. 2020. โA Cutting Re-Mark.โ Significance 17 (5): 4โ5, October 2020.
๐ธ๏ธ LSE Blogs
- โโF**k the algorithmโ?: What the world can learn from the UKโs A-level grading fiascoโ LSE Impact Blog.
Step 2: After youโve read the articles, consider the following questions:
- How did the OFQUAL algorithm work? And what parameters did it take into account when predicting grades?
- How did various countries (i.e England, Scotland, Ireland, France, Germany) deal with the problem of having to assign grades for their high school final exams in the midst of the pandemic?