๐Ÿ—“๏ธ Week 10 - Prediction vs Explanation

2023/24 Autumn Term

Author
Published

27 November 2023

This week, we wonโ€™t be using slides during the lecture and will instead be reading and discussing academic articles. Click on the Lecture Material to check out the list of articles.

The main question we would be asking ourselves is: what should be the role of modelling (be it statistical, machine learning, simulation, etc.) in the social sciences? Should we aim for explanations, make predictions, or a mix of both? Or is it time we drop the โ€œshouldโ€s?

๐Ÿ‘จโ€๐Ÿซ Lecture Material

Here is the plan we will follow this Monday:

A recap of data science terminology (~30 min)

Do you remember all the terms we have explored so far in this course?

Literature review (~70 min)

Then we will go through the literature on the role of modelling in the social sciences. We will read and discuss the following papers:

  1. Hofman, Jake M., Amit Sharma, and Duncan J. Watts. 2017. โ€œPrediction and Explanation in Social Systems.โ€ Science 355 (6324): 486โ€“88.

  2. Rettberg, Jill Walker. 2022. โ€œAlgorithmic Failure as a Humanities Methodology: Machine Learningโ€™s Mispredictions Identify Rich Cases for Qualitative Analysis.โ€ Big Data & Society 9 (2): 205395172211312.

  3. Hullman, Jessica, Sayash Kapoor, Priyanka Nanayakkara, Andrew Gelman, and Arvind Narayanan. 2022. โ€œThe Worst of Both Worlds: A Comparative Analysis of Errors in Learning from Data in Psychology and Machine Learning.โ€ In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, 335โ€“48. Oxford United Kingdom: ACM.

  4. Verhagen, Mark D. 2022. โ€œA Pragmatistโ€™s Guide to Using Prediction in the Social Sciences.โ€ Socius: Sociological Research for a Dynamic World 8 (January): 237802312210817.

Our guiding questions for each of the readings will be as follows:

  • What is the main idea of the article?
  • What are the main takeaways?
  • What are the main implications of the article?

Online and AI tools for modern literature review (~20 min)

I will show you how to use the following tools to conduct a literature review:

Original tweet: https://twitter.com/Artifexx/status/1632277025472888833

๐ŸŽฅ Looking for lecture recordings? You can only find those on Moodle.

โœ๏ธ Coursework to prepare for next weekโ€™s lecture

Within your respective assigned groups, find 2-3 examples of AI ethical issues (you can look at newspapers or academic papers for sources of examples.)

๐Ÿ“Ÿ Communication

  • Post your reflections, questions, and links on Slack.
  • Book office hours if you want to discuss your coursework with me.