🗓️ Week 10 - Unstructured Data (Text, Audio, Video)

2023/24 Winter Term

Author

We have been exploring tidy, rectangular data. But now it is time to explore the challenges associated with unstructured data: text, audio and video.

The lecture will be heavily demo-based.

👨‍🏫 Lecture Slides

Either click on the slide area below or click here to view it in fullscreen. Use your keypad to navigate the slides. You can also find a PDF version on Moodle.

Today, we’ll be using a couple of demos throughout the lecture. You can download the Jupyter notebooks associated with each demo here.

Use the link below to download the Project Gutenberg case study materials:

Use the link below to download the newspapers case study materials (.zip archive containing a Jupyter notebook (.ipynb) and a serialized dataframe (.pkl) ):

🎥 Looking for lecture recordings? You can only find those on Moodle.

Online and AI tools for modern literature review

I will show you how to use the following tools to conduct a literature review:

*Original tweet: https://twitter.com/Artifexx/status/1632277025472888833*

✍️ Coursework to prepare for next week’s lecture

Within your respective assigned groups, find 2-3 examples of AI ethical issues (you can look at newspapers or academic papers for sources of examples.)

✍️ Coursework to replace this week’s (original) missed lecture material

Read the following papers:

Hofman, Jake M., Amit Sharma, and Duncan J. Watts. 2017. “Prediction and Explanation in Social Systems.” Science 355 (6324): 486–88.
Rettberg, Jill Walker. 2022. “Algorithmic Failure as a Humanities Methodology: Machine Learning’s Mispredictions Identify Rich Cases for Qualitative Analysis.” Big Data & Society 9 (2): 205395172211312.
Hullman, Jessica, Sayash Kapoor, Priyanka Nanayakkara, Andrew Gelman, and Arvind Narayanan. 2022. “The Worst of Both Worlds: A Comparative Analysis of Errors in Learning from Data in Psychology and Machine Learning.” In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, 335–48. Oxford United Kingdom: ACM.
Verhagen, Mark D. 2022. “A Pragmatist’s Guide to Using Prediction in the Social Sciences.” Socius: Sociological Research for a Dynamic World 8 (January): 237802312210817.

And answer the following questions about each of the readings:

What is the main idea of the article?
What are the main takeaways?
What are the main implications of the article?

Feel free to work in pairs or groups of three on this homework.

📚 Recommended Reading

Check the end of slides for the list of references cited in the lecture.
Check the 📔 Syllabus for this week’s complete list of indicative and recommended readings.

📟 Communication

Post your reflections, questions, and links on Slack.
Book office hours if you want to discuss your coursework with either me or Riya.