LSE ME204 – Data Engineering for the Social World

Author

Dr Jon Cardoso-Silva

Image Created with DALL·E. Prompt: 'a favicon for a webpage of a course with the topic 'Data Engineering for the Social World' that is more modern, contemporary and geometric'

🔗 Link to the course page on the Summer School website.

📑 Course Brief

Aims: In this course, you will develop the skills to collect public data from the Web or from APIs, connect multiple data sources and build dashboards to communicate insights obtained from data.

How: A hands-on learning experience! Throughout the course, you will actively engage with the material and apply your knowledge in practical scenarios.

🎯 Learning Objectives

  • Reason about the structure and format of data (CSV, JSON, XML, etc.)
  • Collect data from real websites and APIs
  • Identify the best practices for efficient data storage (appropriate data types)
  • Put data in a 'tidy' format, rendering it suitable for further analysis
  • Master the programming skills to clean, pre-process and reshap data – where 80% of the time is spent in data analysis
  • Conduct exploratory data analysis, summarizing the main characteristics of the data and visualizing it
  • Basics of the SQL language to query databases
  • Use GenAI tools (ChatGPT and GitHub Copilot) to write and debug code efficiently
  • Build simple websites to report and communicate your findings effectively

Select Academic Year/Term:

Archives: