πŸ§‘β€πŸ« Week 08 Lecture

From APIs to dataframes to databases (SQLite and SQL queries)

Author
Published

19 November 2024

Image created with the AI embedded in MS Designer using the prompt 'abstract salmon pink light blue icon depicting the metaphysical experience of cleaning up, reshaping, pivoting, and manipulating data in search of the purest insights in data science.'

πŸ“ƒ Schedule

πŸ“Location: Thursday 21 November 2024, 4 pm - 6 pm at CLM.5.02

πŸ“‹ Preparation

  • Fill out the πŸ“‹ LSE Course Survey (Note: Jon is also considered as your teacher in the form). 1

  • Start working on the ✍️ W10 Summative Exercise. Try to go as far as connecting to the Spotify API and saving the requests to simple JSON files.

πŸ“ Lecture Notes

You already know how to collect data from APIs and you have been working with dataframes which were later stored in JSON or CSV files.

In this lecture, we will expand our knowledge of these concepts by learning two new things:

  • How to handle authentication and credentials when working with APIs? Crucially, you will see how to β€˜hide your secrets’ when working with APIs.

  • What is a database and how do I store my data in a database? We will learn about a very simple database called SQLite and how to interact with it using the Structured Query Language (SQL).

You will find the notebooks/W08-Lecture-* notebooks on the the GitHub logo lse-ds105/ds105a-2024 repository.

Footnotes

  1. πŸ“‹ Why is the LSE Course Survey important?

    LSE distributes a survey each academic term to collect essential student feedback about their courses.

    Your feedback is absolutely crucial, as the LSE Course Survey is the most formal way to provide input to the School.

    - It lets you comment on course content, teaching quality, and resources.
    - The feedback informs Teaching Committee meetings, guiding improvements for future cohorts.
    - Teaching staff discusses the feedback and implements necessary changes.
    β†©οΈŽ