🗓️ Week 10 - Case Study: Use of LLMs in senstive contexts

2024/25 Autumn Term

Author

This lecture will start from where we left off last week (the newspaper case study) but will otherwise mainly focus on a case study: How should the use of large language models (e.g ChatGPT) be handled in sensitive contexts (e.g legal, medical or child protection contexts)?

👨‍🏫 Lecture Slides

Either click on the slide area below or click here to view it in fullscreen. Use your keypad to navigate the slides. You can also find a PDF version on Moodle.

You can download the newspaper case study materials (left-over from last week) by using the link below (.zip archive containing a Jupyter notebook (.ipynb) and a serialized dataframe (.pkl) ):
Today’s main case study will look at the following articles:
- Luke Taylor (2023). “Colombian judge says he used ChatGPT in ruling”. The Guardian – (Taylor 2023)
- Amy Guthrie (2023). “Colombian Judge Uses AI Tool ChatGPT in Court Ruling”. Law.com International – (Amy Guthrie 2023)
- Benjamin Weiser (2023). “Here’s What Happens When Your Lawyer Uses ChatGPT”. The New York Times – (Weiser 2023) (You can also access this article through LSE Library Search)
- Dan Milmo (2023). “Two US lawyers fined for submitting fake court citations from ChatGPT”. The Guardian – (Milmo 2023)
- Simon Gibson (2023). “Cautioning the legal sector: AI is a tool, not a panacea”. Legal Futures – (Simon Gibson 2023)
- Hibaq Farah (2023). “Court of appeal judge praises ‘jolly useful’ ChatGPT after asking it for legal summary”. The Guardian – (Hibaq Farah 2023)
- Pranshu Verma and Will Oremus (2023).“How lawyers used ChatGPT and got in trouble”. The Washington Post – (Pranshu Verma and Will Oremus 2023)
- Leyland Cecco (2024). “Canada lawyer under fire for submitting fake cases created by AI chatbot”. The Guardian – (Leyland Cecco 2024)
- Josh Taylor (2023) . “AMA calls for stronger AI regulations after doctors use ChatGPT to write medical notes”. The Guardian – (Josh Taylor 2023)
- Josh Taylor (2024) . “AI ban ordered after child protection worker used ChatGPT in Victorian court case”. The Guardian – (Josh Taylor 2024)

🎥 Looking for lecture recordings? You can only find those on Moodle.

📚 Recommended Reading

Check the end of slides for the list of references cited in the lecture.
Check the 📔 Syllabus for this week’s complete list of indicative and recommended readings.

📟 Communication

Post your reflections, questions, and links on Slack.
Book office hours if you want to discuss your coursework with either me, Barry or Stuart.

📝 Coursework (to bring to next week’s lecture)

Find one or two examples data science/AI applications with ethical issues
- What kinds of issues are these?
- Where do they stem from?

Be prepared to discuss your examples with the rest of the class

References

Amy Guthrie. 2023. “Colombian Judge Uses AI Tool ChatGPT in Court Ruling.” Law.com International. https://www.law.com/international-edition/2023/02/08/colombian-judge-uses-ai-tool-chatgpt-in-court-ruling/?slreturn=20241202-41222.

Hibaq Farah. 2023. “Court of Appeal Judge Praises ‘Jolly Useful’ ChatGPT After Asking It for Legal Summary.” The Guardian. https://www.theguardian.com/technology/2023/sep/15/court-of-appeal-judge-praises-jolly-useful-chatgpt-after-asking-it-for-legal-summary.

Josh Taylor. 2023. “AMA Calls for Stronger AI Regulations After Doctors Use ChatGPT to Write Medical Notes.” The Guardian. https://www.theguardian.com/technology/2023/jul/27/chatgpt-health-industry-hospitals-ai-regulations-ama.

———. 2024. “AI Ban Ordered After Child Protection Worker Used ChatGPT in Victorian Court Case.” The Guardian. https://www.theguardian.com/australia-news/2024/sep/26/victoria-child-protection-chat-gpt-ban-ovic-report-ntwnfb.

Leyland Cecco. 2024. “Canada Lawyer Under Fire for Submitting Fake Cases Created by AI Chatbot.” The Guardian. https://www.theguardian.com/world/2024/feb/29/canada-lawyer-chatgpt-fake-cases-ai.

Milmo, Dan. 2023. “Two US Lawyers Fined for Submitting Fake Court Citations from ChatGPT.” The Guardian (London). https://www.theguardian.com/technology/2023/jun/23/two-us-lawyers-fined-submitting-fake-court-citations-chatgpt.

Pranshu Verma, and Will Oremus. 2023. “How Lawyers Used ChatGPT and Got in Trouble.” The Washington Post. https://www.washingtonpost.com/technology/2023/11/16/chatgpt-lawyer-fired-ai/.

Simon Gibson. 2023. “Cautioning the Legal Sector: AI Is a Tool, Not a Panacea.” Legal Futures. https://www.legalfutures.co.uk/blog/cautioning-the-legal-sector-ai-is-a-tool-not-a-panacea.

Taylor, Luke. 2023. “Colombian Judge Says He Used ChatGPT in Ruling.” The Guardian 2. https://www.theguardian.com/technology/2023/feb/03/colombia-judge-chatgpt-ruling.

Weiser, Benjamin. 2023. “Here’s What Happens When Your Lawyer Uses ChatGPT.” New York Times 27. https://www.nytimes.com/2023/05/27/nyregion/avianca-airline-lawsuit-chatgpt.html.