From Learning Companion to Learning Threat: Examining ChatGPT's Trustworthiness in the Classroom - Hsiang Hui Lek - NUS Chat on GPT

2023 April 18 @ UTown Auditorium 1, NUS, Singapore
Hsiang Hui Lek
https://www.comp.nus.edu.sg/disa/bio/lekhsian/
@hsianghui (https://twitter.com/hsianghui)

This talk will highlight some concerns with the trustworthiness of AI tools and discuss how it impacts student's learning.

Video available at: https://www.youtube.com/watch?v=7zsGNTHbSLQ&t=690s

Event Website: https://wing-nus.github.io/chatongpt/

Transcript

1. Chat on GPT – 18 April 2023 Speaker: Prof Lek Hsiang Hui This talk will highlight some concerns with the trustworthiness of AI tools and discuss how it impacts student's learning. From Learning Companion to Learning Threat: Examining ChatGPT’s Trustworthiness in the Classroom
2. Chat on GPT – 18 April 2023 Age Of AI-Assisted Education Applications of AI in Education • Personalised / Adaptive Learning – AI Tutor (Khan Academy)
3. Chat on GPT – 18 April 2023 Age Of AI-Assisted Education Applications of AI in Education • AI Pair Programmer (Github Copilot)
4. Chat on GPT – 18 April 2023 Age Of AI-Assisted Education Applications of AI in Education • Idea Generation
5. Chat on GPT – 18 April 2023 Age Of AI-Assisted Education Applications of AI in Education • Summarisation / Digest information much faster
6. Chat on GPT – 18 April 2023 Age Of AI-Assisted Education
7. Chat on GPT – 18 April 2023 When There Was No AI … Students need to understand how things are done • Understand what is right/wrong. • Instructors need to ensure that this learning objective is fulfilled. Process of learning is painful, tedious, and time- consuming • Process is not efficient, learning often happens through failure.
8. Chat on GPT – 18 April 2023 How AI Has Changed Learning? Made us more productive in learning • AI (e.g. ChatGPT) as a highly informed assistant that has learned all the information from the web. Always available assistant • Learning companion that is not restricted to the classroom. • Do not have to wait for a human teacher.
9. Chat on GPT – 18 April 2023 Students Getting Excited About AI… Image generated using DALL-E (AI image generation service) “Take a look at what ChatGPT has produced…” Oh wow! We have never seen something like this before…
10. Chat on GPT – 18 April 2023 Gotcha?! Danger of “learning” the wrong thing • Students learning for the first time would not be able to differentiate between what is correct or wrong. • Issue exacerbated because most of the results of ChatGPT are good. • Students get the wrong impression that the output is always correct since it is doing a good job most of the time. Oh wait… the result does not seem correct
11. Chat on GPT – 18 April 2023 Learning Threat? Regardless of correct/wrong output, students might not appreciate what type of training they need • We often learn better through failures. • While AI seems to be a shortcut to learning but is it really helping students to learn? Are we training students to be expert users of AI tools or are we teaching them to be problem solvers? Has the skills of workers shifted to be about “Prompt Engineering” instead?
12. Chat on GPT – 18 April 2023 Food For Thoughts What is the objective of education, classroom learning, assessments, projects, etc? • Sometimes it is the process that matters rather than the final output. If we are not trained to tackle the tasks on our own and AI were to take care of this problem-solving, does it justify our value? • How are we protecting ourselves to be replaced by AI?
13. Chat on GPT – 18 April 2023 Food For Thoughts Is the focus of education about being skillful AI tools users? • Any YouTuber with hours of ChatGPT usage can become an expert user of ChatGPT! • Letting AI automate things so that learners can take the backseat feels like we are going backwards in learning. • What is there to stop someone who graduated earlier (in the era without AI) to take up these tools to turbo boost their productivity further?
14. Chat on GPT – 18 April 2023 Realistically What Then Is The Role Of AI In Education? ✅ ✅ Good for ideation ❌ ❌ Not ideal to be used wholesale as the final form ✅ ✅ Learning companion ❌ ❌ Teacher replacement 🤔🤔 🤔🤔 Definition of right/wrong might not be the same when we talk about humanities/ethics-related topics • AI models are data-driven (learned from data). • Real-world decision making might be based on principles (“what defines being human?”).