Utilizing ChatGPT for Analysis and Evaluation of Korean English Learners’ Presentations

• 발행기관: 한국영어학학회
• 저자명: Goun Lee Dong-Jin Shin
• 간행물 정보: 『영어학연구』제30권 4호, 45~64쪽, 전체 20쪽
• 주제분류: 어문학 > 영어와문학
• 파일형태: PDF
• 발행일자: 2024.11.30

국문 초록

This study explores the utilization of ChatGPT for evaluating English oral presentations by Korean university students. By comparing assessments made by an instructor and ChatGPT, this study aims to determine the efficacy and reliability of AI-assisted evaluation in language education. The findings indicate that ChatGPT can effectively learn and apply the evaluation criteria provided by instructors, particularly in aspects such as delivery and time management. However, limitations exist, including the AI’s tendency to overlook critical areas emphasized by human evaluators, such as content depth and the logical cohesion of ideas. Additionally, non-linguistic elements like body posture and eye contact were less accurately assessed by the AI. These discrepancies highlight the need for continuous refinement of AI algorithms to better mimic human judgment and incorporate detailed evaluation factors. The study also underscores the potential of AI-generated feedback to support a learner-centric approach, enabling students to access tailored feedback and improve their language skills independently. Future research should focus on refining AI evaluation algorithms and exploring the long-term impact of AI-assisted feedback on student performance. The integration of AI tools like ChatGPT into educational practices holds promise, but ongoing evaluation and refinement are crucial to ensure they meet pedagogical goals.

목차

1. Introduction

2. Literature Review

3. Methodology

4. Results and Discussion

5. Conclusion and Implications

References

키워드

AI-assisted evaluation AI-generated feedback learner-centric feedback ChatGPT English oral presentations