Performance of ChatGPT 3.5 on CSAT: Its Potential as a Language Learning and Assessment Tool

• 영문명: Performance of ChatGPT 3.5 on CSAT: Its Potential as a Language Learning and Assessment Tool
• 발행기관: 한국영어교과교육학회
• 저자명: Yoo Young Ahn
• 간행물 정보: 『영어교과교육』22권 2호, 119~145쪽, 전체 27쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2023.05.31

영문 초록

The purpose of this paper is to evaluate ChatGPT 3.5’s performance on the English reading comprehension section of the Korean College Scholastic Ability Test (CSAT). More specifically, this study analyzes its potential as a language learning and assessment tool based on its performance on the high-stakes national test. This study also identifies the strengths and limitations of the large language model (LLM) and explores aspects that need improvement to use for learning. The results suggest that the LLM’s strengths in reasoning and explanation can be useful for language learning. The results also highlight the need for ChatGPT to gain extensive domain-specific knowledge and advanced reasoning skills in order to enhance its contextual understanding. Moreover, the results indicate that human judgment from educators is necessary to ensure the accuracy and reliability of ChatGPT’s outputs, particularly for a high-stakes exam like the CSAT. Combining AI and human judgment can result in more effective and trustworthy results.

목차

I. INTRODUCTION

II. LITERATURE REVIEW

III. METHOD

IV. RESULTS AND DISCUSSION

V. CONCLUSION

REFERENCES

키워드

챗지피티3.5 수능 언어 학습 및 평가 데이터셋 ChatGPT3.5 CAST language learning and assessment dataset