Evaluating the Performance of ChatGPT on the Secondary School English Teacher Hiring Examination

• 영문명: Evaluating the Performance of ChatGPT on the Secondary School English Teacher Hiring Examination
• 발행기관: 한국영어교과교육학회
• 저자명: Je-Young Lee Sunhee Choi Juwon Lee Young Hwang Sodam Choi
• 간행물 정보: 『영어교과교육』22권 4호, 73~95쪽, 전체 23쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2023.11.30

영문 초록

The purpose of the present study is to conduct a comprehensive evaluation and analysis of the performance of OpenAI’s ChatGPT, a language model based on GPT-4 architecture, on the Secondary School English Teacher Hiring Examination. For this purpose, the current study employed ChatGPT-4, the most recent model as its primary research instrument. A total of 23 questions from the 2023 hiring exam were fed into ChatGPT for response generation. The responses elicited from ChatGPT were then analyzed by a panel of five experts according to their respective fields of expertise. The results of the analyses highlighted both the potential and limitations of ChatGPT as a pedagogical tool. The results also identified the AI’s propensity to simplify complex or abstract human knowledge into narrower or more technical concepts. These observations underscore the limitations of current AI in fully emulating human comprehension and its capacity to interpret nuances in knowledge. Nonetheless, these findings also suggest a direction for future AI development and reinforce the idea of AI as a supplementary learning tool rather than a complete replacement of human teachers.

목차

I. INTRODUCTION

II. LITERATURE REVIEW

IV. RESULTS AND DISCUSSION

V. CONCLUSION AND IMPLICATIONS

REFERENCES

키워드

챗GPT 대용량 언어 모델 수행 분석 교원 임용 시험 ChatGPT large language model performance analysis teacher hiring examination