Exploring the Efficacy of Automated Essay Scoring Systems in the Context of Korean EFL High School

• 영문명: Exploring the Efficacy of Automated Essay Scoring Systems in the Context of Korean EFL High School
• 발행기관: 한국영어평가학회
• 저자명: Yubin Jeon
• 간행물 정보: 『English Language Assessment』Vol.18 No.1, 63~95쪽, 전체 33쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2023.06.30

영문 초록

Despite growing attention on the Automated Essay Scoring (AES) systems, it is difficult to find their actual use in Korean EFL high schools. Among various free and easily accessible AES systems available, this study aims to investigate the efficacy of three AES systems in the Korean EFL high school context: Grammarly, MS Editor, and ProWritingAid. To this end, the three AES systems were compared with two human raters in three aspects: scores reported on Korean EFL high school students’ writings, errors detected per error category, and errors detected per student writing. The t-test, ANOVA, and correlation analysis results have led to questions and doubts on the validity of the AES programs and their role as essay evaluators. While AES programs have shown growth, the AES programs are not yet comparable to human raters and teacher feedback. However, the AES programs do show potential as a supplementary tool in the Korean EFL context. Thus, a comparison of the three AES systems was examined in the hopes of finding the optimal choice of AES system. The findings provide information and insights on how AES systems may be implemented in Korean EFL high school classrooms, and further emphasized the importance of teachers’ role in implementing a new tool.

목차

I. INTRODUCTION

II. LITERATURE REVIEW

III. RESEARCH METHOD

IV. RESULTS AND DISCUSSION

V. CONCLUSION

REFERENCES

키워드

Automated Essay Scoring (AES) Automated Writing Evaluation (AWE) writing