고등학생 영어학습자의 말하기 평가에서 채점자 훈련의 효과 및 채점자 인식 분석

• 영문명: An analysis of rater perceptions and the effectiveness of the rater training in speaking assessment
• 발행기관: 팬코리아영어교육학회(구 영남영어교육학회)
• 저자명: 고연승(Ko, Yeonseung) 최현규(Choi, Hyun-Kyu)
• 간행물 정보: 『영어교육연구』제32권 3호, 47~65쪽, 전체 19쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2020.09.30

영문 초록

This study aims to examine the effectiveness of rater training as to the rater reliability in evaluating speaking skill, and to analyze how teachers’ perceptions changed as the training proceeded. For the research, four English teachers in Korean high school rated 15 students four times, once a week, and were interviewed after each rating period. The scoring data was analyzed through the Many-Facet Rash Measurement (MFRM) and the interviews were also analyzed. The results are as follows. First, both the inter- and intra-rater reliability increased. Although four raters were all leniently biased from the first session, the difference of the degree of leniency was closely narrowed down. Also, misfit aspect observed from one of the raters disappeared as the biases incurred by the lack of understanding of the scoring criteria reduced. Second, contrary to their previous concerns about the result of the training, teachers agreed on the need for the training and its effectiveness. The interview revealed that the training encouraged teachers to have confidence in their expertise, eventually raising reliability in their rating. The study demonstrates how rater training can establish rater reliability and most importantly implies that it can be successfully settled in Korean high school.

목차

I. 서 론

II. 이론적 배경

III. 연구 방법

IV. 연구 결과 및 논의

V. 결론 및 제언

참고문헌

키워드

말하기 평가 채점자간 신뢰도 채점자내 신뢰도 라쉬 다국면 라쉬 모형 채점자 인식 채점자 훈련 speaking evaluation inter-rater reliability intra-rater reliability Rasch Many-Facet Rasch Measurement rater’s perceptions rater training