말하기 수행 평가에서 발음 범주 채점의 최적화 방안 연구

• 영문명: A study on the optimal conditions in rating of pronunciation scale for speaking performance assessment: using Generalizability Theory
• 발행기관: 국제한국어교육학회
• 저자명: 이향
• 간행물 정보: 『한국어교육』23권 2호, 301~329쪽, 전체 29쪽
• 주제분류: 어문학 > 한국어와문학
• 파일형태: PDF
• 발행일자: 2012.06.30

영문 초록

This study aims to examine any practical optimal conditions for pronunciation assessment that is used for evaluating Korean-speaking abilities, based on such a theory. In this study, the initial review of the concept of speaking performance assessment led to an assumption that interactions amongst tasks, raters, and examinee affect speaking performance evaluation. Based on such an assumption, an analysis was conducted applying the Generalizability Theory for the three facets. To this end, 33 examinee were given computer-based tests on three categories for speaking performance evaluation. Six raters then performed holistic and analytical ratings for pronunciation scale. Using the rating results, a G study was conducted on tasks, raters, and examinees, based on which a D Study was finally carried out. First off, the result of the G Study indicates that the examinee's abilities are the error facet that accounts for the largest variance component. The very fact that this rating method reflects the differences among the test takers' abilities above all else, attests to the validity of this test. During the D study, reliability of analytical rating turned out to be relatively high compared to holistic rating. And Although reliability factor could show a significant rise by increasing the number of rater from one to two, any more increase in the number of raters showed merely a small growth in reliability factor. In the meantime, while increase in the number of tasks from one to two could result in a significant rise in reliability factor, any further increase in the number of tasks only exhibited a very little improvement in reliability factor. In this respect, such study results seem to be meaningful enough to help any consideration for practicality of speaking performance assessment.

목차

1. 서론

2. 말하기 수행 평가에서의 발음 범주

3. 분석 방법과 연구 설계

4. 연구결과 및 분석

5. 결론

참고문헌

키워드

말하기 수행 평가 컴퓨터 기반 말하기 평가 발음 범주 일반화가능도 이론 총체적 평가 분석적 평가 speaking performance assessment computer based speaking test pronunciation scale Generalizability theory Holistic assessment analytical assessment