NEW FACETS을 활용한 채점자료 분석방법

• 영문명: Understanding rating patterns through New FACETS program
• 발행기관: 한국외국어교육학회
• 저자명: 신동일(Shin Dongil) 설현수(Sul Hyun-Su)
• 간행물 정보: 『Foreign Languages Education』Vol.12 No.2, 191~211쪽, 전체 21쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2005.06.01

영문 초록

Recent developments in multifaceted Rasch measurement (Linacre, 1989) have made possible new kinds of investigations of facets of speaking test samples. The Rasch measurement, implemented through the computer program FACETS 3.56 version, can provide useful information in separate graphics and tables for the facets (e.g., test takers’ ability, item difficulty, and rater severity, bias analyses). This study investigates the roles of newly updated FACETS in the context of rater monitoring of English speaking test. Data for this study came from G-TELP Speaking Test. The performance of 50 candidates on the speaking test was multiply rated and analyzed using the most updated FACETS version of Rasch model. After exploring the extent to which new graphics and analyses tables of new FACETS are useful in rater monitoring, it was suggested that other tester groups should bring analytic tools like FACETS to effectively analyze raters’ consistency patterns as well as other rating patterns of individual raters for specific test tasks and criteria.

목차

Abstract

Ⅰ. 서론

Ⅱ. FACETS 정보를 활용한 채점경향 및 채점자 연구

Ⅲ. 연구방법

Ⅳ. 토론

Ⅴ. 결론 및 제언

참고문헌

필자소개