An Item Analysis of the Mock CSAT English Test

• 발행기관: 한국영어평가학회
• 저자명: Hye Rang Om
• 간행물 정보: 『English Language Assessment』Vol.16 No.2, 71~97쪽, 전체 27쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2021.12.30

영문 초록

This study analyzed students’ test performance on the mock College Scholastic Ability Test (CSAT) English test to examine the reliability and validity of the test items within a framework of Classical Test Theory (CTT). The test used for the present study was the mock CSAT English test administered in June 2021 and item difficulty data was collected from 100 3rd grade high school students who took the test. For the item analysis, Test Analysis Program (TAP), a computational tool was used to investigate the extent to which the mock CSAT is a valid test based on item difficulty, item discrimination and distractors’ attractiveness. According to the item analysis, it was found that the reliability of the test was as high as .876, which is reliable and the level of difficulty was .713, indicating that it wasin the desirable range between .25 and .75. The mean discrimination power was .337, which is within the desirable range of over .3. However, an imbalance of item difficulty between the listening and reading section were detected with unreasonably weighted items and implausible distractors. Therefore, this study provides implications for improvement for the mock CSAT, which can also apply to future CSATs.

목차

I. INTRODUCTION

II. LITERATURE REVIEW

III. RESEARCH METHOD

IV. RESULTS AND DISCUSSION

V. CONCLUSION AND IMPLICATIONS

키워드

reliability validity item analysis item difficulty item discriminability distractor analysis TAP CSAT