Investigating Topic Familiarity as Source of Testlet Effect in Reading Tests: Bifactor Analysis

• 발행기관: 한국외국어교육학회
• 저자명: Jung-Hee Byun Yong-Won Lee
• 간행물 정보: 『Foreign Languages Education』Vol.23 No.3, 79~109쪽, 전체 31쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2016.09.30

영문 초록

The current study aims to examine whether topic familiarity can be associated with, and can also substantially contribute to, the testlet effect often found among items sharing a common passage in reading comprehension tests, particularly by using the Multidimensional Item Response Theory (MIRT) bifactor model as the main data analytic scheme. Data analyzed in this study were item scores collected from 830 Korean high school students who took a 8-passage, 32-item reading comprehension test (4 items per passage) and a 40-item self-reported topic familiarity questionnaire (5 items per passage). The results of analysis revealed that (a) the bifactor model best fit the test data; (b) the self-reported topic familiarity score was not correlated with the testlet factor scores at a statistically significant level; and (c) the overall topic familiarity score had a positive correlation with the general reading ability score, however. Implications of these major findings are discussed in terms of the usefulness of the bifactor model and the nature of testlet effects in reading tests, along with avenues for further investigation.

목차

I. Introduction

II. Literature Review

III. Method

IV. Results

V. Discussion

VI. Conclusion

References

키워드

화제친숙도 독해테스트 다차원 문항반응 측정모형 topic familiarity reading comprehension test MIRT Bifactor model