A many-facet Rasch measurement of randomness in peer-assessors
- سال انتشار: 1393
- محل انتشار: دومین کنفرانس ملی تحقیقات کاربردی در مطالعات زبان انگلیسی
- کد COI اختصاصی: ELSCONF02_200
- زبان مقاله: انگلیسی
- تعداد مشاهده: 809
نویسندگان
Assistant professor at Imam Khomeini International University
MA studentin TEFL at Islamic Azad University, Qazvin branch
چکیده
In secondlanguage performance assessments where assessors are employed to assess language learners’ written products, assessors commit errors which may threaten the reliability of the ratings awarded to the products. Randomness, or inconsistency, is one of the persistent errors which affect language learners’ performances. In the present study, we used a many-facet Rasch measurement approach to detect and measure randomness among peer-assessors. To that end, 39 peer-assessors participated in a two-hour training programme to learn how to assess 20 five-paragraph essays MA students wrote in an Advanced Writing course. The peer-assessors used a 6-point analytic rating scale to assess the essays on 15 assessment criteria. We employed Facets, a computer software package, to analyse the rating data for this study. We ran a many-facet Rasch measurement analysis which included peer-assessor, students’ essay, and assessment criterion as facets. The results of Facets analyses showed that not all peer-assessors assessed the essays consistently. Some peer-assessors were internally consistent when assessing the essays, but they were not consistent with other peerassessors. These peer-assessors tended to assess the essays in a different order than did the other peerassessors. The findings of this study suggest thatextensive training is requiredto make peer-assessors consistent.کلیدواژه ها
مقالات مرتبط جدید
اطلاعات بیشتر در مورد COI
COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.
کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.