BRAF: A Behavioral Response Analysis Framework for Student Patterns in the Era of Digital Assessment

سال انتشار: 1404
نوع سند: مقاله ژورنالی
زبان: انگلیسی
مشاهده: 23

فایل این مقاله در 31 صفحه با فرمت PDF قابل دریافت می باشد

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این مقاله:

شناسه ملی سند علمی:

JR_JCSM-3-2_008

تاریخ نمایه سازی: 22 آبان 1405

چکیده مقاله:

In the era of digital assessment, learners' behavioral data offer new opportunities for analyzing response patterns. This study presents the Behavioral Response Analysis Framework (BRAF), integrating behavioral data and machine learning to analyze responses in a randomized sequential online test. Data from ۲۸۲ students completing a six-item test were analyzed using t-tests, Pearson correlation, Isolation Forest, one-way ANOVA, and Random Forest.Isolation Forest identified ۲۹ students (۱۰.۳\%) with anomalous response-position patterns, whose mean score was significantly lower than that of other students (۳.۷۶ vs. ۴.۷۰; p < ۰.۰۰۱). No significant difference was found between median-based PositionBias groups. Overall, ۴۵.۷\% of students changed their answers at least once, with answer-changing associated with a ۰.۶۱-point lower mean score (p < ۰.۰۰۱). Random Forest assigned greater importance to TotalChanges than PositionBias (۵۳.۳\% vs. ۴۶.۷\%), although predictive performance was limited.The findings suggest that multivariate analysis may improve screening for unusual response-position patterns. Answer-changing was associated with lower performance, but causality cannot be established. BRAF is therefore best viewed as a screening framework for targeted human review rather than a diagnostic tool.

نویسندگان

- -

Department of Information and Computer Engineering, Faculty of Technology and Engineering, Payame Noor University (PNU), P.O. Box ۱۹۳۹۵-۴۶۹۷, Tehran, Iran

- -

Department of Educational Sciences and Learning Technologies,Mehralborz University, Tehran, Iran

- -

Department of Information and Computer Engineering, Faculty of Technology and Engineering, Payame Noor University (PNU) Tehran, Iran