BRAF: A Behavioral Response Analysis Framework for Student Patterns in the Era of Digital Assessment
محل انتشار: نشریه علم داده و مدل سازی، دوره: 3، شماره: 2
سال انتشار: 1404
نوع سند: مقاله ژورنالی
زبان: انگلیسی
مشاهده: 23
فایل این مقاله در 31 صفحه با فرمت PDF قابل دریافت می باشد
- صدور گواهی نمایه سازی
- من نویسنده این مقاله هستم
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
JR_JCSM-3-2_008
تاریخ نمایه سازی: 22 آبان 1405
چکیده مقاله:
In the era of digital assessment, learners' behavioral data offer new opportunities for analyzing response patterns. This study presents the Behavioral Response Analysis Framework (BRAF), integrating behavioral data and machine learning to analyze responses in a randomized sequential online test. Data from ۲۸۲ students completing a six-item test were analyzed using t-tests, Pearson correlation, Isolation Forest, one-way ANOVA, and Random Forest.Isolation Forest identified ۲۹ students (۱۰.۳\%) with anomalous response-position patterns, whose mean score was significantly lower than that of other students (۳.۷۶ vs. ۴.۷۰; p < ۰.۰۰۱). No significant difference was found between median-based PositionBias groups. Overall, ۴۵.۷\% of students changed their answers at least once, with answer-changing associated with a ۰.۶۱-point lower mean score (p < ۰.۰۰۱). Random Forest assigned greater importance to TotalChanges than PositionBias (۵۳.۳\% vs. ۴۶.۷\%), although predictive performance was limited.The findings suggest that multivariate analysis may improve screening for unusual response-position patterns. Answer-changing was associated with lower performance, but causality cannot be established. BRAF is therefore best viewed as a screening framework for targeted human review rather than a diagnostic tool.
کلیدواژه ها:
نویسندگان
- -
Department of Information and Computer Engineering, Faculty of Technology and Engineering, Payame Noor University (PNU), P.O. Box ۱۹۳۹۵-۴۶۹۷, Tehran, Iran
- -
Department of Educational Sciences and Learning Technologies,Mehralborz University, Tehran, Iran
- -
Department of Information and Computer Engineering, Faculty of Technology and Engineering, Payame Noor University (PNU) Tehran, Iran