Pitfalls of a Second Language Writer and AI Detection: Evaluating Plagiarism Checking Tools in Iranian EFL Students' Academic Writings

سال انتشار: 1405
نوع سند: مقاله ژورنالی
زبان: انگلیسی
مشاهده: 32

فایل این مقاله در 17 صفحه با فرمت PDF قابل دریافت می باشد

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این مقاله:

شناسه ملی سند علمی:

JR_IJREE-11-3_007

تاریخ نمایه سازی: 21 آبان 1405

چکیده مقاله:

obective: This study evaluated AI detection tools’ efficacy in assessing EFL students’ writing, focusing on distinguishing AI-generated from human text without misclassifying L۲ work. Methods: A two-phase quantitative design was used. Phase ۱ involved ۳۰ BA students from Yazd University producing one non-AI and one ChatGPT-assisted essay on identical topics. Phase ۲ compared two MA thesis corpora: ۳۰ from the pre-AI era (۲۰۱۰–۲۰۱۵) and ۳۰ from the post-AI era (۲۰۲۰–۲۰۲۵). All texts were analyzed using Turnitin and Grammarly Premium. Results: Results, analyzed via Wilcoxon Signed-Rank Tests and one-sample t-tests, revealed significant performance divergence. Turnitin demonstrated near-perfect accuracy in identifying AI-assisted essays, whereas Grammarly showed a statistically significant false negative rate, failing to detect some AI content. Both tools accurately analyzed short, human-written essays. However, the thesis analysis revealed increased AI-detection scores in the post-AI corpus, contrasting with near-zero scores in the pre-AI corpus. Conclusion: This finding suggests either actual, undisclosed AI use or algorithmic bias misclassifying Iranian EFL linguistic patterns as AI-generated. The study concludes that while Turnitin is more robust than Grammarly, uncritical tool application risks systematic misjudgment against L۲ writers. False positives and negatives threaten academic equity. Thus, AI-detection outputs should trigger pedagogical dialogue and human-led investigation rather than serving as sole misconduct evidence.

نویسندگان

Mohammad Amin Dehghan Baghi

Department of English Language and Literature, Faculty of Foreign Language, Yazd University, Yazd, Iran.

Seyedeh Elham Elhambakhsh

Department of English Language and Literature, Faculty of Foreign Language, Yazd University, Yazd, Iran.

Ali Mohammad Fazilatfar

Department of English Language and Literature, Faculty of Foreign Language, Yazd University, Yazd, Iran.