Presentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures

  • سال انتشار: 1398
  • محل انتشار: مجله پیشرفت در تحقیقات کامپیوتری، دوره: 10، شماره: 2
  • کد COI اختصاصی: JR_JACR-10-2_002
  • زبان مقاله: انگلیسی
  • تعداد مشاهده: 409
دانلود فایل این مقاله

نویسندگان

Hossein Sadr

Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran|Young Researchers and Elite Club, Rasht Branch, Islamic Azad University, Rasht, Iran

Mojdeh Nazari Solimandarabi

Young Researchers and Elite Club, Rasht Branch, Islamic Azad University, Rasht, Iran

چکیده

Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for an automated system with high flexibility for assessing exams based on texts. Generally, ASAG methods can be categorized into supervised and unsupervised approaches. Supervised approaches such as machine learning and especially deep learning methods require the manually constructed pattern. On the other hands, while in the assessment process, student s answer is compared to an ideal response and scoring is done based on their similarity, semantic relatedness and similarity measures can be considered as unsupervised approaches for this aim. Whereas unsupervised approaches do not require labeled data they are more applicable to real-world problems and are confronted with fewer limitations. Therefore, in this paper, various measures of semantic relatedness and similarity are extensively compared in the application of short answer grading. In the following, an approach is proposed for improving the performance of short answer grading systems based on semantic relatedness and similarity measures which leverages students answers with the highest score as feedback. Empirical experiments have proved that using students answers as feedback can considerably improve the precision of semantic relatedness and similarity measures in the automatic assessment of exams with short answers.

کلیدواژه ها

Semantic Relatedness, Short Answer Grading, Latent Semantic Analysis, Explicit Semantic Analysis, Deep Learning, E-learning system

اطلاعات بیشتر در مورد COI

COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.

کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.