ParSQuAD: Persian Question Answering Dataset based on Machine Translation of SQuAD ۲.۰
- سال انتشار: 1400
- محل انتشار: فصلنامه بین المللی وب پژوهی، دوره: 4، شماره: 1
- کد COI اختصاصی: JR_IJWR-4-1_005
- زبان مقاله: انگلیسی
- تعداد مشاهده: 151
نویسندگان
Department of Software Engineering, Faculty of Computer Engineering, University of Isfahan, Isfahan
Department of Software Engineering, Faculty of Computer Engineering, University of Isfahan, Isfahan
Department of Software Engineering, Faculty of Computer Engineering, University of Isfahan, Isfahan
Department of Software Engineering, Faculty of Computer Engineering, University of Isfahan, Isfahan
Department of Linguistics, University of Isfahan, Isfahan, Iran
چکیده
Recent developments in Question Answering (QA) have improved state-of-the-art results, and various datasets have been released for this task. Since substantial English training datasets are available for this task, the majority of works published are for English Question Answering. However, due to the lack of Persian datasets, less research has been done on the latter language, making comparisons difficult. This paper introduces the Persian Question Answering Dataset (ParSQuAD) based on the machine translation of the SQuAD ۲.۰ dataset. Many errors have been discovered within the process of translating the dataset; therefore, two versions of ParSQuAD have been generated depending on whether these errors have been corrected manually or automatically. As a result, the first large-scale QA training resource for Persian has been generated. In addition, we trained three baseline models, i.e., BERT, ALBERT, and Multilingual-BERT (mBERT), on both versions of ParSQuAD. mBERT achieves scores of ۵۶.۶۶% and ۵۲.۸۶% for F۱ score and exact match ratio respectively on the test set with the first version and scores of ۷۰.۸۴% and ۶۷.۷۳% respectively with the second version. This model obtained the best results out of the three on each version of ParSQuAD.کلیدواژه ها
Question Answering, Persian Machine Reading Comprehension, Persian Question Answering Dataset, SQUADاطلاعات بیشتر در مورد COI
COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.
کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.