PerGOLD: Identification of offensive language in Persian tweets: leveraging crowdsourcing
- سال انتشار: 1404
- محل انتشار: مجله مهندسی کامپیوتر و دانش، دوره: 8، شماره: 1
- کد COI اختصاصی: JR_CKE-8-1_004
- زبان مقاله: انگلیسی
- تعداد مشاهده: 88
نویسندگان
Department of the Computer Engineering, Shahrood University of Technology (SUT), Shahrood, Semnan, Iran
Department of the Computer Engineering, Shahrood University of Technology (SUT), Shahrood, Semnan, Iran
Department of the Computer Engineering, Shahrood University of Technology (SUT), Shahrood, Semnan, Iran
Department of the Computer Engineering, Shahrood University of Technology (SUT), Shahrood, Semnan, Iran
چکیده
It is concerning that the growing popularity of social networks is encouraging violence or inciting offense toward other people. An attempt has been made in the past several years to detect offensive language in social media posts. Nonetheless, the majority of studies focus on recognizing offensive language in English. Moreover, dataset labeling emerges as a crucial and fundamental step for training high-quality models, considering the increasing use of artificial intelligence and machine learning tools. Utilizing crowdsourcing platforms is an efficient and optimal method that can be used for data labeling. This approach uses human resources who are sufficiently knowledgeable about the topic to label the data. In this paper, we introduce PerGOLD, a new Persian General Offensive Language Dataset, in which we use an event-based data collection methodology to detect offensive language in Persian Twitter. To access labeled training data, we build a crowdsourcing platform to benefit from human input. We labeled ۱۳,۷۱۶ tweets, and according to the obtained results, ۳۴% of them were labeled as offensive language. Finally, we evaluated the efficiency of these data by applying some classic machine learning models (LR, SVM) and transformer-based language models (RoBERTa, ParsBERT). The obtained F۱-score of the best model (ParsBERT) was ۸۵.۴%.کلیدواژه ها
Offensive Language, Labeling, Crowdsourcing, Natural Language Processingاطلاعات بیشتر در مورد COI
COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.
کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.