Improving the Performance of Text Sentiment Analysis using Deep Convolutional Neural Network Integrated with Hierarchical Attention Layer
سال انتشار: 1398
نوع سند: مقاله ژورنالی
زبان: انگلیسی
مشاهده: 360
فایل این مقاله در 11 صفحه با فرمت PDF قابل دریافت می باشد
- صدور گواهی نمایه سازی
- من نویسنده این مقاله هستم
این مقاله در بخشهای موضوعی زیر دسته بندی شده است:
- هوش مصنوعی > شبکه عصبی
- هوش مصنوعی > یادگیری عمیق
- هوش مصنوعی > پردازش زبان طبیعی
- هوش مصنوعی > تحلیل احساس
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
JR_ITRC-11-3_007
تاریخ نمایه سازی: 23 بهمن 1399
چکیده مقاله:
Sentiment analysis is considered as one of the most essential tasks in the field of natural language processing and cognitive science. In order to enhance the performance of sentiment analysis techniques, it is necessary to not only classify the sentences based on their sentimental labels but also to extract the informative words that contribute to the classification decision. In this regard, deep neural networks based on the attention mechanism have achieved considerable progress in recent years. However, there is still a limited number of studies on attention mechanisms for text classification and especially sentiment analysis. To fill this lacuna, a Convolution Neural Network (CNN) integrated with attention layer is presented in this paper that is able to extract informative words and assign them higher weights based on the context. In the attention layer, the proposed model employs a context vector and tries to measure the importance of a word as the similarity between the context vector and word vector. Then, by integrating the new vectors obtained from the attention layer into sentence vectors, the new generated vectors are used for classification. In order to verify the performance of the proposed model, various experiments were conducted on the Stanford datasets. Based on the results of the experiments, the proposed model not only significantly outperforms other existing studies but also is able to consider the context to extract the informative words which can be considered as a value in analysis and application.
کلیدواژه ها:
نویسندگان
Hossein Sadr
Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran
Mir Mohsen Pedram
Department of Electrical and Computer Engineering, Faculty of Engineering, Kharazmi University ,Tehran, Iran
Mohammad Teshnelab
Industrial Control Center of Excellence, Faculty of Electrical and Computer Engineering, K. N. Toosi University, Tehran, Iran