Pain Facial Expression Recognition from Video Sequences Using Spatio-temporal Local Binary Patterns and Tracking Fiducial Points

  • سال انتشار: 1399
  • محل انتشار: ماهنامه بین المللی مهندسی، دوره: 33، شماره: 5
  • کد COI اختصاصی: JR_IJE-33-5_038
  • زبان مقاله: انگلیسی
  • تعداد مشاهده: 378
دانلود فایل این مقاله

نویسندگان

I. Firouzian

Computer Engineering & IT Department, Shahrood University of Technology, Shahrood, Iran

N. Firouzian

Department of Strategic Management, Bank Melli Iran, Tehran, Iran

S. M. R. Hashemi

Computer Engineering & IT Department, Shahrood University of Technology, Shahrood, Iran

E. Kozegar

Faculty of Engineering, East Guilan, University of Guilan, Guilan, Iran

چکیده

Monitoring the facial expressions of patients in clinical environments is a necessity in addition to vital sign monitoring. Pain monitoring of patients by facial expressions from video sequences eliminates the need for another person to accompany patients. In this paper, a novel approach is presented to monitor the expression of face and notify in case of pain using tracking fiducial points of face in video sequences and spatio-temporal Local Binary Patterns (LBPs) for eyes and eyebrows. The motion of eight fiducial points on facial features such as mouth, eyes, eyebrows are tracked by Lucas-Kanade algorithm and the movement angles are recorded in a feature vector which along with the spatio-temporal histogram of LBPs creates a concatenated feature vector. Spatio-temporal LBPs boost the proposed algorithm to capture minor deformations on eyes and eyebrows. The feature vectors are then compared and classified using the Chi-square similarity measure. Experimental results show that leveraging spatio-temporal LBPs improves the accuracy by 12% on STOIC database.

کلیدواژه ها

Facial expression, Tracking fiducial points, Spatio-temporal, Local Binary Patterns, Pain expression, Video sequences

اطلاعات بیشتر در مورد COI

COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.

کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.