Utilizing SURF Features and KLT Tracking Algorithm in Augmented Reality (AR), Using Kinect V.2 with the Aim of Autism Therapy
سال انتشار: 1398
نوع سند: مقاله کنفرانسی
زبان: انگلیسی
مشاهده: 416
فایل این مقاله در 10 صفحه با فرمت PDF قابل دریافت می باشد
- صدور گواهی نمایه سازی
- من نویسنده این مقاله هستم
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
CEITCONF03_011
تاریخ نمایه سازی: 6 خرداد 1399
چکیده مقاله:
Using Augmented Reality (AR) played important role in learning, education, therapy and especially autism therapy in last decade. Rehabilitating people with Autistic Spectrum Disorder (ASD) using AR was so mentionable in the therapy process. This paper presents a new method for rehabilitation and therapy for people with ASD using Microsoft Kinect V.2. System starts with human detection using depth sensor. In the second step system detects the subject’s face using Viola and Jones algorithm and recognize subject’s face using Convolutional Neural Network (CNN) using color sensor. Third step is consisting of feature extraction process using Bag of Features (BOF) for Content Based Image Retrieval (CBIR) purpose and tracing these points using Kanade–Lucas–Tomasi (KLT) algorithm for finalizing AR process. In the meanwhile, morphing subject’s face to a new avatar takes place (randomly), and also emotion recognition using CNN helps the human therapist. Experiments is done on 4 children with ASD. Therapy estimation after a weak showed experiment’s improvement during 7 days or meetings.
کلیدواژه ها:
Augmented Reality (AR) ، Autistic Spectrum Disorder (ASD) ، Microsoft Kinect V.2 ، Depth sensor ، Content Based Image Retrieval (CBIR) ، Kanade–Lucas–Tomasi (KLT) tracking.
نویسندگان
Seyed Muhammad Hossein Mousavi
Department of Computer Engineering Bu Ali Sina University Hamadan, Iran
S.Younes Mirinezhad
Department of Computer Engineering Bu Ali Sina University Hamadan, Iran
Atiye Ilanloo
Faculty of Humanities-Psychology Islamic Azad University-Rasht Gilan, Iran
Narges Aghsaghloo
Faculty of Humanities-Psychology Islamic Azad University-Saveh Markazi, Iran