Utilizing SURF Features and KLT Tracking Algorithm in Augmented Reality (AR), Using Kinect V.2 with the Aim of Autism Therapy

سال انتشار: 1398
نوع سند: مقاله کنفرانسی
زبان: انگلیسی
مشاهده: 416

فایل این مقاله در 10 صفحه با فرمت PDF قابل دریافت می باشد

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این مقاله:

شناسه ملی سند علمی:

CEITCONF03_011

تاریخ نمایه سازی: 6 خرداد 1399

چکیده مقاله:

Using Augmented Reality (AR) played important role in learning, education, therapy and especially autism therapy in last decade. Rehabilitating people with Autistic Spectrum Disorder (ASD) using AR was so mentionable in the therapy process. This paper presents a new method for rehabilitation and therapy for people with ASD using Microsoft Kinect V.2. System starts with human detection using depth sensor. In the second step system detects the subject’s face using Viola and Jones algorithm and recognize subject’s face using Convolutional Neural Network (CNN) using color sensor. Third step is consisting of feature extraction process using Bag of Features (BOF) for Content Based Image Retrieval (CBIR) purpose and tracing these points using Kanade–Lucas–Tomasi (KLT) algorithm for finalizing AR process. In the meanwhile, morphing subject’s face to a new avatar takes place (randomly), and also emotion recognition using CNN helps the human therapist. Experiments is done on 4 children with ASD. Therapy estimation after a weak showed experiment’s improvement during 7 days or meetings.

کلیدواژه ها:

Augmented Reality (AR) ، Autistic Spectrum Disorder (ASD) ، Microsoft Kinect V.2 ، Depth sensor ، Content Based Image Retrieval (CBIR) ، Kanade–Lucas–Tomasi (KLT) tracking.

نویسندگان

Seyed Muhammad Hossein Mousavi

Department of Computer Engineering Bu Ali Sina University Hamadan, Iran

S.Younes Mirinezhad

Department of Computer Engineering Bu Ali Sina University Hamadan, Iran

Atiye Ilanloo

Faculty of Humanities-Psychology Islamic Azad University-Rasht Gilan, Iran

Narges Aghsaghloo

Faculty of Humanities-Psychology Islamic Azad University-Saveh Markazi, Iran