AI-Based Deepfake Detection in Multimedia Content Using CNN and Transformer Models

سال انتشار: 1405
نوع سند: مقاله کنفرانسی
زبان: انگلیسی
مشاهده: 44

فایل این مقاله در 8 صفحه با فرمت PDF قابل دریافت می باشد

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این مقاله:

شناسه ملی سند علمی:

ICCPM09_006

تاریخ نمایه سازی: 31 تیر 1405

چکیده مقاله:

The rapid advancement of generative artificial intelligence has enabled the creation of highly realistic synthetic media, commonly known as deepfakes. These manipulated multimedia contents, particularly videos and images, pose significant threats to information integrity, personal privacy, public trust, and national security. Detecting deepfakes has therefore emerged as one of the most pressing challenges in modern multimedia systems research. This paper proposes a novel hybrid framework for deepfake detection that combines the feature extraction capabilities of Convolutional Neural Networks (CNNs) with the long-range dependency modeling power of Transformer architectures. The proposed model operates on facial regions extracted from video frames and leverages multi-scale spatial features alongside self-attention mechanisms to capture both local texture artifacts and global contextual inconsistencies introduced during the synthesis process. We evaluate the proposed approach on three widely used benchmark datasets: FaceForensics++, Celeb-DF, and DFDC. Experimental results demonstrate that the hybrid CNN-Transformer model achieves detection accuracy of ۹۷.۴% on FaceForensics++, outperforming several state-of-the-art methods while maintaining competitive performance across cross-dataset evaluation scenarios. The paper also provides an analysis of failure cases, discusses the challenges posed by highly compressed and low-resolution deepfakes, and outlines future research directions for developing more robust and generalizable detection systems.

نویسندگان

Amir Masoud Behboodi

Faculty of Multimedia, Tabriz Islamic Art University, Tabriz, Iran