Utilizing Normalized Mutual Information as a Similarity Measure for EEG and fMRI Fusion

kground and Objectives: Neuroscience research can benefit greatly from the fusion of simultaneous recordings of electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) data due to their complementary properties. We can extract shared information by coupling two modalities in a symmetric data fusion.Methods: This paper proposed an approach based on the advanced coupled matrix tensor factorization (ACMTF) method for analyzing simultaneous EEG-fMRI data. To alleviate the strict equality assumption of shared factors in the common dimension of the ACMTF, the proposed method used a similarity criterion based on normalized mutual information (NMI). This similarity criterion effectively revealed the underlying relationships between the modalities, resulting in more accurate factorization results.Results: The suggested method was utilized on simulated data with various levels of correlation between the components of the two modalities. Despite different noise levels, the average match score improved compared to the ACMTF model, as demonstrated by the results.Conclusion: By relaxing the strict equality assumption, we can identify shared components in a common mode and extract shared components with higher performance than the traditional methods. The suggested method offers a more robust and effective way to analyze multimodal data sets. The findings highlight the potential of the ACMTF method with NMI-based similarity criterion for uncovering hidden patterns in EEG and fMRI data.

کلیدواژه ها:

Data Fusion ، Coupled Matrix Tensor Factorization ، Electroencephalogram (EEG) ، functional Magnetic Resonance Imaging (fMRI) ، Normalized Mutual Information (NMI)