• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhan, Zhouwen (Zhan, Zhouwen.) [1] | Cao, Dongtao (Cao, Dongtao.) [2] | Cheng, Hongju (Cheng, Hongju.) [3] (Scholars:程红举)

Indexed by:

EI Scopus

Abstract:

Multimodal emotion recognition effectively uses cross-modal information to enhance model performance. However, in practical applications, the missing modalities issue often degrades emotion recognition accuracy due to the modality gap arising from differences in information representation and semantic inconsistencies across modalities. To address this challenge, this paper introduces a specific and invariant feature learning approach(SIFL). Specifically, we employ feature extraction techniques using a self-attention mechanism for modality-specific features and leverage a denoising autoencoder for invariant feature extraction to enhance semantic richness and expressiveness. Additionally, we develop a reconstruction network to generate high-quality modality features. To further optimize the process, we design and implement multiple optimization objectives, effectively bridging the semantic gap between modalities. Experimental results on the CMU-MOSI dataset demonstrate that the proposed method surpasses current mainstream baselines and exhibits robust performance, particularly under conditions with high missing rates, validating its efficacy and versatility in handling missing modalities. © 2025 IEEE.

Keyword:

Emotion Recognition Extraction Feature extraction Learning systems Modal analysis Psychology computing Semantics

Community:

  • [ 1 ] [Zhan, Zhouwen]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 2 ] [Cao, Dongtao]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 3 ] [Cheng, Hongju]College of Computer and Data Science, Fuzhou University, Fuzhou, China

Reprint 's Address:

Email:

Show more details

Version:

Related Keywords:

Related Article:

Source :

Year: 2025

Page: 533-537

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:1504/13831062
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1