• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cheng, J. (Cheng, J..) [1] | Yang, Z. (Yang, Z..) [2] | Zhu, X. (Zhu, X..) [3]

Indexed by:

Scopus

Abstract:

Multimodal Emotion Recognition in Conversation (MER) aims to identify emotions in conversation by integrating text, audio, and visual information, playing a crucial role in dialogue system, recommendation system and healthcare. Existing methods overlook the contribution discrepancy among modalities when integrating multimodal information, leading to the problem of imbalanced optimization, which in turn results in suboptimal performance. To address this problem, we propose a Debiased Hierarchical Knowledge Distillation (DHKD) framework that enhances weak modalities’ contribution and mitigates contribution discrepancy through innovative knowledge distillation, achieving a balanced optimization. As the major contribution in our proposed model, the debiased hierarchical knowledge distillation is designed to transfer the knowledge from the multimodality to the others at both the feature and logit levels. It boosts the contribution of single modalities, especially for these modalities with weak contribution. Extensive experiments on IEMOCAP and MELD datasets demonstrate the effectiveness of our approach. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

Keyword:

Community:

  • [ 1 ] [Cheng J.]College of Computer Science and Engineering, Chongqing University of Technology, Chongqing, China
  • [ 2 ] [Yang Z.]College of Computer and Data Science, Fuzhou University, Fujian, Fuzhou, China
  • [ 3 ] [Zhu X.]College of Computer Science and Engineering, Chongqing University of Technology, Chongqing, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 0302-9743

Year: 2025

Volume: 15859 LNCS

Page: 62-74

Language: English

0 . 4 0 2

JCR@2005

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:917/13850404
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1