• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhan, Z. (Zhan, Z..) [1] | Cao, D. (Cao, D..) [2] | Chen, Z. (Chen, Z..) [3] (Scholars:陈哲毅) | Cheng, H. (Cheng, H..) [4] (Scholars:程红举) | Yu, Z. (Yu, Z..) [5] (Scholars:於志勇)

Indexed by:

Scopus

Abstract:

Shared information refers to the common semantic information across multiple modalities, and complementary information refers to modality-specific information that complements other modalities. How to fully utilize this information is a key issue in the multimodal sentiment analysis. In this paper, we first propose a Slice Aggregation (SA) algorithm to address the issue of correlation over time. We use sliding windows to calculate the horizontal and vertical correlations, and then aggregate slices into a series of chunks, each represents a set of successive slices with consistent correlation. Second, we introduce a Dynamic Fusion (DF) strategy comprising two components: shared information fusion and complementary information fusion. The former utilizes a multilayer perceptron (MLP) to extract high-level shared representations, whereas the latter employs a cross-modal multi-head attention mechanism to fuse low-level complementary information. Finally, we propose an SA-DF framework where SA organizes raw slices into correlation-consistent chunks, and DF progressively fuses features across these chunks. The concatenated fused features are used for final sentiment prediction. The experiments on CMU-MOSI and CH-SIMS datasets show that the proposed SA-DF can achieve the best performance on sentiment analysis tasks when compared with the state-of-the-art baselines. © China Computer Federation (CCF) 2025.

Keyword:

Cross-modal multi-head attention Dynamic fusion Modal correlation Multimodal sentiment analysis Slice aggregation

Community:

  • [ 1 ] [Zhan Z.]College of Computer and Data Science, Fuzhou University, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 2 ] [Zhan Z.]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 3 ] [Cao D.]College of Computer and Data Science, Fuzhou University, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 4 ] [Cao D.]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 5 ] [Chen Z.]College of Computer and Data Science, Fuzhou University, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 6 ] [Chen Z.]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 7 ] [Cheng H.]College of Computer and Data Science, Fuzhou University, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 8 ] [Cheng H.]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 9 ] [Yu Z.]College of Computer and Data Science, Fuzhou University, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China
  • [ 10 ] [Yu Z.]Fujian Provincial Key Laboratory of Network Computing and Intelligent Information Processing, Wulong Jiang North Avenue, University Town, Fuzhou, 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

CCF Transactions on Pervasive Computing and Interaction

ISSN: 2524-521X

Year: 2025

2 . 2 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:1463/13841959
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1