• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cheng, H. (Cheng, H..) [1] (Scholars:程红举) | Yang, Z. (Yang, Z..) [2] | Zhang, X. (Zhang, X..) [3] | Yang, Y. (Yang, Y..) [4]

Indexed by:

Scopus

Abstract:

Multimodal sentiment analysis aims to extract and integrate information from different modalities to accurately identify the sentiment expressed in multimodal data. How to effectively capture the relevant information within a specific modality and how to fully exploit the complementary information among multiple modalities are two major challenges in multimodal sentiment analysis. Traditional approaches fail to obtain the global contextual information of long time-series data when extracting unimodal temporal features, and they usually fuse the features from multiple modalities with the same method and ignore the correlation between different modalities when modeling inter-modal interactions. In this paper, we first propose an Attentional Temporal Convolutional Network (ATCN) to extract unimodal temporal features for enhancing the feature representation ability, then introduce a Multi-layer Feature Fusion (MFF) model to improve the effectiveness of multimodal fusion, which fuses the different-level features by different methods according to the correlation coefficient between the features, and cross-modal multi-head attention is used to fully explore the potential relationship between the low-level features. The experimental results on SIMS and CMU-MOSI datasets show that the proposed model achieves superior performance on sentiment analysis tasks compared to state-of-the-art baselines. IEEE

Keyword:

attentional temporal convolutional network cross-modal multi-head attention multi-layer feature fusion Multimodal sentiment analysis

Community:

  • [ 1 ] [Cheng H.]College of Computer and Data Science, Fuzhou University, Fuzhou, Fujian, China
  • [ 2 ] [Yang Z.]College of Computer and Data Science, Fuzhou University, Fuzhou, Fujian, China
  • [ 3 ] [Zhang X.]College of Computer and Data Science, Fuzhou University, Fuzhou, Fujian, China
  • [ 4 ] [Yang Y.]College of Computer and Data Science, Fuzhou University, Fuzhou, Fujian, China

Reprint 's Address:

  • 程红举

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Affective Computing

ISSN: 1949-3045

Year: 2023

Issue: 4

Volume: 14

Page: 1-15

9 . 6

JCR@2023

9 . 6 0 0

JCR@2023

ESI HC Threshold:32

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:177/10872280
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1