• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Jianwen (Wang, Jianwen.) [1] | Wang, Shiping (Wang, Shiping.) [2] (Scholars:王石平) | Lin, Mingwei (Lin, Mingwei.) [3] | Xu, Zeshui (Xu, Zeshui.) [4] | Guo, Wenzhong (Guo, Wenzhong.) [5] (Scholars:郭文忠)

Indexed by:

EI Scopus SCIE

Abstract:

Multimodal sentiment analysis is an actively growing research area that utilizes language, acoustic and visual signals to predict sentiment inclination. Compared to language, acoustic and visual features carry a more evident personal style which may degrade the model generalization capability. The issue will be exacerbated in a speaker-independent setting, where the model will encounter samples from unseen speakers during the testing stage. To mitigate personal style's impact, we propose a framework named SIMR for learning speaker-independent multimodal representation. This framework separates the nonverbal inputs into style encoding and content representation with the aid of informative cross-modal correlations. Besides, in terms of integrating cross-modal complementary information, the classical transformer-based approaches are inherently inclined to discover compatible cross-modal interactions but ignore incompatible ones. In contrast, we suggest simultaneously locating both through an enhanced cross-modal transformer module. Experimental results show that the proposed model achieves state-of-the-art performance on several datasets.

Keyword:

Multimodal fusion Multimodal representation learning Multimodal sentiment analysis Multi-view learning

Community:

  • [ 1 ] [Wang, Jianwen]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
  • [ 2 ] [Wang, Shiping]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
  • [ 3 ] [Guo, Wenzhong]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
  • [ 4 ] [Wang, Jianwen]Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
  • [ 5 ] [Lin, Mingwei]Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
  • [ 6 ] [Xu, Zeshui]Sichuan Univ, Business Sch, Chengdu 610064, Sichuan, Peoples R China
  • [ 7 ] [Wang, Shiping]Fuzhou Univ, Key Lab Network Comp & Intelligent Informat Proc, Fuzhou 350116, Peoples R China
  • [ 8 ] [Guo, Wenzhong]Fuzhou Univ, Key Lab Network Comp & Intelligent Informat Proc, Fuzhou 350116, Peoples R China
  • [ 9 ] [Lin, Mingwei]Fujian Normal Univ, Digital Fujian Inst Big Data Secur Technol, Fuzhou 350117, Peoples R China

Reprint 's Address:

  • 郭文忠

    [Guo, Wenzhong]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China

Show more details

Related Keywords:

Source :

INFORMATION SCIENCES

ISSN: 0020-0255

Year: 2023

Volume: 628

Page: 208-225

0 . 0

JCR@2023

0 . 0 0 0

JCR@2023

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:32

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 5

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:185/10039102
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1