• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Jianwen (Wang, Jianwen.) [1] | Wang, Shiping (Wang, Shiping.) [2] | Lin, Mingwei (Lin, Mingwei.) [3] | Xu, Zeshui (Xu, Zeshui.) [4] | Guo, Wenzhong (Guo, Wenzhong.) [5]

Indexed by:

EI

Abstract:

Multimodal sentiment analysis is an actively growing research area that utilizes language, acoustic and visual signals to predict sentiment inclination. Compared to language, acoustic and visual features carry a more evident personal style which may degrade the model generalization capability. The issue will be exacerbated in a speaker-independent setting, where the model will encounter samples from unseen speakers during the testing stage. To mitigate personal style's impact, we propose a framework named SIMR for learning speaker-independent multimodal representation. This framework separates the nonverbal inputs into style encoding and content representation with the aid of informative cross-modal correlations. Besides, in terms of integrating cross-modal complementary information, the classical transformer-based approaches are inherently inclined to discover compatible cross-modal interactions but ignore incompatible ones. In contrast, we suggest simultaneously locating both through an enhanced cross-modal transformer module. Experimental results show that the proposed model achieves state-of-the-art performance on several datasets. © 2023 Elsevier Inc.

Keyword:

Modal analysis Sentiment analysis Visual languages

Community:

  • [ 1 ] [Wang, Jianwen]College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 2 ] [Wang, Jianwen]College of Computer and Cyber Security, Fujian Normal University, Fuzhou; 350117, China
  • [ 3 ] [Wang, Shiping]College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 4 ] [Wang, Shiping]Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou; 350116, China
  • [ 5 ] [Lin, Mingwei]College of Computer and Cyber Security, Fujian Normal University, Fuzhou; 350117, China
  • [ 6 ] [Lin, Mingwei]Digital Fujian Institute of Big Data Security Technology, Fujian Normal University, Fuzhou; 350117, China
  • [ 7 ] [Xu, Zeshui]Business School, Sichuan University, Sichuan, Chengdu; 610064, China
  • [ 8 ] [Guo, Wenzhong]College of Computer and Data Science, Fuzhou University, Fuzhou; 350116, China
  • [ 9 ] [Guo, Wenzhong]Key Laboratory of Network Computing and Intelligent Information Processing, Fuzhou University, Fuzhou; 350116, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

Information Sciences

ISSN: 0020-0255

Year: 2023

Volume: 628

Page: 208-225

0 . 0

JCR@2023

0 . 0 0 0

JCR@2023

ESI HC Threshold:32

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:149/10046245
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1