• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chen, Yuzhong (Chen, Yuzhong.) [1] (Scholars:陈羽中) | Shi, Liyuan (Shi, Liyuan.) [2] | Lin, Jiali (Lin, Jiali.) [3] | Chen, Jingtian (Chen, Jingtian.) [4] | Zhong, Jiayuan (Zhong, Jiayuan.) [5] | Dong, Chen (Dong, Chen.) [6] (Scholars:董晨)

Indexed by:

EI Scopus SCIE

Abstract:

Aspect-level multimodal sentiment analysis aims to ascertain the sentiment polarity of a given aspect from a text review and its accompanying image. Despite substantial progress made by existing research, aspect-level multimodal sentiment analysis still faces several challenges: (1) Inconsistency in feature granularity between the text and image modalities poses difficulties in capturing corresponding visual representations of aspect words. This inconsistency may introduce irrelevant or redundant information, thereby causing noise and interference in sentiment analysis. (2) Traditional aspect-level sentiment analysis predominantly relies on the fusion of semantic and syntactic information to determine the sentiment polarity of a given aspect. However, introducing image modality necessitates addressing the semantic gap in jointly understanding sentiment features in different modalities. To address these challenges, a multi-granularity visual-textual feature fusion model (MG-VTFM) is proposed to enable deep sentiment interactions among semantic, syntactic, and image information. First, the model introduces a multi-granularity hierarchical graph attention network that controls the granularity of semantic units interacting with images through constituent tree. This network extracts image sentiment information relevant to the specific granularity, reduces noise from images and ensures sentiment relevance in single-granularity cross-modal interactions. Building upon this, a multilayered graph attention module is employed to accomplish multi-granularity sentiment fusion, ranging from fine to coarse. Furthermore, a progressive multimodal attention fusion mechanism is introduced to maximize the extraction of abstract sentiment information from images. Lastly, a mapping mechanism is proposed to align cross-modal information based on aspect words, unifying semantic spaces across different modalities. Our model demonstrates excellent overall performance on two datasets.

Keyword:

Aspect-level sentiment analysis Constituent tree Multi-granularity Multimodal data Visual-textual feature fusion

Community:

  • [ 1 ] [Chen, Yuzhong]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 2 ] [Shi, Liyuan]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 3 ] [Lin, Jiali]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 4 ] [Zhong, Jiayuan]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 5 ] [Dong, Chen]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350108, Fujian, Peoples R China
  • [ 6 ] [Chen, Yuzhong]Minist Educ, Engn Res Ctr Big Data Intelligence, Fuzhou, Peoples R China
  • [ 7 ] [Shi, Liyuan]Minist Educ, Engn Res Ctr Big Data Intelligence, Fuzhou, Peoples R China
  • [ 8 ] [Lin, Jiali]Minist Educ, Engn Res Ctr Big Data Intelligence, Fuzhou, Peoples R China
  • [ 9 ] [Zhong, Jiayuan]Minist Educ, Engn Res Ctr Big Data Intelligence, Fuzhou, Peoples R China
  • [ 10 ] [Dong, Chen]Minist Educ, Engn Res Ctr Big Data Intelligence, Fuzhou, Peoples R China
  • [ 11 ] [Chen, Yuzhong]Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350108, Fujian, Peoples R China
  • [ 12 ] [Shi, Liyuan]Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350108, Fujian, Peoples R China
  • [ 13 ] [Lin, Jiali]Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350108, Fujian, Peoples R China
  • [ 14 ] [Zhong, Jiayuan]Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350108, Fujian, Peoples R China
  • [ 15 ] [Dong, Chen]Fujian Prov Key Lab Network Comp & Intelligent Inf, Fuzhou 350108, Fujian, Peoples R China
  • [ 16 ] [Chen, Jingtian]Fujian Media Grp, Fuzhou 350002, Fujian, Peoples R China

Reprint 's Address:

  • [Chen, Jingtian]Fujian Media Grp, Fuzhou 350002, Fujian, Peoples R China;;

Show more details

Related Keywords:

Source :

JOURNAL OF SUPERCOMPUTING

ISSN: 0920-8542

Year: 2025

Issue: 1

Volume: 81

2 . 5 0 0

JCR@2023

CAS Journal Grade:3

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 9

Online/Total:174/10872245
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1