• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chen, Yaxiong (Chen, Yaxiong.) [1] | Du, Chuang (Du, Chuang.) [2] | Zi, Yunfei (Zi, Yunfei.) [3] | Xiong, Shengwu (Xiong, Shengwu.) [4] | Lu, Xiaoqiang (Lu, Xiaoqiang.) [5]

Indexed by:

EI

Abstract:

Remote sensing (RS) audio-visual cross-modal retrieval is a challenging task in the search of meaningful RS information. Nevertheless, the impact of multiscale features and associated redundant information in the RS images cannot be overlooked in the retrieval task. In addition, how to deal with the completely different physical expressions of different modal information is crucial for cross-modal retrieval tasks. To tackle these issues, we propose a Scale-aware Adaptive Refinement and Cross-Interaction (SARCI) network. The Quaternion-attention Dominated Multiscale Visual Refinement (QDMVR) module in SARCI is suggested to learn multiscale visual features and further optimize features containing redundant information for different scale features. To better integrate channel attention and spatial attention for adaptively learning of meaningful visual semantics, we propose the symmetric quaternion attention (SQA) within the QDMVR module to enhance RS visual features. The SQA mechanism acts on both high-level and low-level features to explore salient RS vision information across different scales. In order to allow information from different modalities to interact more valuably, we propose the Instruction-based Cross-Learning Module (ICLM) to perform cross-modal feature interaction based on the characteristic of the two modalities. SARCI network demonstrates state-of-the-art performance on three public RS cross-modal datasets: Sydney, UCM, and RSICD audio-visual datasets. The code is available at: https://github.com/WUTCM-Lab/SARCI. © 1980-2012 IEEE.

Keyword:

Amplitude modulation Image coding Image enhancement Image retrieval Job analysis Modal analysis Multi-task learning Photointerpretation

Community:

  • [ 1 ] [Chen, Yaxiong]The School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan; 430070, China
  • [ 2 ] [Chen, Yaxiong]Wuhan University of Technology, Sanya Science and Education Innovation Park, Sanya; 572000, China
  • [ 3 ] [Chen, Yaxiong]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 4 ] [Chen, Yaxiong]Chongqing Research Institute, Wuhan University of Technology, Chongqing; 401122, China
  • [ 5 ] [Du, Chuang]The School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan; 430070, China
  • [ 6 ] [Du, Chuang]Wuhan University of Technology, Sanya Science and Education Innovation Park, Sanya; 572000, China
  • [ 7 ] [Du, Chuang]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 8 ] [Du, Chuang]Chongqing Research Institute, Wuhan University of Technology, Chongqing; 401122, China
  • [ 9 ] [Zi, Yunfei]The School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan; 430070, China
  • [ 10 ] [Zi, Yunfei]Wuhan University of Technology, Sanya Science and Education Innovation Park, Sanya; 572000, China
  • [ 11 ] [Zi, Yunfei]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 12 ] [Zi, Yunfei]Chongqing Research Institute, Wuhan University of Technology, Chongqing; 401122, China
  • [ 13 ] [Xiong, Shengwu]The School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan; 430070, China
  • [ 14 ] [Xiong, Shengwu]Wuhan University of Technology, Sanya Science and Education Innovation Park, Sanya; 572000, China
  • [ 15 ] [Xiong, Shengwu]Shanghai Artificial Intelligence Laboratory, Shanghai; 200232, China
  • [ 16 ] [Xiong, Shengwu]Chongqing Research Institute, Wuhan University of Technology, Chongqing; 401122, China
  • [ 17 ] [Xiong, Shengwu]The School of Information Engineering, Wuhan Huaxia Institute of Technology, Wuhan; 430223, China
  • [ 18 ] [Xiong, Shengwu]The School of Information Science and Technology, Qiongtai Normal University, Haikou; 571127, China
  • [ 19 ] [Lu, Xiaoqiang]Fuzhou University, College of Physics and Information Engineering, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Geoscience and Remote Sensing

ISSN: 0196-2892

Year: 2024

Volume: 62

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:144/10042099
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1