• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Yao, Z. (Yao, Z..) [1] | Gao, W. (Gao, W..) [2] | Li, G. (Li, G..) [3] | Zhao, T. (Zhao, T..) [4]

Indexed by:

Scopus

Abstract:

The key challenge of cross-modal salient object detection lies in the representational discrepancy between different modal inputs. Existing methods typically employ only one encoding mode, either constrained encoding to extract modality-shared characteristics, or unconstrained encoding to capture modality-specific traits. However, the use of a single paradigm limits the capability of capturing salient cues, thus leading to poor generalization of existing methods. We propose a novel learning paradigm named “Collaborating Constrained and Unconstrained Encodings” (CCUE) that integrates constrained and unconstrained feature extraction to discover richer salient cues. Accordingly, we establish a CCUE network (CCUENet) consisting of a constrained branch and an unconstrained branch. The representations at each level from these two branches are integrated in an Information Selection and Fusion (ISF) module. The novelty of this module lies in its selective fusion of the important information from each feature primarily based on the response degree, which enables the network to aggregate effective cues for saliency detection. In the network training stage, we propose a Multi-scale Boundary Information (MBI) loss, which can constrain the detection results to retain clear region boundaries and boost the model's robustness to variations in object scale. Under the supervision of MBI loss, CCUENet is able to output high-quality saliency maps. The experimental results show that CCUENet exhibits superior performance on RGB-T and RGB-D datasets. © 2017 IEEE.

Keyword:

constrained features information selection and fusion multi-scale boundary information loss Salient object detection unconstrained features

Community:

  • [ 1 ] [Yao Z.]Peking University, Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, School of Electronic and Computer Engineering, Shenzhen, 518055, China
  • [ 2 ] [Gao W.]School of Electronic and Computer Engineering, Peking University, Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Shenzhen, 518055, China
  • [ 3 ] [Gao W.]Peng Cheng Laboratory, Shenzhen, 518066, China
  • [ 4 ] [Li G.]Peking University, Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, School of Electronic and Computer Engineering, Shenzhen, 518055, China
  • [ 5 ] [Zhao T.]Fuzhou University, College of Physics and Information Engineering, Fuzhou, 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Emerging Topics in Computational Intelligence

ISSN: 2471-285X

Year: 2025

5 . 3 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:1356/13860558
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1