• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Xu (Wang, Xu.) [1] | Kong, Weifeng (Kong, Weifeng.) [2] | Zhang, Qiudan (Zhang, Qiudan.) [3] | Yang, You (Yang, You.) [4] | Zhao, Tiesong (Zhao, Tiesong.) [5] (Scholars:赵铁松) | Jiang, Jianmin (Jiang, Jianmin.) [6]

Indexed by:

EI Scopus SCIE

Abstract:

Owing to the rapid development of emerging 360(degrees)panoramic imaging techniques, indoor 360(degrees)depth estimation has aroused extensive attention in the community. Due to the lack of available ground truth depth data, it is extremely urgent to model indoor 360(degrees)depth estimation in self-supervised mode. However, self-supervised 360 degrees depth estimation suffers from two major limitations. One is the distortion and network training problems caused by Equirectangular projection (ERP), and the other is that texture-less regions are quite difficult to back-propagate in self-supervised mode. Hence, to address the above issues, we introduce spherical view synthesis for learning self-supervised 360(degrees)depthestimation. Specifically, to alleviate the ERP-related problems, we first propose a dual-branch distortion-aware network to produce the coarse depth map, including a distortion-aware module and a hybrid projection fusion module. Subsequently, the coarse depth map is utilized for spherical view synthesis, in which a spherically weighted loss function for view reconstruction and depth smoothing is investigated to optimize the projection distribution problem of360(degrees)images. In addition, two structural regularities of indoor360(degrees)scenes are devised as two additional supervisory signals to efficiently optimize our self-supervised 360(degrees)depth estimation model, containing the principal-direction normal constraint and the co-planar depth constraint. The principal-direction normal constraint is designed to align the normal of the 360(degrees)imagewith the direction of the vanishing points. Meanwhile, we employ the co-planar depth constraint to fit the estimated depth of each pixel through its 3D plane. Finally, a depth map is obtained for the 360(degrees)image. Experimental results illustrate that our proposed method achieves superior performance than the current advanced depth estimation methods on four publicly available datasets

Keyword:

360(degrees) image depth estimation Distortion Estimation Feature extraction Image reconstruction self-supervised learning Self-supervised learning structural regularity Task analysis Training

Community:

  • [ 1 ] [Wang, Xu]Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
  • [ 2 ] [Kong, Weifeng]Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
  • [ 3 ] [Zhang, Qiudan]Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
  • [ 4 ] [Jiang, Jianmin]Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
  • [ 5 ] [Yang, You]Huangzhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
  • [ 6 ] [Zhao, Tiesong]Fuzhou Univ, Coll Phys & Informat Engn, Fuzhou 350108, Peoples R China

Reprint 's Address:

  • [Zhang, Qiudan]Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Show more details

Related Keywords:

Source :

IEEE TRANSACTIONS ON MULTIMEDIA

ISSN: 1520-9210

Year: 2024

Volume: 26

Page: 3998-4011

8 . 4 0 0

JCR@2023

Cited Count:

WoS CC Cited Count: 2

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:194/10039797
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1