• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Wang, Xu (Wang, Xu.) [1] | Kong, Weifeng (Kong, Weifeng.) [2] | Zhang, Qiudan (Zhang, Qiudan.) [3] | Yang, You (Yang, You.) [4] | Zhao, Tiesong (Zhao, Tiesong.) [5] | Jiang, Jianmin (Jiang, Jianmin.) [6]

Indexed by:

EI

Abstract:

Owing to the rapid development of emerging 360° panoramic imaging techniques, indoor 360° depth estimation has aroused extensive attention in the community. Due to the lack of available ground truth depth data, it is extremely urgent to model indoor 360° depth estimation in self-supervised mode. However, self-supervised 360° depth estimation suffers from two major limitations. One is the distortion and network training problems caused by Equirectangular projection (ERP), and the other is that texture-less regions are quite difficult to back-propagate in self-supervised mode. Hence, to address the above issues, we introduce spherical view synthesis for learning self-supervised 360° depth estimation. Specifically, to alleviate the ERP-related problems, we first propose a dual-branch distortion-aware network to produce the coarse depth map, including a distortion-aware module and a hybrid projection fusion module. Subsequently, the coarse depth map is utilized for spherical view synthesis, in which a spherically weighted loss function for view reconstruction and depth smoothing is investigated to optimize the projection distribution problem of 360° images. In addition, two structural regularities of indoor 360° scenes are devised as two additional supervisory signals to efficiently optimize our self-supervised 360° depth estimation model, containing the principal-direction normal constraint and the co-planar depth constraint. The principal-direction normal constraint is designed to align the normal of the 360° image with the direction of the vanishing points. Meanwhile, we employ the co-planar depth constraint to fit the estimated depth of each pixel through its 3D plane. Finally, a depth map is obtained for the 360° image. Experimental results illustrate that our proposed method achieves superior performance than the current advanced depth estimation methods on four publicly available datasets. © 1999-2012 IEEE.

Keyword:

Feature extraction Image reconstruction Inspection Job analysis Latexes Personnel training Supervised learning

Community:

  • [ 1 ] [Wang, Xu]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen; 518060, China
  • [ 2 ] [Kong, Weifeng]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen; 518060, China
  • [ 3 ] [Zhang, Qiudan]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen; 518060, China
  • [ 4 ] [Yang, You]Huangzhong University of Science and Technology, School of Electronic Information and Communications, Wuhan; 430074, China
  • [ 5 ] [Zhao, Tiesong]Fuzhou University, College of Physics and Information Engineering, Fuzhou; 350108, China
  • [ 6 ] [Jiang, Jianmin]Shenzhen University, College of Computer Science and Software Engineering, Shenzhen; 518060, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Multimedia

ISSN: 1520-9210

Year: 2024

Volume: 26

Page: 3998-4011

8 . 4 0 0

JCR@2023

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:766/10890846
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1