• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhou, Yang (Zhou, Yang.) [1] | Wu, Hanjie (Wu, Hanjie.) [2] | Liu, Wenxi (Liu, Wenxi.) [3] (Scholars:刘文犀) | Xiong, Zheng (Xiong, Zheng.) [4] | Qin, Jing (Qin, Jing.) [5] | He, Shengfeng (He, Shengfeng.) [6]

Indexed by:

EI Scopus SCIE

Abstract:

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically, we leverage the reliable and explicit stereo prior to generate a pseudo-stereo viewpoint, which serves as an auxiliary input to construct the 3D space. In this way, the challenging novel view synthesis process is decoupled into two simpler problems of stereo synthesis and 3D reconstruction. In order to synthesize a structurally correct and detail-preserved stereo image, we propose a self-rectified stereo synthesis to amend erroneous regions in an identify-rectify manner. Hard-to-train and incorrect warping samples are first discovered by two strategies, (1) pruning the network to reveal low-confident predictions; and (2) bidirectionally matching between stereo images to allow the discovery of improper mapping. These regions are then inpainted to form the final pseudo-stereo. With the aid of this extra input, a preferable 3D reconstruction can be easily obtained, and our method can work with arbitrary 3D representations. Extensive experiments show that our method outperforms state-of-the-art single-view view synthesis methods and stereo synthesis methods.

Keyword:

3D reconstruction Stereo synthesis View synthesis

Community:

  • [ 1 ] [Zhou, Yang]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
  • [ 2 ] [Wu, Hanjie]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
  • [ 3 ] [Xiong, Zheng]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
  • [ 4 ] [Liu, Wenxi]Fuzhou Univ, Coll Math & Comp Sci, Fuzhou, Peoples R China
  • [ 5 ] [Qin, Jing]Hong Kong Polytech Univ, Dept Nursing, Hong Kong, Peoples R China
  • [ 6 ] [He, Shengfeng]Singapore Management Univ, Sch Comp & Informat Syst, Guangzhou, Singapore

Reprint 's Address:

  • [He, Shengfeng]Singapore Management Univ, Sch Comp & Informat Syst, Guangzhou, Singapore

Show more details

Version:

Related Keywords:

Source :

INTERNATIONAL JOURNAL OF COMPUTER VISION

ISSN: 0920-5691

Year: 2023

Issue: 8

Volume: 131

Page: 2032-2043

1 1 . 6

JCR@2023

1 1 . 6 0 0

JCR@2023

ESI Discipline: ENGINEERING;

ESI HC Threshold:35

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:365/10026603
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1