• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhou, Yuanbo (Zhou, Yuanbo.) [1] | Xue, Yuyang (Xue, Yuyang.) [2] | Zhang, Xinlin (Zhang, Xinlin.) [3] | Deng, Wei (Deng, Wei.) [4] | Wang, Tao (Wang, Tao.) [5] | Tan, Tao (Tan, Tao.) [6] | Gao, Qinquan (Gao, Qinquan.) [7] (Scholars:高钦泉) | Tong, Tong (Tong, Tong.) [8] (Scholars:童同)

Indexed by:

EI Scopus SCIE

Abstract:

Despite advances in the use of the strategy of pre-training then fine-tuning in low-level vision tasks, the increasing size of models presents significant challenges for this paradigm, particularly in terms of training time and memory consumption. In addition, unsatisfactory results may occur when pre-trained single-image models are directly applied to a multi-image domain. In this paper, we propose an efficient method for transferring a pre-trained single-image super-resolution transformer network to the domain of stereo image super-resolution (SteISR) using a parameter-efficient fine-tuning approach. Specifically, the concept of stereo adapters and spatial adapters are introduced, which are incorporated into the pre-trained single-image super-resolution transformer network. Subsequently, only the inserted adapters are trained on stereo datasets. Compared with the classical full fine-tuning paradigm, our method can effectively reduce training time and memory consumption by 57% and 15%, respectively. Moreover, this method allows us to train only 4.8% of the original model parameters, achieving state-of-the-art performance on four commonly used SteISR benchmarks. This technology is expected to improve stereo image resolution in various fields such as medical imaging and autonomous driving, thereby indirectly enhancing the accuracy of depth estimation and object recognition tasks.

Keyword:

Autonomous driving Parameter-efficient fine-tuning Stereo image super-resolution Transfer learning

Community:

  • [ 1 ] [Zhou, Yuanbo]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 2 ] [Zhang, Xinlin]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 3 ] [Wang, Tao]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 4 ] [Gao, Qinquan]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 5 ] [Tong, Tong]Fuzhou Univ, Fuzhou 350108, Peoples R China
  • [ 6 ] [Deng, Wei]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 7 ] [Gao, Qinquan]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 8 ] [Tong, Tong]Imperial Vis Technol, Fuzhou 350002, Peoples R China
  • [ 9 ] [Xue, Yuyang]Univ Edinburgh, Edinburgh EH8 9YL, Scotland
  • [ 10 ] [Tan, Tao]Macao Polytech Univ, Se 999078, Macao, Peoples R China

Reprint 's Address:

  • 童同

    [Tong, Tong]Fuzhou Univ, Fuzhou 350108, Peoples R China;;[Tong, Tong]Imperial Vis Technol, Fuzhou 350002, Peoples R China

Show more details

Version:

Related Keywords:

Related Article:

Online/Total:119/10043342
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1