• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Tang, Hui (Tang, Hui.) [1] | Zhou, Yuanbo (Zhou, Yuanbo.) [2] | Chen, Yuanbin (Chen, Yuanbin.) [3] | Zhang, Xinlin (Zhang, Xinlin.) [4] | Xue, Yuyang (Xue, Yuyang.) [5] | Lin, Xiaoyong (Lin, Xiaoyong.) [6] | Dai, Xinwei (Dai, Xinwei.) [7] | Qiu, Xintao (Qiu, Xintao.) [8] | Gao, Qinquan (Gao, Qinquan.) [9] | Tong, Tong (Tong, Tong.) [10]

Indexed by:

EI

Abstract:

Image colorization has a wide range of applications, but it remains a challenging task due to it is an inherently ill-posed problem with multi-modal uncertainty. The advancement of deep learning techniques has provided extensive avenues for addressing image colorization. However, current works mainly suffer from two problems: inaccurate colorization leading to biased color tones (e.g., cool or warm bias) and undersaturation of images. Existing Transformer-based methods can produce impressive results, but they often come with high training costs and may result in color overflow effects. In this paper, we propose a two-stage image colorization strategy based on a color codebook. Clustering methods in the three-dimensional CIE Lab color space is proposed to integrate brightness information so that the colors in the codebook can be lifelike. In the first stage, we treat the colorization task as a classification problem based on a color codebook, and a high-quality codebook is advantageous for enhancing color classification accuracy. In the second stage, different from the traditional Transformer-based method, a pyramid-type Transformer structure is used to extract rich image features to refine the colors, which can solve potential color bands, color errors and color overflow. In addition, the parameters and FLOPs are significantly smaller than other traditional Transformer-based methods. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches. On the ImageNet validation set, the achieved values are 4.60, 25.23, 0.19, and 39.82 in terms of FID, PSNR, LPIPS, and CF, respectively. On the COCO-Stuff validation set, the achieved values are 5.62, 25.15, 0.19, and 36.25 in terms of FID, PSNR, LPIPS, and CF, respectively. The codes are available at https://github.com/Tanghui2000/Two-stage_Image_Colorization_via_Color_Codebook. © 2024

Keyword:

Color Convolutional neural networks Deep neural networks Image classification Learning systems

Community:

  • [ 1 ] [Tang, Hui]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 2 ] [Tang, Hui]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 3 ] [Zhou, Yuanbo]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 4 ] [Zhou, Yuanbo]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 5 ] [Chen, Yuanbin]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 6 ] [Chen, Yuanbin]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 7 ] [Zhang, Xinlin]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 8 ] [Zhang, Xinlin]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 9 ] [Xue, Yuyang]Edinburgh University, Edinburgh, United Kingdom
  • [ 10 ] [Lin, Xiaoyong]Fujian Provincial Key Laboratory for Network Audiovisual Application Innovationand, Xiamen University of Technology, Xiamen, China
  • [ 11 ] [Dai, Xinwei]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 12 ] [Dai, Xinwei]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 13 ] [Qiu, Xintao]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 14 ] [Qiu, Xintao]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 15 ] [Gao, Qinquan]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 16 ] [Gao, Qinquan]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 17 ] [Gao, Qinquan]Imperial Vision Technology, Fuzhou, China
  • [ 18 ] [Tong, Tong]College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
  • [ 19 ] [Tong, Tong]Fujian Key Lab of Medical Instrumentation & Pharmaceutical Technology, Fuzhou University, Fuzhou, China
  • [ 20 ] [Tong, Tong]Imperial Vision Technology, Fuzhou, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Expert Systems with Applications

ISSN: 0957-4174

Year: 2024

Volume: 250

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:191/10039824
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1