• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Yang, Dan (Yang, Dan.) [1] | Peng, Xin (Peng, Xin.) [2] | Wu, Xiaolong (Wu, Xiaolong.) [3] | Huang, Haojie (Huang, Haojie.) [4] (Scholars:黄昊杰) | Li, Linlin (Li, Linlin.) [5] | Zhong, Weimin (Zhong, Weimin.) [6]

Indexed by:

EI Scopus SCIE

Abstract:

During the process of real-time monitoring, low sampling rate make it difficult to construct a prediction model of variable due to the lack of data. Transfer learning addresses the dilemma of lacking sufficiently labeled data for training neural networks by leveraging relevant labeled data for knowledge transfer, which can significantly improve the prediction accuracy of the low sampling rate variable by utilizing high sampling rate variables. When the feature spaces of low and high sampling rate indicators do not coincide, it constitutes a special case of transfer learning known as Heterogeneous Transfer Learning (HTL). One classical way of HTL is fine-tuning the pre-trained source model. Nevertheless, they mainly focus on optimizing the weights of pre-trained models and ignore the mismatch of structure. Therefore, in this paper, Domain Perceptive-Pruning and Fine-tuning (DP-PF) is proposed for HTL to simultaneously tune the structure and weights of the source pre-trained model and improve its adaptability to the target task. Specifically, DP-PF proposes target-perceptive pruning that removes unimportant layers from the source pre-trained model based on the target pre-trained model to tune structure, importance-perceptive fine-tuning with adaptive learning rate based on layer importance to tune the weights, and source-perceptive regularizing to mitigate catastrophic forgetting of original knowledge contained in the source model. Experiments are constructed based on the wastewater treatment process and air quality prediction. The R-2 predicted by DP-PF is at least 12% higher than that of other compared methods. The excellence of DP-PF in accurate cross-domain prediction proves the effectiveness of the proposed method.

Keyword:

Air quality prediction Fine-tune Heterogeneous transfer learning Prune Regularize Wastewater treatment process

Community:

  • [ 1 ] [Yang, Dan]Hunan Univ Sci & Technol, Dept Informat & Elect Engn, Xiangtan 411201, Peoples R China
  • [ 2 ] [Yang, Dan]East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
  • [ 3 ] [Peng, Xin]East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
  • [ 4 ] [Zhong, Weimin]East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
  • [ 5 ] [Wu, Xiaolong]Beijing Univ Technol, Beijing Artificial Intelligence Inst, Fac Informat Technol,Minist Educ, Engn Res Ctr Digital Community,Beijing Key Lab Com, Beijing 100124, Peoples R China
  • [ 6 ] [Wu, Xiaolong]Beijing Univ ofTechnol, Beijing Lab Intelligent Environm Protect, Beijing 100124, Peoples R China
  • [ 7 ] [Huang, Haojie]Fuzhou Univ, Coll Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 8 ] [Li, Linlin]Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China

Reprint 's Address:

  • [Zhong, Weimin]East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China;;

Show more details

Related Keywords:

Source :

EXPERT SYSTEMS WITH APPLICATIONS

ISSN: 0957-4174

Year: 2024

Volume: 260

7 . 5 0 0

JCR@2023

Cited Count:

WoS CC Cited Count: 4

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:230/10059559
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1