• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Xie, Lehui (Xie, Lehui.) [1] | Wang, Yaopeng (Wang, Yaopeng.) [2] | Yin, Jia-Li (Yin, Jia-Li.) [3] (Scholars:印佳丽) | Liu, Ximeng (Liu, Ximeng.) [4] (Scholars:刘西蒙)

Indexed by:

EI

Abstract:

High cost of training time caused by multi-step adversarial example generation is a major challenge in adversarial training. Previous methods try to reduce the computational burden of adversarial training using single-step adversarial example generation schemes, which can effectively improve the efficiency but also introduce the problem of 'catastrophic overfitting', where the robust accuracy against Fast Gradient Sign Method (FGSM) can achieve nearby 100% whereas the robust accuracy against Projected Gradient Descent (PGD) suddenly drops to 0% over a single epoch. To address this issue, we focus on single-step adversarial training scheme in this paper and propose a novel Fast Gradient Sign Method with PGD Regularization (FGSMPR) to boost the efficiency of adversarial training without catastrophic overfitting. Our core observation is that single-step adversarial training can not simultaneously learn robust internal representations of FGSM and PGD adversarial examples. Therefore, we design a PGD regularization term to encourage similar embeddings of FGSM and PGD adversarial examples. The experiments demonstrate that our proposed method can train a robust deep network for L∞ -perturbations with FGSM adversarial training and reduce the gap to multi-step adversarial training. © 2021, Springer Nature Switzerland AG.

Keyword:

Deep learning Efficiency Gradient methods

Community:

  • [ 1 ] [Xie, Lehui]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 2 ] [Xie, Lehui]Fujian Provincial Key Laboratory of Information Security of Network Systems, Fuzhou University, Fuzhou; 350108, China
  • [ 3 ] [Wang, Yaopeng]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 4 ] [Wang, Yaopeng]Fujian Provincial Key Laboratory of Information Security of Network Systems, Fuzhou University, Fuzhou; 350108, China
  • [ 5 ] [Yin, Jia-Li]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 6 ] [Yin, Jia-Li]Fujian Provincial Key Laboratory of Information Security of Network Systems, Fuzhou University, Fuzhou; 350108, China
  • [ 7 ] [Liu, Ximeng]College of Mathematics and Computer Science, Fuzhou University, Fuzhou; 350108, China
  • [ 8 ] [Liu, Ximeng]Fujian Provincial Key Laboratory of Information Security of Network Systems, Fuzhou University, Fuzhou; 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 0302-9743

Year: 2021

Volume: 13022 LNCS

Page: 29-41

Language: English

0 . 4 0 2

JCR@2005

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:263/10036477
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1