• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Chen, Guang-Yong (Chen, Guang-Yong.) [1] | Gan, Min (Gan, Min.) [2] | Chen, Long (Chen, Long.) [3] | Chen, C. L. Philip (Chen, C. L. Philip.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

Separable nonlinear models (SNLMs) are of great importance in system modeling, signal processing, and machine learning because of their flexible structure and excellent description of nonlinear behaviors. The online identification of such models is quite challenging, and previous related work usually ignores the special structure where the estimated parameters can be partitioned into a linear and a nonlinear part. In this brief, we propose an efficient first-order recursive algorithm for SNLMs by introducing the variable projection (VP) step. The proposed algorithm utilizes the recursive least-squares method to eliminate the linear parameters, resulting in a reduced function. Then, the stochastic gradient descent (SGD) algorithm is employed to update the parameters of the reduced function. By considering the tight coupling relationship between linear parameters and nonlinear parameters, the proposed first-order VP algorithm is more efficient and robust than the traditional SGD algorithm and alternating optimization algorithm. More importantly, since the proposed algorithm just uses the first-order information, it is easier to apply it to large-scale models. Numerical results on examples of different sizes confirm the effectiveness and efficiency of the proposed algorithm.

Keyword:

Couplings Feedforward neural networks (FNNs) Jacobian matrices Machine learning algorithms Numerical models online identification Optimization separable nonlinear models (SNLMs) Signal processing algorithms stochastic gradient descent (SGD) method Stochastic processes variable projection (VP) method

Community:

  • [ 1 ] [Chen, Guang-Yong]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
  • [ 2 ] [Gan, Min]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
  • [ 3 ] [Chen, Guang-Yong]Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
  • [ 4 ] [Gan, Min]Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
  • [ 5 ] [Chen, C. L. Philip]Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
  • [ 6 ] [Chen, Long]Univ Macau, Fac Sci & Technol, Macau, Peoples R China
  • [ 7 ] [Chen, C. L. Philip]South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China

Reprint 's Address:

  • [Gan, Min]Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China;;

Show more details

Version:

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS

ISSN: 2162-237X

Year: 2024

Issue: 6

Volume: 35

Page: 8695-8701

1 0 . 2 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Online/Total:308/10032372
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1