• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Tian, Yuan (Tian, Yuan.) [1] | Yu, Yuanlong (Yu, Yuanlong.) [2] (Scholars:于元隆)

Indexed by:

EI Scopus

Abstract:

This paper presents a new pruning extreme learning machine (N-PELM) algorithm which can generate a compact single-hidden-layer neural network (SLNN) by automatically pruning the number of hidden nodes while keep high accuracy. The proposed N-PELM algorithm initializes a SLNN by using extreme learning machine (ELM) algorithm given superfluous number of hidden nodes. The following part consists of two iterative processes. First, the significance of the hidden node is estimated and the insignificant node is removed. Secondly, once the node be removed, the existing hidden nodes are updated using ELM algorithm. These two processes continue until all of each hidden nodes is estimated or the number of the hidden nodes is small enough. Compared against other neural network algorithms, N-PELM algorithm has mainly three improvements. Firstly, the significance of hidden nodes is estimated in output layer such that the relevance of hidden nodes and classes can be estimated more precisely. Secondly, the pruning threshold is selected automatically from a base set of potential relevance threshold values using Akaike information criterion (AIC) such that the threshold can accommodate any data type. Thirdly, P-ELM uses Kullback-Leibler (KL) divergence and Jensen-Shannon (JS) divergence to measure the significance of hidden nodes. Experimental results have shown that the P-ELM algorithm can automatically achieve a reasonable compact network structure while keep comparable or much higher accuracy in classification and regression. © 2017 IEEE.

Keyword:

Iterative methods Knowledge acquisition Learning algorithms Machine learning Multilayer neural networks Network layers

Community:

  • [ 1 ] [Tian, Yuan]College of Mathematics and Computer Science, Fuzhou University, Fuzhou, Fujian; 350116, China
  • [ 2 ] [Yu, Yuanlong]College of Mathematics and Computer Science, Fuzhou University, Fuzhou, Fujian; 350116, China

Reprint 's Address:

  • 于元隆

    [yu, yuanlong]college of mathematics and computer science, fuzhou university, fuzhou, fujian; 350116, china

Show more details

Version:

Related Keywords:

Related Article:

Source :

Year: 2017

Page: 704-709

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Online/Total:244/10044095
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1