• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Sun, Z. (Sun, Z..) [1] | Chen, Z. (Chen, Z..) [2] | Liu, J. (Liu, J..) [3] | Yu, Y. (Yu, Y..) [4]

Indexed by:

Scopus

Abstract:

Feature selection plays a critical role in many machine learning applications as it effectively addresses the challenges posed by “the curse of dimensionality” and enhances the generalization capability of trained models. However, existing approaches for multi-class feature selection (MFS) often combine sparse regularization with a simple classification model, such as least squares regression, which can result in suboptimal performance. To address this limitation, this paper introduces a novel MFS method called Sparse Softmax Feature Selection (S2FS). S2FS combines a l2,0-norm regularization with the Softmax model to perform feature selection. By utilizing the l2,0-norm, S2FS produces a more precise sparsity solution for the feature selection matrix. Additionally, the Softmax model improves the interpretability of the model’s outputs, thereby enhancing the classification performance. To further enhance discriminative feature selection, a discriminative regularization, derived based on linear discriminate analysis (LDA), is incorporated into the learning model. Furthermore, an efficient optimization algorithm, based on the alternating direction method of multipliers (ADMM), is designed to solve the objective function of S2FS. Extensive experiments conducted on various datasets demonstrate that S2FS achieves higher accuracy in classification tasks compared to several contemporary MFS methods. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2024.

Keyword:

Alternating direction method of multipliers Discriminative regularization L2,0-norm regularization Multi-class feature selection

Community:

  • [ 1 ] [Sun Z.]College of Computer Science and Technology, HuaQiao University, Jimei Avenue, Fujian Province, Xiamen, 361021, China
  • [ 2 ] [Sun Z.]Xiamen Key Laboratory of Computer Vision and Pattern Recognition, HuaQiao University, Jimei Avenue, Fujian Province, Xiamen, 361021, China
  • [ 3 ] [Chen Z.]College of Computer Science and Technology, HuaQiao University, Jimei Avenue, Fujian Province, Xiamen, 361021, China
  • [ 4 ] [Liu J.]College of Computer Science and Technology, HuaQiao University, Jimei Avenue, Fujian Province, Xiamen, 361021, China
  • [ 5 ] [Yu Y.]College of Computer and Data Science, Fuzhou University, Wulong Jiangbei Avenue, Fujian Province, Fuzhou, 350108, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

International Journal of Machine Learning and Cybernetics

ISSN: 1868-8071

Year: 2024

Issue: 1

Volume: 16

Page: 159-172

3 . 1 0 0

JCR@2023

CAS Journal Grade:4

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:117/10851192
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1