• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Lin, Meixia (Lin, Meixia.) [1] | Liu, Yong-Jin (Liu, Yong-Jin.) [2] (Scholars:刘勇进) | Sun, Defeng (Sun, Defeng.) [3] | Toh, Kim-Chuan (Toh, Kim-Chuan.) [4]

Indexed by:

EI Scopus SCIE

Abstract:

We focus on solving the clustered Lasso problem, which is a least squares problem with the l(1)-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regression parameters. Here we first reformulate the clustered Lasso regularizer as a weighted ordered-Lasso regularizer, which is essential in reducing the computational cost from O(n(2)) to O(n log(n)). We then propose an inexact semismooth Newton augmented Lagrangian (SSNAL) algorithm to solve the clustered Lasso problem or its dual via this equivalent formulation, depending on whether the sample size is larger than the dimension of the features. An essential component of the SSNAL algorithm is the computation of the generalized Jacobian of the proximal mapping of the clustered Lasso regularizer. Based on the new formulation, we derive an efficient procedure for its computation. Comprehensive results on the global convergence and local linear convergence of the SSNAL algorithm are established. For the purpose of exposition and comparison, we also summarize/design several first-order methods that can be used to solve the problem under consideration, but with the key improvement from the new formulation of the clustered Lasso regularizer. As a demonstration of the applicability of our algorithms, numerical experiments on the clustered Lasso problem are performed. The experiments show that the SSNAL algorithm substantially outperforms the best alternative algorithm for the clustered Lasso problem.

Keyword:

augmented Lagrangian method clustered Lasso convex minimization semismooth Newton method

Community:

  • [ 1 ] [Lin, Meixia]Natl Univ Singapore, Dept Math, 10 Lower Kent Ridge Rd, Singapore, Singapore
  • [ 2 ] [Toh, Kim-Chuan]Natl Univ Singapore, Dept Math, 10 Lower Kent Ridge Rd, Singapore, Singapore
  • [ 3 ] [Liu, Yong-Jin]Fuzhou Univ, Key Lab Operat Res & Control Univ Fujian, Coll Math & Comp Sci, Fuzhou 350116, Fujian, Peoples R China
  • [ 4 ] [Sun, Defeng]Hong Kong Polytech Univ, Dept Appl Math, Hung Hom, Hong Kong, Peoples R China
  • [ 5 ] [Toh, Kim-Chuan]Natl Univ Singapore, Inst Operat Res & Analyt, 10 Lower Kent Ridge Rd, Singapore, Singapore

Reprint 's Address:

  • 刘勇进

    [Liu, Yong-Jin]Fuzhou Univ, Key Lab Operat Res & Control Univ Fujian, Coll Math & Comp Sci, Fuzhou 350116, Fujian, Peoples R China

Show more details

Related Keywords:

Source :

SIAM JOURNAL ON OPTIMIZATION

ISSN: 1052-6234

Year: 2019

Issue: 3

Volume: 29

Page: 2026-2052

2 . 2 4 7

JCR@2019

2 . 6 0 0

JCR@2023

ESI Discipline: MATHEMATICS;

ESI HC Threshold:59

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 13

SCOPUS Cited Count: 13

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:337/10899615
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1