• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Shi, C. (Shi, C..) [1] | Li, J. (Li, J..) [2] | Zhuang, J. (Zhuang, J..) [3] | Yao, X. (Yao, X..) [4] | Huang, Y. (Huang, Y..) [5] | Fu, Y.-G. (Fu, Y.-G..) [6] (Scholars:傅仰耿)

Indexed by:

CPCI-S EI Scopus

Abstract:

With increasing popularity and larger real-world applicability, graph self-supervised learning (GSSL) can significantly reduce labeling costs by extracting implicit input supervision. As a promising example, graph masked auto-encoders (GMAE) can encode rich node knowledge by recovering the masked input components, e.g., features or edges. Despite their competitiveness, existing GMAEs focus only on neighboring information reconstruction, which totally ignores distant multi-hop semantics and thus fails to capture global knowledge. Furthermore, many GMAEs cannot scale on large-scale graphs since they suffer from memory bottlenecks with unavoidable full-batch training. To address these challenges and facilitate “high-level” discriminative semantics, we propose a simple yet effective framework (i.e., HopMAE) to encourage hop-perspective semantic interactions by adopting multi-hop input-rich reconstruction while supporting mini-batch training. Despite the rationales of the above designs, we still observe some limitations (e.g., sub-optimal generalizability and training instability), potentially due to the implicit gap between the task-triviality and input-richness of reconstruction. Therefore, to alleviate task-triviality and fully unleash the potential of our framework, we further propose a combined fine-grained loss function, which generalizes the existing ones and significantly improves the difficulties of reconstruction tasks, thus naturally alleviating over-fitting. Extensive experiments on eight benchmarks demonstrate that our method comprehensively outperforms many state-of-the-art counterparts. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

Keyword:

Graph Masked Auto-Encoders Graph Neural Networks Graph Representation Learning Self-Supervised Learning

Community:

  • [ 1 ] [Shi C.]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 2 ] [Li J.]AI Thrust, Information Hub, HKUST (Guangzhou), Guangzhou, China
  • [ 3 ] [Zhuang J.]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 4 ] [Yao X.]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 5 ] [Huang Y.]College of Computer and Data Science, Fuzhou University, Fuzhou, China
  • [ 6 ] [Fu Y.-G.]College of Computer and Data Science, Fuzhou University, Fuzhou, China

Reprint 's Address:

Email:

Show more details

Version:

Related Keywords:

Source :

ISSN: 0302-9743

Year: 2024

Volume: 14876 LNAI

Page: 343-355

Language: English

0 . 4 0 2

JCR@2005

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:147/10059297
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1