• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Shizhen (Huang, Shizhen.) [1] | Tang, Enhao (Tang, Enhao.) [2] | Li, Shun (Li, Shun.) [3]

Indexed by:

EI

Abstract:

Recently, Graph Attention Networks (GATs) have shown good performance for representation learning on graphs. Furthermore, GAT leverage the masked self-Attention mechanism to get a more advanced feature representation than the graph convolution networks (GCNs). However, GAT incurs large amounts of irregularity in computation and memory access, which prevents the efficient use of traditional neural network accelerators. Moreover, existing dedicated GAT accelerators demand high memory volumes and are difficult to implement onto resource-limited edge devices. Due to this, this paper proposes an FPGA-based accelerator, called H-GAT, which achieves excellent performance on acceleration and energy efficiency in GAT inference. HGAT decomposes GAT operation into matrix multiplication and activation function unit. We first design an effective and fully-pipelined PE for sparse matrix multiplication (SpMM) and dense matrix-vector multiplication (DMVM). Moreover, we optimize the softmax data flow so that the computational efficiency of softmax can be improved dramatically. We evaluate our design on Xilinx Kintex-7 FPGA with three popular datasets. Compared to existing CPU, GPU, and state-of-The-Art FPGA-based GAT accelerator, H-GAT can achieve speedup by up to 585×, 2.7×, and 11× and increases power efficiency by up to 2095×, 173×, and 65×, respectively. © 2023 Authors. All rights reserved.

Keyword:

Computational efficiency Energy efficiency Field programmable gate arrays (FPGA) Graph neural networks Integrated circuit design Matrix algebra Memory architecture

Community:

  • [ 1 ] [Huang, Shizhen]College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350116, China
  • [ 2 ] [Tang, Enhao]College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350116, China
  • [ 3 ] [Li, Shun]College of Physics and Information Engineering, Fuzhou University, Fuzhou; 350116, China

Reprint 's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Journal of Applied Science and Engineering (Taiwan)

ISSN: 2708-9967

Year: 2023

Issue: 3

Volume: 27

Page: 2233-2240

1 . 1

JCR@2023

1 . 1 0 0

JCR@2023

JCR Journal Grade:3

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:145/10048894
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1