• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Cai, S. (Cai, S..) [1] | Fang, J. (Fang, J..) [2] | Xu, M. (Xu, M..) [3]

Indexed by:

Scopus

Abstract:

Currently, congestion has become a common urban disease. Recently, traffic control methods leveraging reinforcement learning (RL) have gained significant attention due to their capability to effectively utilize real-time traffic data. However, existing RL-based methods for multi-intersection traffic signal control (TSC) solely focus on enhancing network-level performance, which can potentially exacerbate traffic conditions at specific intersections, making it unreasonable. This balance of network-level and local intersection traffic conditions is referred to as the fairness issue in TSC. To address the aforementioned fairness issue and further alleviate congestion, a multi-agent reinforcement learning (MARL) algorithm, COunterfactual Multi-Agent policy gradients (COMA), which, compared to Multi-agent Advantage Actor-Critic (MA2C), is characterized by its use of counterfactual advantage estimation to effectively resolve the credit assignment problem, was employed in multi-intersection TSC domain. However, as an on-policy algorithm, COMA encounters limitations in training sample utilization, specifically in terms of inefficient sample usage and temporal correlation among samples. To enhance the efficiency of sample usage and to mitigate the temporal correlation among training samples, thereby improving overall training efficiency, we introduced (a) importance sampling and (b) distributed computing. COMA, when incorporating importance sampling and distributed computing, evolved into our method, Advanced-COMA, which demonstrated effectiveness in the experiments. Additionally, a fairness-aware reward function was designed to better address fairness considerations. Finally, extensive experiments were conducted on both synthetic and real-world traffic networks, including grid and arterial scenarios. The results confirmed the superiority of our methods in enhancing traffic conditions and fairness. Some details can be found on https://github.com/caisibin/FS.  © 2025 IEEE.

Keyword:

distributed computing importance sampling MARL TSC

Community:

  • [ 1 ] [Cai S.]Fuzhou University, College of Civil Engineering, Fujian, Fuzhou, 350108, China
  • [ 2 ] [Fang J.]Fuzhou University, College of Civil Engineering, Fujian, Fuzhou, 350108, China
  • [ 3 ] [Xu M.]National University of Singapore, civil and environmental engineering, Singapore

Reprint 's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Internet of Things Journal

ISSN: 2327-4662

Year: 2025

8 . 2 0 0

JCR@2023

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:26/10058115
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1