• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Huang, Jie (Huang, Jie.) [1] (Scholars:黄捷) | Mo, Zhibin (Mo, Zhibin.) [2] | Zhang, Zhenyi (Zhang, Zhenyi.) [3] | Chen, Yutao (Chen, Yutao.) [4] (Scholars:陈宇韬)

Indexed by:

EI Scopus SCIE CSCD

Abstract:

In this study, a novel reinforcement learning task supervisor (RLTS) with memory in a behavioral control framework is proposed for human-multi-robot coordination systems (HMRCSs). Existing HMRCSs suffer from high decision-making time cost and large task tracking errors caused by repeated human intervention, which restricts the autonomy of multi-robot systems (MRSs). Moreover, existing task supervisors in the null-space-based behavioral control (NSBC) framework need to formulate many priority-switching rules manually, which makes it difficult to realize an optimal behavioral priority adjustment strategy in the case of multiple robots and multiple tasks. The proposed RLTS with memory provides a detailed integration of the deep Q-network (DQN) and long short-term memory (LSTM) knowledge base within the NSBC framework, to achieve an optimal behavioral priority adjustment strategy in the presence of task conflict and to reduce the frequency of human intervention. Specifically, the proposed RLTS with memory begins by memorizing human intervention history when the robot systems are not confident in emergencies, and then reloads the history information when encountering the same situation that has been tackled by humans previously. Simulation results demonstrate the effectiveness of the proposed RLTS. Finally, an experiment using a group of mobile robots subject to external noise and disturbances validates the effectiveness of the proposed RLTS with memory in uncertain real-world environments.

Keyword:

Human-multi-robot coordination systems Knowledge base Null-space-based behavioral control Reinforcement learning Task supervisor TP18

Community:

  • [ 1 ] [Huang, Jie]Fuzhou Univ, Sch Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 2 ] [Mo, Zhibin]Fuzhou Univ, Sch Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 3 ] [Zhang, Zhenyi]Fuzhou Univ, Sch Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 4 ] [Chen, Yutao]Fuzhou Univ, Sch Elect Engn & Automat, Fuzhou 350108, Peoples R China
  • [ 5 ] [Huang, Jie]Fuzhou Univ, 5G Ind Internet Inst, Fuzhou 350108, Peoples R China
  • [ 6 ] [Mo, Zhibin]Fuzhou Univ, 5G Ind Internet Inst, Fuzhou 350108, Peoples R China
  • [ 7 ] [Zhang, Zhenyi]Fuzhou Univ, 5G Ind Internet Inst, Fuzhou 350108, Peoples R China
  • [ 8 ] [Chen, Yutao]Fuzhou Univ, 5G Ind Internet Inst, Fuzhou 350108, Peoples R China
  • [ 9 ] [Huang, Jie]Fuzhou Univ, Key Lab Ind Automat Control Technol & Informat Pr, Fuzhou 350108, Peoples R China
  • [ 10 ] [Mo, Zhibin]Fuzhou Univ, Key Lab Ind Automat Control Technol & Informat Pr, Fuzhou 350108, Peoples R China
  • [ 11 ] [Zhang, Zhenyi]Fuzhou Univ, Key Lab Ind Automat Control Technol & Informat Pr, Fuzhou 350108, Peoples R China
  • [ 12 ] [Chen, Yutao]Fuzhou Univ, Key Lab Ind Automat Control Technol & Informat Pr, Fuzhou 350108, Peoples R China

Reprint 's Address:

Show more details

Related Keywords:

Source :

FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING

ISSN: 2095-9184

CN: 33-1389/TP

Year: 2022

Issue: 8

Volume: 23

Page: 1174-1188

3 . 0

JCR@2022

2 . 7 0 0

JCR@2023

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:61

JCR Journal Grade:2

CAS Journal Grade:3

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 7

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Online/Total:287/10044006
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1