Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0
Best Paper Runner-up AwardINFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026年5月18日
DOI: 10.1109/INFOCOM59046.2026.11571634
3行要約
- 動的な工場環境で無人搬送車の軌道を計画する。
- 分散型の情報共有と、サブタスク別のアクターを持つTriple DQNを使う。
- 実験では、DQN系の比較手法より高い報酬と安定した学習を報告した。
アブストラクト(原文)
Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.
動画
関連する研究・ソフトウェア
関連ニュース
引用方法
Q. Zhou, W. Mao, Y. Xiao, M. Tsukada, and Y. Ji, “Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0,” in INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026, doi: 10.1109/INFOCOM59046.2026.11571634.
BibTeX
@workshop{Zhou2026,
title = {Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0},
author = {Quanxi Zhou and Wencan Mao and Yu Xiao and Manabu Tsukada and Yusheng Ji},
doi = {10.1109/INFOCOM59046.2026.11571634},
year = {2026},
date = {2026-05-18},
urldate = {2026-05-18},
booktitle = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
abstract = {Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.},
howpublished = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
note = {Best Paper Runner-up Award},
keywords = {Other},
pubstate = {published},
tppubtype = {workshop}
}