Tsukada Lab. Computer Network Group
← Publications Workshop / WiP

Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0

Best Paper Runner-up Award

Quanxi Zhou, Wencan Mao, Yu Xiao, Manabu Tsukada, Yusheng Ji

INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), May 18, 2026

Summary in three lines

  • The study plans trajectories for automated guided vehicles in a dynamic factory environment.
  • It uses decentralized information sharing and a triple DQN with separate actors for subtasks.
  • Experiments report improved reward and training stability over variants of DQN.

Abstract

Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.

Video

Related video: Trajectory Planning for UAV-Based Smart Farming Using Imitation-Based Triple Deep Q-Learning

Related research and software

Related news

How to cite

Q. Zhou, W. Mao, Y. Xiao, M. Tsukada, and Y. Ji, “Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0,” in INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026, doi: 10.1109/INFOCOM59046.2026.11571634.

BibTeX

@workshop{Zhou2026,
  title         = {Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0},
  author        = {Quanxi Zhou and Wencan Mao and Yu Xiao and Manabu Tsukada and Yusheng Ji},
  doi           = {10.1109/INFOCOM59046.2026.11571634},
  year          = {2026},
  date          = {2026-05-18},
  urldate       = {2026-05-18},
  booktitle     = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  abstract      = {Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.},
  howpublished  = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  note          = {Best Paper Runner-up Award},
  keywords      = {Other},
  pubstate      = {published},
  tppubtype     = {workshop}
}