Tsukada Lab. Computer Network Group
← 発表論文一覧 ワークショップ等

Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0

Best Paper Runner-up Award

Quanxi Zhou, Wencan Mao, Yu Xiao, Manabu Tsukada, Yusheng Ji

INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026年5月18日

3行要約

  • 動的な工場環境で無人搬送車の軌道を計画する。
  • 分散型の情報共有と、サブタスク別のアクターを持つTriple DQNを使う。
  • 実験では、DQN系の比較手法より高い報酬と安定した学習を報告した。

アブストラクト(原文)

Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.

動画

関連する動画: Trajectory Planning for UAV-Based Smart Farming Using Imitation-Based Triple Deep Q-Learning

関連する研究・ソフトウェア

関連ニュース

引用方法

Q. Zhou, W. Mao, Y. Xiao, M. Tsukada, and Y. Ji, “Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0,” in INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026, doi: 10.1109/INFOCOM59046.2026.11571634.

BibTeX

@workshop{Zhou2026,
  title         = {Deep Reinforcement Learning for Automated Guided Vehicle Trajectory Planning in Industry 4.0},
  author        = {Quanxi Zhou and Wencan Mao and Yu Xiao and Manabu Tsukada and Yusheng Ji},
  doi           = {10.1109/INFOCOM59046.2026.11571634},
  year          = {2026},
  date          = {2026-05-18},
  urldate       = {2026-05-18},
  booktitle     = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  abstract      = {Automated Guided Vehicles (AGVs) play a vital role in the Fourth Industrial Revolution (Industry 4.0), improving safety, time efficiency, and cost-effectiveness. While existing works focused on centralized or independent AGV control, we propose a distributed strategy for the large-scale, dynamic, and multi-functional environments of Industry 4.0. The proposed strategy enables AGVs to autonomously generate their material delivery trajectories while sharing information to support collaborative searching. Moreover, to enhance effectiveness and efficiency, we propose a Sub-task Agent Triple Deep Q-Network (SA-TDQN) algorithm, which decouples the actors for each sub-task mode, while incorporating a mediator Q-network between the online and target Q-networks. Experiments demonstrate that the proposed strategy is both feasible and effective. Furthermore, SA-TDQN consistently outperforms Deep Q-Network (DQN), Double DQN, and Triple DQN in terms of reward, training efficiency, and convergence stability, with comparable time complexity.},
  howpublished  = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  note          = {Best Paper Runner-up Award},
  keywords      = {Other},
  pubstate      = {published},
  tppubtype     = {workshop}
}