Tsukada Lab. Computer Network Group

Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns

Dongyang Li

Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo, 2025年3月31日

3行要約

  • 矢印信号の保護がない交差点で、周囲の映像と自車の運動状態に基づくEnd-to-End運転を検討する。
  • 模倣学習の方策にクロスアテンションを組み込み、画像と自車状態の特徴を融合する。
  • AWSIMの交差点シナリオで、従来の模倣学習を上回った。

論文の図

図 4.1: クロスアテンションを用いた模倣学習フレームワークの全体像(保護のない交差点の右左折向け)
図 4.1. クロスアテンションを用いた模倣学習フレームワークの全体像(保護のない交差点の右左折向け)出典: 修士論文、東京大学、2025(著者版) の図 4.1前方カメラ画像を事前学習済みViTでパッチトークンに変換し、向き・位置・右左折指示・速度を状態トークンに変換する。クロスアテンションで画像パッチを重み付けし、アッカーマン制御コマンドを出力する。
図 5.5: AWSIMの保護のない右折シナリオにおける、Autowareと3つの学習方策の成功率
図 5.5. AWSIMの保護のない右折シナリオにおける、Autowareと3つの学習方策の成功率出典: 修士論文、東京大学、2025(著者版) の図 5.5クロスアテンション方策の成功率は94%で、CIL-ViTの84%、ViT-Onlyの70%、Autowareの42%を上回った。

アブストラクト(原文)

Performing an unprotected turn at the intersection is a complex scenario for autonomous vehicles. It requires a comprehensive understanding of the surrounding environment, while also highly relying on the current state of the ego vehicle to make safer decisions. A conventional way to learn end-to-end autonomous driving is imitation learning, which stands for learning from expert demonstrations. While most imitation learning methods focus on imitating the expert action, they often fail to imitate a complex policy efficiently when the ego vehicle’s states are crucial to the scenario because there might be arbitrary optimal actions under different states. To address this issue and investigate how vehicle states affect autonomous driving, we present a novel cross-attention enhanced imitation learning approach for end-to-end autonomous driving in unprotected turns, focusing on capturing the relationships between the ego vehicle’s states and its perception of the environment. We evaluated our model in the AWSIM simulator, an open source autonomous driving simulator, and the results demonstrate that our model outperformed conventional imitation learning-based baselines in performing unprotected turn scenarios, showcasing its ability to imitate a complex policy efficiently.

引用方法

D. Li, “Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns,” in Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo, 2025.

BibTeX

@mastersthesis{Li2025,
  title         = {Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns},
  author        = {Dongyang Li},
  year          = {2025},
  date          = {2025-03-31},
  urldate       = {2025-03-31},
  school        = {Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo},
  abstract      = {Performing an unprotected turn at the intersection is a complex scenario for autonomous vehicles. It requires a comprehensive understanding of the surrounding environment, while also highly relying on the current state of the ego vehicle to make safer decisions. A conventional way to learn end-to-end autonomous driving is imitation learning, which stands for learning from expert demonstrations. While most imitation learning methods focus on imitating the expert action, they often fail to imitate a complex policy efficiently when the ego vehicle’s states are crucial to the scenario because there might be arbitrary optimal actions under different states. To address this issue and investigate how vehicle states affect autonomous driving, we present a novel cross-attention enhanced imitation learning approach for end-to-end autonomous driving in unprotected turns, focusing on capturing the relationships between the ego vehicle’s states and its perception of the environment. We evaluated our model in the AWSIM simulator, an open source autonomous driving simulator, and the results demonstrate that our model outperformed conventional imitation learning-based baselines in performing unprotected turn scenarios, showcasing its ability to imitate a complex policy efficiently.},
  keywords      = {Thesis},
  pubstate      = {published},
  tppubtype     = {mastersthesis}
}