Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns
Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo, 2025年3月31日
3行要約
- 矢印信号の保護がない交差点で、周囲の映像と自車の運動状態に基づくEnd-to-End運転を検討する。
- 模倣学習の方策にクロスアテンションを組み込み、画像と自車状態の特徴を融合する。
- AWSIMの交差点シナリオで、従来の模倣学習を上回った。
論文の図


アブストラクト(原文)
Performing an unprotected turn at the intersection is a complex scenario for autonomous vehicles. It requires a comprehensive understanding of the surrounding environment, while also highly relying on the current state of the ego vehicle to make safer decisions. A conventional way to learn end-to-end autonomous driving is imitation learning, which stands for learning from expert demonstrations. While most imitation learning methods focus on imitating the expert action, they often fail to imitate a complex policy efficiently when the ego vehicle’s states are crucial to the scenario because there might be arbitrary optimal actions under different states. To address this issue and investigate how vehicle states affect autonomous driving, we present a novel cross-attention enhanced imitation learning approach for end-to-end autonomous driving in unprotected turns, focusing on capturing the relationships between the ego vehicle’s states and its perception of the environment. We evaluated our model in the AWSIM simulator, an open source autonomous driving simulator, and the results demonstrate that our model outperformed conventional imitation learning-based baselines in performing unprotected turn scenarios, showcasing its ability to imitate a complex policy efficiently.
引用方法
D. Li, “Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns,” in Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo, 2025.
BibTeX
@mastersthesis{Li2025,
title = {Cross-Attention Enhanced End-to-End Autonomous Driving in Unprotected Turns},
author = {Dongyang Li},
year = {2025},
date = {2025-03-31},
urldate = {2025-03-31},
school = {Master Thesis, Graduate School of Information Science and Technology, The University of Tokyo},
abstract = {Performing an unprotected turn at the intersection is a complex scenario for autonomous vehicles. It requires a comprehensive understanding of the surrounding environment, while also highly relying on the current state of the ego vehicle to make safer decisions. A conventional way to learn end-to-end autonomous driving is imitation learning, which stands for learning from expert demonstrations. While most imitation learning methods focus on imitating the expert action, they often fail to imitate a complex policy efficiently when the ego vehicle’s states are crucial to the scenario because there might be arbitrary optimal actions under different states. To address this issue and investigate how vehicle states affect autonomous driving, we present a novel cross-attention enhanced imitation learning approach for end-to-end autonomous driving in unprotected turns, focusing on capturing the relationships between the ego vehicle’s states and its perception of the environment. We evaluated our model in the AWSIM simulator, an open source autonomous driving simulator, and the results demonstrate that our model outperformed conventional imitation learning-based baselines in performing unprotected turn scenarios, showcasing its ability to imitate a complex policy efficiently.},
keywords = {Thesis},
pubstate = {published},
tppubtype = {mastersthesis}
}