AWSIM-VR: A Tightly-Coupled Virtual Reality Extension for Human-in-the-Loop Pedestrian-Autonomous Vehicle Interaction
3rd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2025), Seoul, Korea, 2025年8月27日
GitHub(コード)DOI: 10.1109/MetaCom65502.2025.00063
3行要約
- AWSIM-VRは、VRを通じて実際の歩行者が自動運転の閉ループシミュレーションに参加できるようにする。
- 歩行者の動きを自動運転スタックに渡し、シミュレーション内の車両挙動の変化を参加者に表示する。
- 車外ディスプレイとライトストリップを使った被験者実験で、インターフェースの評価に使えることを示した。
アブストラクト(原文)
Effective communication between autonomous vehicles (AVs) and pedestrians is crucial for ensuring future urban traffic safety. While external Human-Machine Interfaces (eHMIs) have emerged as promising solutions, current evaluation methodologies — particularly Virtual Reality (VR)-based studies — typically rely on scripted or pre-defined autonomous vehicle behaviors, limiting realism and neglecting pedestrians' active role in interactions. To address this, we introduce AWSIM-VR, a tightly-coupled VR extension of the AWSIM autonomous driving simulator, enabling real-time, human-in-the-loop pedestrian-AV interactions by directly integrating unmodified, real autonomous driving software (Autoware) into the simulation loop. Unlike previous systems, AWSIM-VR provides authentic, bidirectional interaction: pedestrians' actions dynamically influence vehicle decision-making and eHMI responses in real-time, closely emulating real-world AV scenarios. In user studies directly comparing AWSIM-VR to existing methodologies, participants reported significantly higher perceived realism and immersion, underscoring the importance of authentic autonomous behaviors in VR-based pedestrian interaction research. By directly utilizing production-level autonomous driving stacks, AWSIM-VR represents a significant methodological advancement, enabling more realistic, effective, and safer development and evaluation of eHMIs and AV technologies.
コード
関連ニュース
引用方法
S. Zhang, A. Orsholits, E. Javanmardi, and M. Tsukada, “AWSIM-VR: A Tightly-Coupled Virtual Reality Extension for Human-in-the-Loop Pedestrian-Autonomous Vehicle Interaction,” in 3rd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2025), Seoul, Korea, 2025, doi: 10.1109/MetaCom65502.2025.00063.
BibTeX
@inproceedings{Zhang2025,
title = {AWSIM-VR: A Tightly-Coupled Virtual Reality Extension for Human-in-the-Loop Pedestrian-Autonomous Vehicle Interaction},
author = {Shangkai Zhang and Alex Orsholits and Ehsan Javanmardi and Manabu Tsukada},
url = {https://github.com/zhangshangkai/AWSIM-VR},
doi = {10.1109/MetaCom65502.2025.00063},
year = {2025},
date = {2025-08-27},
urldate = {2025-08-27},
booktitle = {3rd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2025)},
address = {Seoul, Korea},
abstract = {Effective communication between autonomous vehicles (AVs) and pedestrians is crucial for ensuring future urban traffic safety. While external Human-Machine Interfaces (eHMIs) have emerged as promising solutions, current evaluation methodologies — particularly Virtual Reality (VR)-based studies — typically rely on scripted or pre-defined autonomous vehicle behaviors, limiting realism and neglecting pedestrians' active role in interactions. To address this, we introduce AWSIM-VR, a tightly-coupled VR extension of the AWSIM autonomous driving simulator, enabling real-time, human-in-the-loop pedestrian-AV interactions by directly integrating unmodified, real autonomous driving software (Autoware) into the simulation loop. Unlike previous systems, AWSIM-VR provides authentic, bidirectional interaction: pedestrians' actions dynamically influence vehicle decision-making and eHMI responses in real-time, closely emulating real-world AV scenarios. In user studies directly comparing AWSIM-VR to existing methodologies, participants reported significantly higher perceived realism and immersion, underscoring the importance of authentic autonomous behaviors in VR-based pedestrian interaction research. By directly utilizing production-level autonomous driving stacks, AWSIM-VR represents a significant methodological advancement, enabling more realistic, effective, and safer development and evaluation of eHMIs and AV technologies.},
keywords = {CRONOS, ITS},
pubstate = {published},
tppubtype = {inproceedings}
}