Tsukada Lab. Computer Network Group

TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue

Ye Tao, Manabu Tsukada, Hiroshi Esaki

IEEE 103rd Vehicular Technology Conference (VTC2026-Spring), Nice, France, 2026年6月9日

3行要約

  • TacitCollabは自由形式のV2Xメッセージで、運転エージェント同士が衝突回避を調整する仕組みである。
  • 既存プランナの走行意図を受け取り、元の形式で更新した意図を返す。
  • DeepAccidentの238場面で衝突回避率97.4%を報告した。

アブストラクト(原文)

Autonomous vehicles increasingly rely on Vehicle-to-Everything (V2X) communication to coordinate in complex traffic scenarios. However, the existing approaches typically exchange predefined message formats such as waypoints or discrete actions, limiting their ability to handle exotic situations that require nuanced negotiation. We propose TacitCollab, a V2X dialogue system that enables vehicles to coordinate collision avoidance through free-form natural language communication. TacitCollab leverages vision-language models to interpret traffic situations and engage in human-like dialogue, allowing vehicles to share observations, negotiate priorities, and reach mutual agreements. The system is designed as a plug-and-play module that can be inserted into existing autonomous driving pipelines, accepting intentions in arbitrary formats and outputting updated intentions in the same format. We evaluate TacitCollab on 238 collision scenarios from the DeepAccident dataset. Results show a Collision Avoidance Ratio of 97.4%, with 84.2% of scenarios achieving coordinated outcomes where vehicles successfully negotiate right-of-way. The average bandwidth of 1.17 KB per scenario demonstrates that text-based dialogue is practical for bandwidth-constrained V2X networks.

引用方法

Y. Tao, M. Tsukada, and H. Esaki, “TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue,” in IEEE 103rd Vehicular Technology Conference (VTC2026-Spring), Nice, France, 2026.

BibTeX

@inproceedings{Tao2026,
  title         = {TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue},
  author        = {Ye Tao and Manabu Tsukada and Hiroshi Esaki},
  year          = {2026},
  date          = {2026-06-09},
  urldate       = {2026-06-09},
  booktitle     = {IEEE 103rd Vehicular Technology Conference (VTC2026-Spring)},
  address       = {Nice, France},
  abstract      = {Autonomous vehicles increasingly rely on Vehicle-to-Everything (V2X) communication to coordinate in complex traffic scenarios. However, the existing approaches typically exchange predefined message formats such as waypoints or discrete actions, limiting their ability to handle exotic situations that require nuanced negotiation. We propose TacitCollab, a V2X dialogue system that enables vehicles to coordinate collision avoidance through free-form natural language communication. TacitCollab leverages vision-language models to interpret traffic situations and engage in human-like dialogue, allowing vehicles to share observations, negotiate priorities, and reach mutual agreements. The system is designed as a plug-and-play module that can be inserted into existing autonomous driving pipelines, accepting intentions in arbitrary formats and outputting updated intentions in the same format. We evaluate TacitCollab on 238 collision scenarios from the DeepAccident dataset. Results show a Collision Avoidance Ratio of 97.4%, with 84.2% of scenarios achieving coordinated outcomes where vehicles successfully negotiate right-of-way. The average bandwidth of 1.17 KB per scenario demonstrates that text-based dialogue is practical for bandwidth-constrained V2X networks.},
  keywords      = {CRONOS, ITS},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}