Tsukada Lab. Computer Network Group
← Publications Int'l conference

TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue

Ye Tao, Manabu Tsukada, Hiroshi Esaki

IEEE 103rd Vehicular Technology Conference (VTC2026-Spring), Nice, France, Jun 9, 2026

Summary in three lines

  • TacitCollab lets driving agents exchange free-form V2X messages to negotiate collision avoidance.
  • The module accepts an existing planner’s intent and returns an updated intent in the original format.
  • It reached a 97.4% collision-avoidance ratio on 238 selected DeepAccident scenarios.

Abstract

Autonomous vehicles increasingly rely on Vehicle-to-Everything (V2X) communication to coordinate in complex traffic scenarios. However, the existing approaches typically exchange predefined message formats such as waypoints or discrete actions, limiting their ability to handle exotic situations that require nuanced negotiation. We propose TacitCollab, a V2X dialogue system that enables vehicles to coordinate collision avoidance through free-form natural language communication. TacitCollab leverages vision-language models to interpret traffic situations and engage in human-like dialogue, allowing vehicles to share observations, negotiate priorities, and reach mutual agreements. The system is designed as a plug-and-play module that can be inserted into existing autonomous driving pipelines, accepting intentions in arbitrary formats and outputting updated intentions in the same format. We evaluate TacitCollab on 238 collision scenarios from the DeepAccident dataset. Results show a Collision Avoidance Ratio of 97.4%, with 84.2% of scenarios achieving coordinated outcomes where vehicles successfully negotiate right-of-way. The average bandwidth of 1.17 KB per scenario demonstrates that text-based dialogue is practical for bandwidth-constrained V2X networks.

How to cite

Y. Tao, M. Tsukada, and H. Esaki, “TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue,” in IEEE 103rd Vehicular Technology Conference (VTC2026-Spring), Nice, France, 2026.

BibTeX

@inproceedings{Tao2026,
  title         = {TacitCollab: A Plug-and-Play V2X Safety Filter via Free-Form LLM Dialogue},
  author        = {Ye Tao and Manabu Tsukada and Hiroshi Esaki},
  year          = {2026},
  date          = {2026-06-09},
  urldate       = {2026-06-09},
  booktitle     = {IEEE 103rd Vehicular Technology Conference (VTC2026-Spring)},
  address       = {Nice, France},
  abstract      = {Autonomous vehicles increasingly rely on Vehicle-to-Everything (V2X) communication to coordinate in complex traffic scenarios. However, the existing approaches typically exchange predefined message formats such as waypoints or discrete actions, limiting their ability to handle exotic situations that require nuanced negotiation. We propose TacitCollab, a V2X dialogue system that enables vehicles to coordinate collision avoidance through free-form natural language communication. TacitCollab leverages vision-language models to interpret traffic situations and engage in human-like dialogue, allowing vehicles to share observations, negotiate priorities, and reach mutual agreements. The system is designed as a plug-and-play module that can be inserted into existing autonomous driving pipelines, accepting intentions in arbitrary formats and outputting updated intentions in the same format. We evaluate TacitCollab on 238 collision scenarios from the DeepAccident dataset. Results show a Collision Avoidance Ratio of 97.4%, with 84.2% of scenarios achieving coordinated outcomes where vehicles successfully negotiate right-of-way. The average bandwidth of 1.17 KB per scenario demonstrates that text-based dialogue is practical for bandwidth-constrained V2X networks.},
  keywords      = {CRONOS, ITS},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}