Tsukada Lab. Computer Network Group
← Publications Workshop / WiP

Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks

Xiaoyang He, Manabu Tsukada

INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), May 18, 2026

Summary in three lines

  • BKC-UCB selects base stations and beams for mmWave vehicular links using contextual bandits.
  • The kernel shares information among similar observations and beams, with event-triggered updates among vehicles.
  • Experiments compare regret and transmission rate with baseline association methods.

Abstract

Timely channel information is necessary for vehicles to determine both the serving base station (BS) and the beamforming vector, but frequent estimation of fast-fading mmWave channels incurs significant overhead. To address this challenge, we propose a Beam-aware Kernelized Contextual Upper Confidence Bound (BKC-UCB) algorithm that estimates instantaneous transmission rates without additional channel measurements by exploiting historical contexts such as vehicle location and velocity, together with past observed transmission rates. Specifically, BKC-UCB leverages kernel methods to capture the nonlinear relationship between context and transmission rate by mapping contexts into a reproducing kernel Hilbert space (RKHS), where linear learning becomes feasible. Rather than treating each beam as an independent arm, the beam index is embedded into the context, enabling BKC-UCB to exploit correlations among beams to accelerate convergence. Furthermore, an event-triggered information sharing mechanism is incorporated into BKC-UCB, enabling information exchange only when significant explorations are conducted to improve learning efficiency with limited communication overhead.

Related news

How to cite

X. He and M. Tsukada, “Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks,” in INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026, doi: 10.1109/INFOCOM59046.2026.11571675.

BibTeX

@workshop{He2026b,
  title         = {Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks},
  author        = {Xiaoyang He and Manabu Tsukada},
  url           = {https://arxiv.org/abs/2603.19285},
  doi           = {10.1109/INFOCOM59046.2026.11571675},
  year          = {2026},
  date          = {2026-05-18},
  urldate       = {2026-05-18},
  booktitle     = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  abstract      = {Timely channel information is necessary for vehicles to determine both the serving base station (BS) and the beamforming vector, but frequent estimation of fast-fading mmWave channels incurs significant overhead. To address this challenge, we propose a Beam-aware Kernelized Contextual Upper Confidence Bound (BKC-UCB) algorithm that estimates instantaneous transmission rates without additional channel measurements by exploiting historical contexts such as vehicle location and velocity, together with past observed transmission rates. Specifically, BKC-UCB leverages kernel methods to capture the nonlinear relationship between context and transmission rate by mapping contexts into a reproducing kernel Hilbert space (RKHS), where linear learning becomes feasible. Rather than treating each beam as an independent arm, the beam index is embedded into the context, enabling BKC-UCB to exploit correlations among beams to accelerate convergence. Furthermore, an event-triggered information sharing mechanism is incorporated into BKC-UCB, enabling information exchange only when significant explorations are conducted to improve learning efficiency with limited communication overhead.},
  howpublished  = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
  keywords      = {ITS},
  pubstate      = {published},
  tppubtype     = {workshop}
}