Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks
INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), May 18, 2026
arXivDOI: 10.1109/INFOCOM59046.2026.11571675
Summary in three lines
- BKC-UCB selects base stations and beams for mmWave vehicular links using contextual bandits.
- The kernel shares information among similar observations and beams, with event-triggered updates among vehicles.
- Experiments compare regret and transmission rate with baseline association methods.
Abstract
Timely channel information is necessary for vehicles to determine both the serving base station (BS) and the beamforming vector, but frequent estimation of fast-fading mmWave channels incurs significant overhead. To address this challenge, we propose a Beam-aware Kernelized Contextual Upper Confidence Bound (BKC-UCB) algorithm that estimates instantaneous transmission rates without additional channel measurements by exploiting historical contexts such as vehicle location and velocity, together with past observed transmission rates. Specifically, BKC-UCB leverages kernel methods to capture the nonlinear relationship between context and transmission rate by mapping contexts into a reproducing kernel Hilbert space (RKHS), where linear learning becomes feasible. Rather than treating each beam as an independent arm, the beam index is embedded into the context, enabling BKC-UCB to exploit correlations among beams to accelerate convergence. Furthermore, an event-triggered information sharing mechanism is incorporated into BKC-UCB, enabling information exchange only when significant explorations are conducted to improve learning efficiency with limited communication overhead.
Related news
How to cite
X. He and M. Tsukada, “Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks,” in INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc), 2026, doi: 10.1109/INFOCOM59046.2026.11571675.
BibTeX
@workshop{He2026b,
title = {Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks},
author = {Xiaoyang He and Manabu Tsukada},
url = {https://arxiv.org/abs/2603.19285},
doi = {10.1109/INFOCOM59046.2026.11571675},
year = {2026},
date = {2026-05-18},
urldate = {2026-05-18},
booktitle = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
abstract = {Timely channel information is necessary for vehicles to determine both the serving base station (BS) and the beamforming vector, but frequent estimation of fast-fading mmWave channels incurs significant overhead. To address this challenge, we propose a Beam-aware Kernelized Contextual Upper Confidence Bound (BKC-UCB) algorithm that estimates instantaneous transmission rates without additional channel measurements by exploiting historical contexts such as vehicle location and velocity, together with past observed transmission rates. Specifically, BKC-UCB leverages kernel methods to capture the nonlinear relationship between context and transmission rate by mapping contexts into a reproducing kernel Hilbert space (RKHS), where linear learning becomes feasible. Rather than treating each beam as an independent arm, the beam index is embedded into the context, enabling BKC-UCB to exploit correlations among beams to accelerate convergence. Furthermore, an event-triggered information sharing mechanism is incorporated into BKC-UCB, enabling information exchange only when significant explorations are conducted to improve learning efficiency with limited communication overhead.},
howpublished = {INFOCOM 2026 International Workshop on Fusion of Data, Operation, Information, and Communication Technology for Industry 4.0 and Society 5.0 (DOICT-IndSoc)},
keywords = {ITS},
pubstate = {published},
tppubtype = {workshop}
}