Tsukada Lab. Computer Network Group

CARE: Camera-Residual Reserves for First Sightings in Adaptive LiDAR Sensing

Jiachen Gong, Yun Li, Ehsan Javanmardi, Wencan Mao, Manabu Tsukada

18th Asian Conference on Computer Vision (ACCV 2026), Osaka, Japan, 2026年12月14日

3行要約

  • CAREは、既存の追跡結果で説明できないカメラ観測にLiDAR走査枠の一部を割り当てる。
  • 速度に応じた安全距離の外にある静止・遠ざかる追跡対象から、走査枠を再配分する。
  • nuScenesで、履歴だけを使う方式より初出物体の再現率を4.3〜5.2ポイント改善した。

アブストラクト(原文)

Adaptive LiDAR scanning, which concentrates a limited sensing budget on informative regions of interest based on past object tracks, is becoming a key enabler in autonomous driving by lowering data volume while maintaining detection accuracy. However, existing scanning policies face three key challenges. First, history-driven approaches depend heavily on past object tracks, leading to delayed or missed detection of unseen objects. Second, methods leveraging random or uniform sampling outside the predicted regions have no awareness of where new objects appear. Third, camera-guided alternatives spend their budget on all camera detections, resampling objects that are already covered, which costs overall recall in crowded scenes and detection range when budgets are scarce. To address these limitations, this paper introduces the CAmera-REsidual reserve (CARE), a training-free allocation rule that reserves part of a fixed ray budget for the directions of current camera detections that the track forecasts cannot explain, while the remaining budget follows the base history policy and unused reserve returns to a shared random floor. The paper makes three key contributions: First, a leakage-free ray-budget evaluation on nuScenes (150 scenes, 4,148 events) that measures the first-sighting loss of history-driven scanning, with a strict-causal variant using the preceding keyframe. Second, CARE raises first-sighting recall by 5.2, 5.2, and 4.3 points at 10%, 20%, and 35% budgets over the history policy with paired intervals excluding zero; the camera cue drives this gain, and the first-sighting versus overall trade-off is reported openly as a budget-dependent Pareto choice. Third, a safety-bounded forgetting module that releases budget from receding or static tracks beyond a speed-dependent guard distance; at tight budgets forgetting without the guard significantly harms near-field recall, and the guard is what keeps forgetting safe at the tightest budget. The pipeline runs end to end on a real vehicle and, in a closed-loop simulation, detects an occluded pedestrian earlier and brakes more reliably than history-driven scanning.

引用方法

J. Gong, Y. Li, E. Javanmardi, W. Mao, and M. Tsukada, “CARE: Camera-Residual Reserves for First Sightings in Adaptive LiDAR Sensing,” in 18th Asian Conference on Computer Vision (ACCV 2026), Osaka, Japan, 2026.

BibTeX

@inproceedings{Gong2026b,
  title         = {CARE: Camera-Residual Reserves for First Sightings in Adaptive LiDAR Sensing},
  author        = {Jiachen Gong and Yun Li and Ehsan Javanmardi and Wencan Mao and Manabu Tsukada},
  url           = {https://arxiv.org/abs/2608.24282},
  year          = {2026},
  date          = {2026-12-14},
  urldate       = {2026-12-14},
  booktitle     = {18th Asian Conference on Computer Vision (ACCV 2026)},
  address       = {Osaka, Japan},
  abstract      = {Adaptive LiDAR scanning, which concentrates a limited sensing budget on informative regions of interest based on past object tracks, is becoming a key enabler in autonomous driving by lowering data volume while maintaining detection accuracy. However, existing scanning policies face three key challenges. First, history-driven approaches depend heavily on past object tracks, leading to delayed or missed detection of unseen objects. Second, methods leveraging random or uniform sampling outside the predicted regions have no awareness of where new objects appear. Third, camera-guided alternatives spend their budget on all camera detections, resampling objects that are already covered, which costs overall recall in crowded scenes and detection range when budgets are scarce. To address these limitations, this paper introduces the CAmera-REsidual reserve (CARE), a training-free allocation rule that reserves part of a fixed ray budget for the directions of current camera detections that the track forecasts cannot explain, while the remaining budget follows the base history policy and unused reserve returns to a shared random floor. The paper makes three key contributions: First, a leakage-free ray-budget evaluation on nuScenes (150 scenes, 4,148 events) that measures the first-sighting loss of history-driven scanning, with a strict-causal variant using the preceding keyframe. Second, CARE raises first-sighting recall by 5.2, 5.2, and 4.3 points at 10%, 20%, and 35% budgets over the history policy with paired intervals excluding zero; the camera cue drives this gain, and the first-sighting versus overall trade-off is reported openly as a budget-dependent Pareto choice. Third, a safety-bounded forgetting module that releases budget from receding or static tracks beyond a speed-dependent guard distance; at tight budgets forgetting without the guard significantly harms near-field recall, and the guard is what keeps forgetting safe at the tightest budget. The pipeline runs end to end on a real vehicle and, in a closed-loop simulation, detects an occluded pedestrian earlier and brakes more reliably than history-driven scanning.},
  keywords      = {ITS},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}