Tsukada Lab. Computer Network Group

Edge Vision AI Co-Processing for Dynamic Context Awareness in Mixed Reality

Honorable Mention Award

Alex Orsholits, Manabu Tsukada

IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025), Saint-Malo, France, 2025年3月8日

3行要約

  • 単体で使える複合現実ヘッドセットに、エッジでの画像認識を追加する。
  • カメラ映像をAIアクセラレータへ送り、物体検出、姿勢推定、深度推定などを実行する。
  • 処理結果をヘッドセットに戻して空間に重ね、場面に応じた情報を提示する。

アブストラクト(原文)

Spatial computing is evolving towards leveraging data streaming for computationally demanding applications, facilitating a shift to lightweight, untethered, and standalone devices. These devices are ideal candidates for co-processing, where real-time scene context understanding and low-latency data streaming are fundamental for general-purpose Mixed Reality (MR) experiences. This poster demonstrates and evaluates a scalable approach to augmented contextual understanding in MR by implementing edge AI co-processing through a Hailo-8 AI accelerator, a low-power ARM-based single board computer (SBC), and the Magic Leap 2 AR headset. The resulting inferences are streamed back to the headset for spatial reprojection into the user’s vision.

動画

関連する研究・ソフトウェア

関連ニュース

引用方法

A. Orsholits and M. Tsukada, “Edge Vision AI Co-Processing for Dynamic Context Awareness in Mixed Reality,” in IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025), Saint-Malo, France, 2025, doi: 10.1109/VRW66409.2025.00293.

BibTeX

@misc{Orsholits2025b,
  title         = {Edge Vision AI Co-Processing for Dynamic Context Awareness in Mixed Reality},
  author        = {Alex Orsholits and Manabu Tsukada},
  url           = {https://www.youtube.com/watch?v=xxahKZl4K9w https://ieeevr.org/2025/awards/conference-awards/#poster-honorable},
  doi           = {10.1109/VRW66409.2025.00293},
  year          = {2025},
  date          = {2025-03-08},
  urldate       = {2025-03-08},
  booktitle     = {IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2025)},
  address       = {Saint-Malo, France},
  abstract      = {Spatial computing is evolving towards leveraging data streaming for computationally demanding applications, facilitating a shift to lightweight, untethered, and standalone devices. These devices are ideal candidates for co-processing, where real-time scene context understanding and low-latency data streaming are fundamental for general-purpose Mixed Reality (MR) experiences. This poster demonstrates and evaluates a scalable approach to augmented contextual understanding in MR by implementing edge AI co-processing through a Hailo-8 AI accelerator, a low-power ARM-based single board computer (SBC), and the Magic Leap 2 AR headset. The resulting inferences are streamed back to the headset for spatial reprojection into the user’s vision.},
  howpublished  = {IEEE VR 2025, Poster},
  note          = {Honorable Mention Award},
  keywords      = {Award, SDM},
  pubstate      = {published},
  tppubtype     = {misc}
}