Tsukada Lab. Computer Network Group

PLATONE: An Immersive Geospatial Audio Spatialization Platform

Alex Orsholits, Yiyuan Qian, Eric Nardini, Yusuke Obuchi, Manabu Tsukada

2nd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2024), Hong Kong, China, 2024年8月12日

3行要約

  • PLATONEは都市規模の立体音響を扱う複合現実の試作基盤である。
  • 位置情報付きの3D形状を使い、環境が音の聞こえ方に与える影響を表現する。
  • 専用のハードウェアとソフトウェアで利用者の周囲に仮想音源を配置する。

論文の図

図 7: Project Acousticsを使ったPLATONEの処理手順
図 7. Project Acousticsを使ったPLATONEの処理手順出典: Orsholits et al., 2nd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2024), 2024(著者原稿の図版) の図 7環境の形状から音の伝わり方を計算し、利用者の位置に応じて音を再現する流れが分かる。

アブストラクト(原文)

In the rapidly evolving landscape of mixed reality (MR) and spatial computing, the convergence of physical and virtual spaces is becoming increasingly crucial for enabling immersive, large-scale user experiences and shaping inter-reality dynamics. This is particularly significant for immersive audio at city-scale, where the 3D geometry of the environment must be considered, as it drastically influences how sound is perceived by the listener. This paper introduces PLATONE, a novel proof-of-concept MR platform designed to augment urban contexts with environment-dependent spatialized audio. It leverages custom hardware for localization and orientation, alongside a cloud-based pipeline for generating real-time binaural audio. By utilizing open-source 3D building datasets, sound propagation effects such as occlusion, reverberation, and diffraction are accurately simulated. We believe that this work may serve as a compelling foundation for further research and development.

関連する研究・ソフトウェア

関連ニュース

引用方法

A. Orsholits, Y. Qian, E. Nardini, Y. Obuchi, and M. Tsukada, “PLATONE: An Immersive Geospatial Audio Spatialization Platform,” in 2nd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2024), Hong Kong, China, 2024, doi: 10.1109/MetaCom62920.2024.00020.

BibTeX

@inproceedings{Orsholits2024,
  title         = {PLATONE: An Immersive Geospatial Audio Spatialization Platform},
  author        = {Alex Orsholits and Yiyuan Qian and Eric Nardini and Yusuke Obuchi and Manabu Tsukada},
  doi           = {10.1109/MetaCom62920.2024.00020},
  year          = {2024},
  date          = {2024-08-12},
  urldate       = {2024-08-12},
  booktitle     = {2nd Annual IEEE International Conference on Metaverse Computing, Networking, and Applications (MetaCom 2024)},
  address       = {Hong Kong, China},
  abstract      = {In the rapidly evolving landscape of mixed reality (MR) and spatial computing, the convergence of physical and virtual spaces is becoming increasingly crucial for enabling immersive, large-scale user experiences and shaping inter-reality dynamics. This is particularly significant for immersive audio at city-scale, where the 3D geometry of the environment must be considered, as it drastically influences how sound is perceived by the listener. This paper introduces PLATONE, a novel proof-of-concept MR platform designed to augment urban contexts with environment-dependent spatialized audio. It leverages custom hardware for localization and orientation, alongside a cloud-based pipeline for generating real-time binaural audio. By utilizing open-source 3D building datasets, sound propagation effects such as occlusion, reverberation, and diffraction are accurately simulated. We believe that this work may serve as a compelling foundation for further research and development.},
  keywords      = {SDM},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}