Tiled Hybrid Wave-Geometric Acoustic Fields for City-Scale Outdoor Mixed-Reality Auralisation
International Conference on Extended Reality (ICXR 2026), Guangzhou, China, Nov 5, 2026
Summary in three lines
- The work precomputes tiled acoustic fields for physically informed outdoor sound in mixed reality.
- It combines wave simulation at low frequencies with geometric acoustics at higher frequencies and corrects vertical leakage in the 2D model.
- Tokyo tests measured 3.68 dB mean absolute error after correction at 125 Hz and 95.7% probe coverage on a walking trace.
Abstract
Outdoor mixed-reality auralisation requires virtual sound sources to remain acoustically consistent with the surrounding built environment as sources and listeners move through it. Extending this behaviour from an individual scene to an urban area requires a reusable representation of sound propagation that remains computationally viable across the audible spectrum and allows the spatial data required at runtime to be streamed on demand. This paper describes a system for constructing tiled multiband acoustic fields from three-dimensional building meshes and co-registered terrain data. Rather than containing predetermined programme material, these fields describe the acoustic transfer between candidate source positions and their surrounding listener domains, allowing the same urban bake to spatialise subsequently selected source signals. Simulation geometry and source-probe layouts are generated automatically, whilst the bake is distributed across a scalable pool of containerised compute workers. Propagation is simulated independently for each frequency band using three-dimensional and two-dimensional finite-element methods together with geometrical acoustics. The lowest-band three-dimensional response also supplies a per-cell outdoorness measure used to compensate for vertical energy escape that cannot be represented by a two-dimensional simulation. The encoded fields retain attenuation, reverberation and direction of arrival independently across frequency, so different spectral components may reach the listener along distinct urban propagation paths. They are partitioned into spatial tiles that can be transferred and retained according to the active sources and listener trajectory, whilst remaining independent of a particular rendering implementation. We evaluate the system through end-to-end baking and parallel-scaling experiments, measurements of spatial coverage and storage cost, and trace-driven streaming tests with moving sources and listeners. Runtime experiments characterise cache residency, transfer latency, audioprocessing cost and concurrent-source capacity. Frequency-dependent directionality is examined through an ablation against a single broadband arrival direction in urban configurations where reflected and diffracted paths diverge across frequency.
How to cite
A. Orsholits and M. Tsukada, “Tiled Hybrid Wave-Geometric Acoustic Fields for City-Scale Outdoor Mixed-Reality Auralisation,” in International Conference on Extended Reality (ICXR 2026), Guangzhou, China, 2026.
BibTeX
@inproceedings{Orsholits2026b,
title = {Tiled Hybrid Wave-Geometric Acoustic Fields for City-Scale Outdoor Mixed-Reality Auralisation},
author = {Alex Orsholits and Manabu Tsukada},
year = {2026},
date = {2026-11-05},
urldate = {2026-11-05},
booktitle = {International Conference on Extended Reality (ICXR 2026)},
address = {Guangzhou, China},
abstract = {Outdoor mixed-reality auralisation requires virtual sound sources to remain acoustically consistent with the surrounding built environment as sources and listeners move through it. Extending this behaviour from an individual scene to an urban area requires a reusable representation of sound propagation that remains computationally viable across the audible spectrum and allows the spatial data required at runtime to be streamed on demand. This paper describes a system for constructing tiled multiband acoustic fields from three-dimensional building meshes and co-registered terrain data. Rather than containing predetermined programme material, these fields describe the acoustic transfer between candidate source positions and their surrounding listener domains, allowing the same urban bake to spatialise subsequently selected source signals. Simulation geometry and source-probe layouts are generated automatically, whilst the bake is distributed across a scalable pool of containerised compute workers. Propagation is simulated independently for each frequency band using three-dimensional and two-dimensional finite-element methods together with geometrical acoustics. The lowest-band three-dimensional response also supplies a per-cell outdoorness measure used to compensate for vertical energy escape that cannot be represented by a two-dimensional simulation. The encoded fields retain attenuation, reverberation and direction of arrival independently across frequency, so different spectral components may reach the listener along distinct urban propagation paths. They are partitioned into spatial tiles that can be transferred and retained according to the active sources and listener trajectory, whilst remaining independent of a particular rendering implementation. We evaluate the system through end-to-end baking and parallel-scaling experiments, measurements of spatial coverage and storage cost, and trace-driven streaming tests with moving sources and listeners. Runtime experiments characterise cache residency, transfer latency, audioprocessing cost and concurrent-source capacity. Frequency-dependent directionality is examined through an ablation against a single broadband arrival direction in urban configurations where reflected and diffracted paths diverge across frequency.},
keywords = {SDM},
pubstate = {published},
tppubtype = {inproceedings}
}