Tsukada Lab. Computer Network Group
← Publications Int'l conference

Web360^2: An Interactive Web Application for viewing 3D Audio-visual Contents

Shin Kato, Tomohiro Ikeda, Mitsuaki Kawamorita, Manabu Tsukada, Hiroshi Esaki

17th Sound and Music Computing Conference (SMC), Torino, Italy, pp. 32–39, Jun 25, 2020

Summary in three lines

  • Web360² is a web application for interactive playback of 360° video and object-based spatial audio.
  • It uses browser capabilities to make three-dimensional media accessible without a dedicated player.
  • The authors implemented the application and used a questionnaire to evaluate the viewing experience.

Figures from the paper

Figure 3: System design of Web360²
Figure 3. System design of Web360²Source: Figure 3 from Kato et al., Sound and Music Computing Conference 2020 (© the authors, CC BY 3.0; original figure from the authors’ manuscript)The diagram shows how the browser combines media files and metadata with viewer input to produce video and binaural audio.
Figure 5: Interactive playback in Web360²
Figure 5. Interactive playback in Web360²Source: Figure 5 from Kato et al., Sound and Music Computing Conference 2020 (© the authors, CC BY 3.0; original figure from the authors’ manuscript)The screen shows controls for playback and switching individual sound objects on or off.

Abstract

The use of video streaming services is expanding, and currently accounts for the majority of downstream Internet traffic. With the availability of virtual reality (VR) services and 360-degree cameras for consumer use, 3D services are also gaining in popularity. In recent years, the technology supporting for 3D representation on the Web has advanced. Users can easily utilize this technology without installing dedicated applications. In this study, we design and implement a Web application, called “Web360$^2$,” which plays 360-degree video and object-based 3D sounds interactively on the Web. We also evaluated Web360$^2$ through a questionnaire survey.

Video

Code

How to cite

S. Kato, T. Ikeda, M. Kawamorita, M. Tsukada, and H. Esaki, “Web360^2: An Interactive Web Application for viewing 3D Audio-visual Contents,” in 17th Sound and Music Computing Conference (SMC), Torino, Italy, 2020, doi: 10.5281/zenodo.3898664.

BibTeX

@inproceedings{Kato2020,
  title         = {Web360^{2}: An Interactive Web Application for viewing 3D Audio-visual Contents},
  author        = {Shin Kato and Tomohiro Ikeda and Mitsuaki Kawamorita and Manabu Tsukada and Hiroshi Esaki},
  url           = {https://zenodo.org/record/3898664/files/SMCCIM_2020_paper_102.pdf https://github.com/sdm-wg/web360square https://youtu.be/qg7aGhzO2Nc},
  doi           = {10.5281/zenodo.3898664},
  year          = {2020},
  date          = {2020-06-25},
  booktitle     = {17th Sound and Music Computing Conference (SMC)},
  pages         = {32--39},
  address       = {Torino, Italy},
  abstract      = {The use of video streaming services is expanding, and currently accounts for the majority of downstream Internet traffic. With the availability of virtual reality (VR) services and 360-degree cameras for consumer use, 3D services are also gaining in popularity. In recent years, the technology supporting for 3D representation on the Web has advanced. Users can easily utilize this technology without installing dedicated applications. In this study, we design and implement a Web application, called “Web360$^2$,” which plays 360-degree video and object-based 3D sounds interactively on the Web. We also evaluated Web360$^2$ through a questionnaire survey.},
  keywords      = {SDM},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}