Tsukada Lab. Computer Network Group

LiVRation: Remote VR live platform with interactive 3D audio-visual service

Takashi Kasuya, Manabu Tsukada, Yu Komohara, Shigeki Takasaka, Takuhiro Mizuno, Yoshitaka Nomura, Yuta Ueda, Hiroshi Esaki

IEEE Games Entertainment & Media Conference (GEM 2019), Yale University, New Haven, CT, USA, pp. 1–7, 2019年6月19日

3行要約

  • LiVRationは、収録したライブ会場の中で視聴位置を自由に選べるシステム。
  • 映像と音声をオブジェクトとして扱い、3次元空間でインタラクティブに再生する。
  • 211名の体験者を対象にアンケートを行い、Billboard Live Hackasong 2017のデモで最優秀賞を受賞した。

論文の図

図 1: ライブ収録時のマイクとカメラの配置
図 1. ライブ収録時のマイクとカメラの配置出典: Takashi Kasuya ほか、IEEE GEM 2019(著者原稿の原図) の図 1後から演奏空間を再現するために、各音源と360度映像をどの位置から収録したかが分かる。
図 6: LiVRationの主観評価
図 6. LiVRationの主観評価出典: Takashi Kasuya ほか、IEEE GEM 2019(著者原稿の原図) の図 6立体音響、映像、操作体験に対する視聴者の回答分布が分かる。

アブストラクト(原文)

Of late, various audio-visual services based on the internet are being deployed extensively. Among these, object- based audio-visual services are attracting more attention. In 2014, we had established the software defined media (SDM) consortium to investigate object-based and internet-based audio- visual services. Despite the increasing demand and popularity of live concert events, the placement of the microphone and camera limit the free-viewpoint watching of the contents of package media, such as DVDs. In this study, we design and implement an interactive 3D audio-visual service system called LiVRation, with a free-view-listen point. For subjective evaluation, 211 people were made to experience LiVRation and answer a questionnaire, subsequently. In addition, we demonstrated the system in the ”Billboard Live Hackasong 2017” hosted by Billboard Japan and received the first prize, based on the votes of the judges as well as the audience.

動画

関連する研究・ソフトウェア

引用方法

T. Kasuya, M. Tsukada, Y. Komohara, S. Takasaka, T. Mizuno, Y. Nomura, Y. Ueda, and H. Esaki, “LiVRation: Remote VR live platform with interactive 3D audio-visual service,” in IEEE Games Entertainment & Media Conference (GEM 2019), Yale University, New Haven, CT, USA, 2019, doi: 10.1109/GEM.2019.8811549.

BibTeX

@inproceedings{Kasuya2019,
  title         = {LiVRation: Remote VR live platform with interactive 3D audio-visual service},
  author        = {Takashi Kasuya and Manabu Tsukada and Yu Komohara and Shigeki Takasaka and Takuhiro Mizuno and Yoshitaka Nomura and Yuta Ueda and Hiroshi Esaki},
  url           = {https://hal.archives-ouvertes.fr/hal-02136247/document?.pdf https://youtu.be/4MElM4_t2Io},
  doi           = {10.1109/GEM.2019.8811549},
  year          = {2019},
  date          = {2019-06-19},
  booktitle     = {IEEE Games Entertainment & Media Conference (GEM 2019)},
  pages         = {1--7},
  address       = {Yale University, New Haven, CT, USA},
  abstract      = {Of late, various audio-visual services based on the internet are being deployed extensively. Among these, object- based audio-visual services are attracting more attention. In 2014, we had established the software defined media (SDM) consortium to investigate object-based and internet-based audio- visual services. Despite the increasing demand and popularity of live concert events, the placement of the microphone and camera limit the free-viewpoint watching of the contents of package media, such as DVDs. In this study, we design and implement an interactive 3D audio-visual service system called LiVRation, with a free-view-listen point. For subjective evaluation, 211 people were made to experience LiVRation and answer a questionnaire, subsequently. In addition, we demonstrated the system in the ”Billboard Live Hackasong 2017” hosted by Billboard Japan and received the first prize, based on the votes of the judges as well as the audience.},
  keywords      = {SDM},
  pubstate      = {published},
  tppubtype     = {inproceedings}
}