XRKaigi2021 Award - Application Category Excellence Award

XRKaigi2021

Atsuto Inoue, Yasuhiro Oikawa, Wataru Teraoka (Waseda University Oikawa Lab / INSPIREI, Inc.)

Sound visualization system 'OTOMIRU' received the Excellence Award in the Application Category at XRKaigi2021.

Visualization measurement of time variation of sound intensity distribution using mixed reality technology

Architectural Acoustics Conference in Japan

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa (Waseda University/INSPIREI), Yusuke Ikeda (Tokyo Denki University/INSPIREI), Yuta Kataoka (Waseda University)

Presented the three-dimensional sound intensity visualization system under development.

3D exploration system for sound sources in space and from object surfaces

JP2024-032687A

Masahito Kobayashi, Yasuyuki Iwane, Takahiro Sato, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka, Tsubasa Kusano, Masahiko Goto, Mingyu Pan

Patent application for a system that uses microphone arrays and MVDR beamforming to three-dimensionally measure and visualize sound source positions and sound propagation in 3D space. Applicants: Waseda University, Tobishima Corporation.

Data visualization system in space

Japanese Patent No. 7506381 (JP2022-174479A)

Masahito Kobayashi, Yasuyuki Iwane, Takahiro Sato, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Patent for a system that combines MR devices and microphone arrays to measure and visualize sound pressure level distribution data in real-time in 3D space using beamforming. Applicants: Waseda University, Tobishima Corporation.

Sound Field Projection System using Optical See-Through Head-Mounted Display

inter-noise2021

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa (Waseda University / INSPIREI, Inc.), Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi (TOBISHIMA CORPORATION)

Presented the sound visualization system 'OTOMIRU' jointly developed with Tobishima Corporation at inter-noise2021.

The 20th Itakura Memorial Award for Creative Research

Acoustical Society of Japan

Atsuto Inoue

Received the Itakura Memorial Award for creative research in the field of acoustics.

About Sound Field Measurement & Visualization AR/MR System 'OTOMIRU'

OTOMIRU ver.1 Article

Atsuto Inoue

Article about OTOMIRU

I-INCE YOUNG PROFESSIONAL CONGRESS ATTENDANCE GRANTS (YP GRANTS)

International Institute of Noise Control Engineering (I-INCE)

Atsuto Inoue

Selected for YP GRANTS from young presenters at the International Noise Control Engineering Congress inter-noise2021.

OTOMIRU Ver.1

World's first real-time sound field visualization system using MixedReality (HoloLens2)

Jointly developed with Tobishima Corporation, the sound visualization system 'OTOMIRU' projects sound measurement results in real-time onto real space.

Visualization of Impulse Responses Using XR Technology

189th Meeting of the Acoustical Society of America (joint with ASJ), Program No. 1aAA1

Shizuki Mizuno, Wataru Teraoka, Atsuto Inoue, Yasuhiro Oikawa

Presented visualization of impulse responses using XR technology.

Evaluation of the musical field visualization using XR technology by extracting visualized images

189th Meeting of the Acoustical Society of America (joint with ASJ), Program No. 3pEA6

Wataru Teraoka, Atsuto Inoue, Yasuhiro Oikawa, Takahiro Satou, Masahito Kobayashi

Presented evaluation of the musical field visualization using XR technology by extracting visualized images.

Real-time 3-D sound field visualization systems using XR technologies

189th Meeting of the Acoustical Society of America (joint with ASJ), Program No. 4pED10

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Satou, Masahito Kobayashi

Presented real-time 3-D sound field visualization systems using XR technologies.

Interactive sound field visualization with mixed reality based on geometric acoustics simulation

189th Meeting of the Acoustical Society of America (joint with ASJ), Program No. 2aSP34

Shoya Onuma, Ayame Uchida, Yusuke Ikeda, Atsuto Inoue, Yasuhiro Oikawa

Presented interactive sound field visualization with mixed reality based on geometric acoustics simulation.

Musical field visualization using XR technology

Journal of the Acoustical Society of America

Wataru Teraoka, Atsuto Inoue, Yasuhiro Oikawa, Takahiro Sato, Masahito Kobayashi

XR技術を用いた音楽音場の可視化に関する研究をJASAに発表しました。

Overview and application examples of 3D sound pressure distribution visualization using XR technology

INCE/J 2024 Autumn Meeting, Paper No. 2-3-08

Takahiro Sato, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Presented the overview and application examples of 3D sound pressure distribution visualization using XR technology.

Study on 3D sound pressure distribution visualization using XR technology - Part 1 Improvement of visualization for enhanced localization accuracy

ASJ 2024 Autumn Meeting, Paper No. 3-8-2, pp.795-796

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Sato, Masahito Kobayashi

Improved visualization for enhanced localization accuracy in 3D sound pressure distribution visualization using XR technology.

Study on 3D sound pressure distribution visualization using XR technology - Part 2 Accuracy verification of improved visualization

ASJ 2024 Autumn Meeting, Paper No. 3-8-3, pp.797-798

Takahiro Sato, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Verified the accuracy of the improved visualization.

Interactive MR visualization system of 3D sound field with physical model of sound propagation

SPIE Other Conferences

Ayame Uchida, I. Tsunokuni, Yusuke Ikeda, Atsuto Inoue, Yasuhiro Oikawa

Developed an interactive MR visualization system for 3D sound fields using a physical model of sound propagation.

Gas main maintenance device.

Coming soon

Sound field visualization system by MVDR beamforming with augmented reality and point clouds

INTER-NOISE and NOISE-CON Congress

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Sato, Y. Iwane, Masahito Kobayashi

LiDARセンサーで取得した点群データとMVDRビームフォーミングを用いた音場計測・AR/MR可視化システムを発表しました。

Current status of augmented reality and mixed reality technologies and their application to sound field measurement and visualization

Journal of the Acoustical Society of Japan, Vol.79, No.10, pp.510–516

Atsuto Inoue, Yusuke Ikeda, Yasuhiro Oikawa

Review article in Journal of the Acoustical Society of Japan

Report on methods for visualizing sound pressure level distribution using mixed and augmented reality technologies - System overview and application examples

ASJ Acoustic Imaging Research Group, AI2023-10-01

Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka, Masahiko Goto, Mingyu Pan

Reported on the overview and application examples of the sound pressure level distribution visualization system using mixed and augmented reality technologies.

Study of methods for visualizing sound pressure level distribution using mixed reality and augmented reality technologies: Visualization experiments for construction sites and building spaces

Acoustical Science and Technology, Vol.44, No.5, pp.411–414

Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Study of methods for visualizing sound pressure level distribution using mixed reality and augmented reality technologies. Visualization experiments for construction sites and building spaces.

Study on sound pressure distribution visualization using optical see-through HMD - Part 6 Implementation and accuracy verification of 3D sound field visualization system using MVDR beamformer

ASJ 2023 Autumn Meeting, Paper No. 1-Q-15

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Masahiko Goto, Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi

Implemented and verified the accuracy of a 3D sound field visualization system using MVDR beamformer.

Study on sound pressure distribution visualization using optical see-through HMD - Part 7 Examination of the usefulness of 3D sound field visualization system

ASJ 2023 Autumn Meeting, Paper No. 1-Q-16

Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka, Masahiko Goto

Examined the usefulness of the 3D sound field visualization system.

Study on sound pressure distribution visualization using optical see-through HMD - Part 8 Examination of omnidirectional sound field visualization system using 3D array

ASJ 2023 Autumn Meeting, Paper No. 1-Q-17

Mingyu Pan, Masahiko Goto, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka, Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi

Examined an omnidirectional sound field visualization system using a 3D array.

Utilizing LiDAR Data for 3D Sound Source Localization

SIGGRAPH Posters

Masahiko Goto, Yasuhiro Oikawa, et al., Masahito Kobayashi

LiDAR技術を用いた3次元音源定位システムを紹介しました。

Examination of 3D data utilization using LiDAR for 3D sound source localization

ASJ 2023 Spring Meeting, Paper No. 3-6-3

Masahiko Goto, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Examined the utilization of 3D data using LiDAR for 3D sound source localization.

Study on sound pressure distribution visualization using optical see-through HMD - Part 3 System improvement for practical use and application to sound field visualization using AR devices

ASJ 2022 Autumn Meeting, pp.965-966

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi

Presented system improvements for practical use and application to sound field visualization using AR devices.

Study on sound pressure distribution visualization using optical see-through HMD - Part 4 Examination of system utilization methods through actual measurements

ASJ 2022 Autumn Meeting, pp.967-968

Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Examined system utilization methods through actual measurements.

Study on sound pressure distribution visualization using optical see-through HMD - Part 5 Examination of 3D sound source localization using MVDR

ASJ 2022 Autumn Meeting, pp.969-970

Masahiko Goto, Tsubasa Kusano, Mingyu Pan, Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi

Examined 3D sound source localization using MVDR.

Study on sound pressure distribution visualization using optical see-through HMD - Part 1 System configuration and data processing overview

ASJ 2021 Autumn Meeting, pp.621-622

Atsuto Inoue, Wataru Teraoka, Yasuhiro Oikawa, Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi

Presented the system configuration and data processing overview of the sound pressure distribution visualization system using optical see-through HMD.

Study on sound pressure distribution visualization using optical see-through HMD - Part 2 Examination of system effectiveness in laboratory and outdoor environments

ASJ 2021 Autumn Meeting, pp.623-624

Takahiro Sato, Yasuyuki Iwane, Masahito Kobayashi, Yasuhiro Oikawa, Atsuto Inoue, Wataru Teraoka

Examined the effectiveness of the optical see-through HMD sound pressure distribution visualization system in laboratory and outdoor environments.

Visualization of time variation of sound intensity distribution using mixed reality technology

Acoustical Society of Japan Meeting

Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Visualization of impulse responses using mixed reality technology and handheld microphone measurement

IPSJ National Convention pp.4-255-4-256

Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Visualization System of Measured and Simulated Sound Intensities with Mixed Reality

IEEE Global Conference on Consumer Electronics (GCCE)

Yukiko Okawa, Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Visualization of sound intensity using mixed reality technology and FTDT simulation

ASJ Meeting pp.353-354

Yukiko Okawa, Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Performed FDTD simulation using room shape obtained by SLAM and overlaid sound intensity on room space.

Visualization of sound wave fronts using mixed reality technology and moving microphone measurement

ASJ Meeting pp.539-540

Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Introduced measurement examples of spatial impulse response measurement and visualization system using handheld 4-point microphone and HoloLens.

Mixed Reality Visualization of Instantaneous Sound Intensity with Moving 4-ch Microphone Array

SIGGRAPH Posters pp.57

Yuta Kataoka, Yasuhiro Oikawa, Yasuaki Watanabe, Yusuke Ikeda

Visualized time variation of sound field through visualization of instantaneous sound intensity.

Visualization of Spatial Impulse Responses using Mixed Reality and Moving Microphone

SIGGRAPH Posters pp.58

Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Developed spatial impulse response measurement and visualization system using handheld 4-point microphone and HoloLens.

Visualization of spatial impulse responses using mixed reality technology and moving microphone measurement

ASJ Acoustic Imaging Research Group AI-2019-37

Yasuaki Watanabe, Yuta Kataoka, Yusuke Ikeda, Yasuhiro Oikawa, Naotoshi Osaka

Extended the sound intensity measurement system and proposed dynamic impulse response measurement and visualization system.

3D sound intensity visualization sharing system using mixed reality technology

ASJ Acoustic Imaging Research Group AI-2019-20

Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Yasuaki Watanabe, Yusuke Ikeda

Implemented sharing of measurement results between measurer and multiple observers for 3D sound intensity measurement and visualization system.

Effect of handheld movement of microphone array on 3D sound intensity measurement

ASJ Meeting pp.395-396

Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Performed numerical simulation on the effect of handheld 4-point microphone movement on 3D sound intensity measurement for point sources.

Effect of measurement position error on dynamic impulse response using handheld microphone

ASJ Meeting pp.321-322

Yasuaki Watanabe, Yusuke Ikeda, Yuta Kataoka, Yasuhiro Oikawa, Naotoshi Osaka

Measured measurement position error of sound intensity measurement system and verified its effect on impulse response reconstruction accuracy.

Effect of handy microphone movement in Mixed Reality visualization system of sound intensity

International Congress on Acoustics (ICA) pp.4452-4459

Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Yusuke Ikeda

Investigated the effect of handheld 4-point microphone movement on 3D sound intensity measurement.

Sound Field Evaluation by using Closely Located Four-point Microphone Method and Mixed Reality Technology

International Congress on Acoustics (ICA) pp.4598-4604

Wataru Teraoka, Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Performed measurements using four-point method at multiple locations and displayed virtual sound source distribution at HoloLens wearer's position.

Three-dimensional sound source localization using microphone array and its display with mixed reality technology

Inter Noise pp.1776

Tsubasa Kusano, Yasuhide Matsumoto, Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Kenichi Yoshida, Yoshimi Kitazumi

Visualized and displayed sound source position estimation results by beamforming using HoloLens.

Application possibility of Mixed Reality technology to acoustic technology from system perspective

IPSJ Research Report 2019-MUS-123 no.3

Yusuke Ikeda, Yasuaki Watanabe, Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa

Discussed the possibility of applying mixed reality technology to the acoustic field.

Sound field visualization measurement using optical technology and Mixed Reality technology

IPSJ Research Report 2019-MUS-123 no.5

Yasuhiro Oikawa, Kenji Ishikawa, Kohei Yatabe, Risako Tanigawa, Yuta Kataoka, Wataru Teraoka, Hayashi Onuma, Yusuke Ikeda

Reported on latest examples of sound field visualization technology, including polarization high-speed interferometry and optical see-through display visualization.

Visualization system for sound field using see-through head-mounted display

Acoust. Sci. & Tech., Vol.40, No.1, pp.1-11

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

Developed 3D sound intensity measurement and visualization system using xR devices (HoloLens, OculusRift) and handheld 4-point microphone, and visualized car engine sounds and sound leakage. Published in Acoustical Science and Technology (international journal).

Real-time Measurement and Display System of 3D Sound Intensity Map using Optical See-Through Head Mounted Display

SIGGRAPH Asia Poster pp.71

Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Yusuke Ikeda

Conducted wide-range sound field visualization experiments using 3D sound intensity measurement and visualization system.

Visualization of wide-range 3D sound field using mixed reality technology

ASJ Acoustic Imaging Research Group AI-2018-25

Yusuke Ikeda, Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa

Introduced visualization examples of 3D sound intensity using mixed reality technology.

Simulation model experiment using Mixed Reality technology

ASJ Meeting pp.705-706

Sonoko Furusawa, Wataru Teraoka, Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Performed sound propagation simulation inside architectural model using HoloLens.

3D sound intensity measurement and display system using see-through Mixed Reality device

ASJ Meeting pp.587-588

Yuta Kataoka, Wataru Teraoka, Yasuhiro Oikawa, Yusuke Ikeda

Improved the sound intensity measurement system developed by Inoue et al., enabling real-time communication of handheld 4-point microphone information and acquisition by HoloLens.

Integration of measurement and display systems in Mixed Reality display method for virtual sound source distribution

ASJ Meeting pp.703-704

Wataru Teraoka, Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Made four-point proximity method measurement and display using HoloLens more rapid.

Display System for Distribution of Virtual Image Sources by using Mixed Reality Technology

Inter Noise in18_1647

Wataru Teraoka, Yuta Kataoka, Yasuhiro Oikawa, Yusuke Ikeda

Proposed various ways to display visualization results by four-point proximity method, including display on smartphones and animations.

3D sound intensity visualization system using optical see-through head mounted display

ASJ Acoustic Imaging Research Group AI2017-3-06

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

Compared and discussed 3D sound intensity visualization using video see-through head mounted display (OculusRift) and optical see-through head mounted display (HoloLens).

3D sound intensity visualization system using see-through AR device

ASJ Meeting pp.635-636

Atsuto Inoue, Kohei Yatabe, Yasuhiro Oikawa, Yusuke Ikeda

Enabled overlay display of 3D sound intensity on real space by visualizing 3D sound intensity measurement and visualization system using optical see-through display (HoloLens).

Proposal of Mixed Reality display method for four-point proximity method data

ASJ Meeting pp.1089-1090

Wataru Teraoka, Atsuto Inoue, Yasuhiro Oikawa, Yusuke Ikeda

Developed visualization system for virtual sound source distribution and directivity patterns using four-point proximity method with HoloLens.

Visualization of 3D Sound Field using See-Through Head Mounted Display

SIGGRAPH Posters pp.34

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

Developed prototype of 3D sound intensity measurement and visualization system using xR devices (HoloLens, OculusRift) and handheld 4-point microphone, and demonstrated at SIGGRAPH2017 (Los Angeles) poster session.

Three-dimensional sound-field visualization system using head mounted display and stereo camera

Joint Meeting of the Acoustical Society of America and Acoustical Society of Japan 140(4) pp.3195

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

First international conference presentation on 3D sound intensity measurement and visualization system.

3D sound field information presentation system using see-through head mounted display

ASJ Acoustic Imaging Research Group AI2016-3-03

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

Conducted visualization experiments around speakers using 3D sound intensity measurement and visualization system with OculusRift and handheld 4-point microphone.

3D sound field information presentation system using head mounted display

ASJ Meeting pp.1097-1098

Atsuto Inoue, Yusuke Ikeda, Kohei Yatabe, Yasuhiro Oikawa

Developed 3D sound intensity measurement and visualization system using OculusRift and handheld 4-point microphone.

Acoustical Society of Japan Student Presentation Award (14th, Fall 2016)

Acoustical Society of Japan

Atsuto Inoue

Received the Student Presentation Award at the Acoustical Society of Japan 2016 Autumn Meeting.