Awareness of space, and subsequent orientation and navigation in rooms, is dominated by the visual system. However, humans are able to extract auditory information about their surroundings from early reflections and reverberation in enclosed spaces. To better understand orientation and navigation based on acoustic cues only, three virtual corridor layouts (I-, U-, and Z-shaped) were presented using real-time virtual acoustics in a three-dimensional 86-channel loudspeaker array. Participants were seated on a rotating chair in the center of the loudspeaker array and navigated using real rotation and virtual locomotion by “teleporting” in steps on a grid in the invisible environment. A head mounted display showed control elements and the environment in a visual reference condition. Acoustical information about the environment originated from a virtual sound source at the collision point of a virtual ray with the boundaries. In different control modes, the ray was cast either in view or hand direction or in a rotating, “radar”-like fashion in 90° steps to all sides. Time to complete, number of collisions, and movement patterns were evaluated. Navigation and orientation were possible based on the direct sound with little effect of room acoustics and control mode. Underlying acoustic cues were analyzed using an auditory model.
References
1.
Ahrens
, A.
, Lund
, K. D.
, Marschall
, M.
, and Dau
, T.
(2019
). “Sound source localization with varying amount of visual information in virtual reality
,” PLoS One
14
, e0214603
.2.
Allen
, J. B.
, and Berkley
, D. A.
(1979
). “Image method for efficiently simulating small‐room acoustics
,” J. Acoust. Soc. Am.
65
, 943
–950
.3.
Anderson
, P. W.
, and Zahorik
, P.
(2014
). “Auditory/visual distance estimation: Accuracy and variability
,” Front. Psychol.
5
, 1097
.4.
Blau
, M.
, Budnik
, A.
, Fallahi
, M.
, Steffens
, H.
, Ewert
, S. D.
, and van de Par
, S.
(2021
). “Toward realistic binaural auralizations – perceptual comparison between measurement and simulation-based auralizations and the real room for a classroom scenario
,” Acta Acust.
5
, 8
.5.
Braga
, R. M.
, Fu
, R. Z.
, Seemungal
, B. M.
, Wise
, R. J. S.
, and Leech
, R.
(2016
). “Eye movements during auditory attention predict individual differences in dorsal attention network activity
,” Front. Hum. Neurosci.
10
, 164
.6.
Breebaart
, J.
, van de Par
, S.
, and Kohlrausch
, A.
(2001
). “Binaural processing model based on contralateral inhibition. I. Model structure
,” J. Acoust. Soc. Am.
110
, 1074
–1088
.7.
Brinkmann
, F.
, Aspöck
, L.
, Ackermann
, D.
, Lepa
, S.
, Vorländer
, M.
, and Weinzierl
, S.
(2019
). “A round robin on room acoustical simulation and auralization
,” J. Acoust. Soc. Am.
145
, 2746
–2760
.8.
Brinkmann
, F.
, Lindau
, A.
, Weinzierl
, S.
, van de Par
, S.
, Müller-Trapet
, M.
, Opdam
, R.
, and Vorländer
, M.
(2017
). “A high resolution and full-spherical head-related transfer function database for different head-above-torso orientations
,” J. Audio Eng. Soc.
65
(10
), 841
–848
.9.
Capelle
, C.
, Trullemans
, C.
, Arno
, P.
, and Veraart
, C.
(1998
). “A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution
,” IEEE Trans. Biomed. Eng.
45
, 1279
–1293
.10.
Carmigniani
, J.
, Furht
, B.
, Anisetti
, M.
, Ceravolo
, P.
, Damiani
, E.
, and Ivkovic
, M.
(2011
). “Augmented reality technologies, systems and applications
,” Multimed. Tools Appl.
51
, 341
–377
.11.
Connolly
, C.
(2007
). “Collision avoidance technology: From parking sensors to unmanned aircraft
,” Sensor Rev.
27
, 182
–188
.12.
Dietz
, M.
, Ewert
, S. D.
, and Hohmann
, V.
(2011
). “Auditory model based direction estimation of concurrent speakers from binaural signals
,” Speech Commun. Percept. Stat. Audition
53
, 592
–605
.13.
Dodsworth
, C.
, Norman
, L. J.
, and Thaler
, L.
(2020
). “Navigation and perception of spatial layout in virtual echo-acoustic space
,” Cognition
197
, 104185
.14.
Fichna
, S.
, Biberger
, T.
, Seeber
, B. U.
, and Ewert
, S. D.
(2021
). “Effect of acoustic scene complexity and visual scene representation on auditory perception in virtual audio-visual environments
,” in Proceedings of the 2021 Immersive and 3D Audio: From Architecture to Automotive (I3DA)
, September 8–10
, Bologna, Italy
, pp. 1
–9
.15.
Hendrikse
, M. M. E.
, Llorach
, G.
, Hohmann
, V.
, and Grimm
, G.
(2019
). “Movement and gaze behavior in virtual audiovisual listening environments resembling everyday life
,” Trends Hear.
23
, 233121651987236
.16.
Jot
, J.-M.
, and Chaigne
, A.
(1991
). “Digital delay networks for designing artificial reverberators
,” in Proceedings of the Audio Engineering Society Convention
, February 19–22, Paris, France.17.
Kirsch
, C.
, Poppitz
, J.
, Wendt
, T.
, van de Par
, S.
, and Ewert
, S. D.
(2021a
). “Computationally efficient spatial rendering of late reverberation in virtual acoustic environments
,” in Proceedings of the 2021 Immersive and 3D Audio: From Architecture to Automotive (I3DA)
, September 8–10
, Bologna, Italy
.18.
Kirsch
, C.
, Poppitz
, J.
, Wendt
, T.
, van de Par
, S.
, and Ewert
, S. D.
(2021b
). “Spatial resolution of late reverberation in virtual acoustic environments
,” Trends Hear.
25
, 233121652110549
.19.
Klockgether
, S.
, and van de Par
, S.
(2016
). “Just noticeable differences of spatial cues in echoic and anechoic acoustical environments
,” J. Acoust. Soc. Am.
140
, EL352
–EL357
.20.
Kolarik
, A. J.
, Moore
, B. C. J.
, Zahorik
, P.
, Cirstea
, S.
, and Pardhan
, S.
(2016
). “Auditory distance perception in humans: A review of cues, development, neuronal bases, and effects of sensory loss
,” Atten. Percept. Psychophys.
78
, 373
–395
.21.
Kolarik
, A. J.
, Scarfe
, A. C.
, Moore
, B. C. J.
, and Pardhan
, S.
(2017
). “Blindness enhances auditory obstacle circumvention: Assessing echolocation, sensory substitution, and visual-based navigation
,” PLoS One
12
, e0175750
.22.
Kuttruff
, H.
(1995
). “A simple iteration scheme for the computation of decay constants in enclosures with diffusely reflecting boundaries
,” J. Acoust. Soc. Am.
98
, 288
–293
.23.
Leclère
, T.
, Lavandier
, M.
, and Culling
, J. F.
(2015
). “Speech intelligibility prediction in reverberation: Towards an integrated model of speech transmission, spatial unmasking, and binaural de-reverberation
,” J. Acoust. Soc. Am.
137
, 3335
–3345
.24.
Levy-Tzedek
, S.
, Maidenbaum
, S.
, Amedi
, A.
, and Lackner
, J.
(2016
). “Aging and sensory substitution in a virtual navigation task
,” PLoS One
11
, e0151593
.25.
Lokki
, T.
, and Gröhn
, M.
(2005
). “Navigation with auditory cues in a virtual environment
,” IEEE Multimedia
12
, 80
–86
.26.
Loomis
, J. M.
, Golledge
, R. G.
, and Klatzky
, R. L.
(1998
). “Navigation system for the blind: Auditory display modes and guidance
,” Presence
7
, 193
–203
.27.
Lu
, Y.-C.
, and Cooke
, M.
(2011
). “Motion strategies for binaural localisation of speech sources in azimuth and distance by artificial listeners
,” Speech Commun. Percept. Stat. Audition
53
, 622
–642
.28.
Lück
, T.
, Nopper
, H.
, Schendel
, O.
, Weyhe
, D.
, Salzmann
, D.
, Uslar
, V.
, Reinschluessel
, A. V.
, Döring
, T.
, Muender
, T.
, Malaka
, R.
, Schenk
, A.
, and Schumann
, C.
(2020
). “Exploring realistic haptics for 3D-printed organ phantoms in surgery training in VR and AR
,” Trans. Addit. Manuf. Meets Med.
2
(1
), 026
.29.
Maidenbaum
, S.
, Abboud
, S.
, and Amedi
, A.
(2014
). “Sensory substitution: Closing the gap between basic research and widespread practical visual rehabilitation
,” Neurosci. Biobehav. Rev.
41
, 3
–15
.30.
Massiceti
, D.
, Hicks
, S. L.
, and Rheede
, J. J. V.
(2018
). “Stereosonic vision: Exploring visual-to-auditory sensory substitution mappings in an immersive virtual reality navigation paradigm
,” PLoS One
13
, e0199389
.31.
Meijer
, P. B. L.
(1992
). “An experimental system for auditory image representations
,” IEEE Trans. Biomed. Eng.
39
, 112
–121
.32.
Middlebrooks
, J. C.
, and Green
, D. M.
(1991
). “Sound Localization by Human Listeners
,” Ann. Rev. Psychol.
42
, 135
–159
.33.
Mizumachi
, M.
, Kaminuma
, A.
, Ono
, N.
, and Ando
, S.
(2014
). “Robust sensing of approaching vehicles relying on acoustic cues
,” Sensors
14
, 9546
–9561
.34.
Nilsson
, M. E.
, and Schenkman
, B. N.
(2016
). “Blind people are more sensitive than sighted people to binaural sound-location cues, particularly inter-aural level differences
,” Hear. Res.
332
, 223
–232
.35.
Paliwal
, K.
, and Wojcicki
, K.
(2008
). “Effect of analysis window duration on speech intelligibility
,” IEEE Signal Process. Lett.
15
, 785
–788
.36.
Pulkki
, V.
(1997
). “Virtual sound source positioning using vector base amplitude panning
,” JAES
45
, 456
–466
.37.
Pulkki
, V.
, McCormack
, L.
, and Gonzalez
, R.
(2021
). “Superhuman spatial hearing technology for ultrasonic frequencies
,” Sci. Rep.
11
, 11608
.38.
Søndergaard
, P.
, and Majdak
, P.
(2013
). “The auditory modeling toolbox
,” in The Technology of Binaural Listening
, edited by J.
Blauert
(Springer
, Berlin-Heidelberg
), pp. 33
–56
.39.
Tan
, A. K.
, and Lerner
, N. D.
(1996
). “Acoustic localization of in-vehicle crash avoidance warnings as a cue to hazard direction
,” Report No. 808 534, USDOT
, Washington, DC
.40.
Thaler
, L.
, Zhang
, X.
, Antoniou
, M.
, Kish
, D. C.
, and Cowie
, D.
(2020
). “The flexible action system: Click-based echolocation may replace certain visual functionality for adaptive walking
,” J. Exp. Psychol. Hum. Percept. Perform.
46
, 21
–35
.41.
Valente
, D. L.
, and Braasch
, J.
(2010
). “Subjective scaling of spatial room acoustic parameters influenced by visual environmental cues
,” J. Acoust. Soc. Am.
128
, 1952
–1964
.42.
Wallach
, H.
(1940
). “The role of head movements and vestibular and visual cues in sound localization
,” J. Exp. Psychol.
27
(4
), 339
–336
.43.
Wallach
, H.
, Newman
, E. B.
, and Rosenzweig
, M. R.
(1949
). “The precedence effect in sound localization
,” Am. J. Psychol.
62
, 315
–336
.44.
Wallmeier
, L.
, Geßele
, N.
, and Wiegrebe
, L.
(2013
). “Echolocation versus echo suppression in humans
,” Proc. R Soc. B
280
, 20131428
.45.
Welsh
, R. L.
, and Blasch
, B. B.
(1980
). Foundations of Orientation and Mobility
(American Foundation for the Blind
, New York
).46.
Wendt
, T.
, van de Par
, S.
, and Ewert
, S. D.
(2014
). “A computationally-efficient and perceptually-plausible algorithm for binaural room impulse response simulation
,” J. Audio Eng. Soc.
62
, 748
–766
.47.
Wightman
, F. L.
, and Kistler
, D. J.
(1992
). “The dominant role of low‐frequency interaural time differences in sound localization
,” J. Acoust. Soc. Am.
91
, 1648
–1661
.48.
Wightman
, F. L.
, and Kistler
, D. J.
(1997
). “Monaural sound localization revisited
,” J. Acoust. Soc. Am.
101
, 1050
–1063
.49.
Zahorik
, P.
(2002
). “Assessing auditory distance perception using virtual acoustics
,” J. Acoust. Soc. Am.
111
, 1832
–1846
.50.
Zahorik
, P.
, Brungart
, D. S.
, and Bronkhorst
, A. W.
(2005
). “Auditory distance perception in humans: A summary of past and present research
,” Acta Acust. united Ac.
91
, 409
–420
.© 2022 Acoustical Society of America.
2022
Acoustical Society of America
You do not currently have access to this content.