User interaction with the virtual acoustic environment (VAE) has become of increasing interest in research. However, so far little attention has been paid to interaction by means of self-generated sound, like, for example, the own voice, even though this would open up new possibilities for natural interaction. Moreover, there is evidence that adequate reproduction of self-generated sound might enhance presence. This paper presents a system that allows such interaction with the VAE. For this, the so-called reactive VAE captures the self-generated sound, feeds it back into the virtual room, and provides the acoustic response to the actions of the user in real time. The specific features are that the system considers the dynamic directivity of the sound source and that it generally works with any source. The paper describes the implementation of the system, a technical evaluation that confirms basic functionality, and two implementation examples. Moreover, the study discusses technical general conditions of the system architecture. The potential applications of the reactive VAE are diverse, including use as a virtual practice room for musicians or as a research tool. In future work, the system will provide a basis for experiments investigating the influence of self-generated sound on human perceptual processes.
Skip Nav Destination
Article navigation
25 June 2017
173rd Meeting of Acoustical Society of America and 8th Forum Acusticum
25–29 June 2017
Boston, Massachusetts
Architectural Acoustics: Paper 4aAAd2
September 21 2017
Binaural reproduction of self-generated sound in virtual acoustic environments
Johannes M. Arend;
Johannes M. Arend
1
Institute of Communications Engineering, TH Köln, Köln
, NRW, 50679, GERMANY
; Christoph.Poerschmann@th-koeln.de2TU Berlin,
Audio Communication Group
, Berlin, GERMANY
; Johannes.Arend@th-koeln.de; Philipp.Stade@th-koeln.de
Search for other works by this author on:
Philipp Stade;
Philipp Stade
1
Institute of Communications Engineering, TH Köln, Köln
, NRW, 50679, GERMANY
; Christoph.Poerschmann@th-koeln.de2TU Berlin,
Audio Communication Group
, Berlin, GERMANY
; Johannes.Arend@th-koeln.de; Philipp.Stade@th-koeln.de
Search for other works by this author on:
Christoph Pörschmann
Christoph Pörschmann
1
Institute of Communications Engineering, TH Köln, Köln
, NRW, 50679, GERMANY
; Christoph.Poerschmann@th-koeln.de
Search for other works by this author on:
Proc. Mtgs. Acoust. 30, 015007 (2017)
Article history
Received:
July 19 2017
Accepted:
August 31 2017
Citation
Johannes M. Arend, Philipp Stade, Christoph Pörschmann; Binaural reproduction of self-generated sound in virtual acoustic environments. Proc. Mtgs. Acoust. 25 June 2017; 30 (1): 015007. https://doi.org/10.1121/2.0000574
Download citation file: