In a remote microphone (RM) system, a talker speaks into a microphone and the signal is transmitted to the hearing aids worn by the hearing-impaired listener. A difficulty with remote microphones, however, is that the signal received at the hearing aid bypasses the head and pinna, so the acoustic cues needed to externalize the sound source are missing. The objective of this paper is to process the RM signal to improve externalization when listening through earphones. The processing is based on a structural binaural model, which uses a cascade of processing modules to simulate the interaural level difference, interaural time difference, pinna reflections, ear-canal resonance, and early room reflections. The externalization results for the structural binaural model are compared to a left-right signal blend, the listener's own anechoic head-related impulse response (HRIR), and the listener's own HRIR with room reverberation. The azimuth is varied from straight ahead to 90° to one side. The results show that the structural binaural model is as effective as the listener's own HRIR plus reverberation in producing an externalized acoustic image, and that there is no significant difference in externalization between hearing-impaired and normal-hearing listeners.

1.
Algazi
,
V. R.
,
Avendano
,
C.
, and
Duda
,
R. O.
(
2001a
). “
Estimation of a spherical-head model from anthropometry
,”
J. Audio Eng. Soc.
49
,
472
479
.
2.
Algazi
,
V. R.
,
Duda
,
R. O.
,
Thompson
,
D. M.
, and
Avendano
,
C.
(
2001b
). “
The CIPIC database
,” in
Proceedings of the Workshop on Applications of Signal Processing to Audio and Electroacoustics
, New Paltz, NY (October 21–24, 2001), pp.
W2001-1
W2001-4
.
3.
Allen
,
J. B.
, and
Berkley
,
D. A.
(
1979
). “
Image method for efficiently simulating small-room acoustics
,”
J. Acoust. Soc. Am.
65
,
943
950
.
4.
Batteau
,
D. W.
(
1967
). “
The role of the pinna in human localization
,”
Proc. R. Soc. London B
168
,
158
180
.
5.
Begault
,
D. R.
(
1992
). “
Perceptual effects of synthetic reverberation on three-dimensional audio systems
,”
J. Audio Eng. Soc.
40
,
895
903
.
6.
Begault
,
D. R.
,
Wenzel
,
E. M.
, and
Anderson
,
M. R.
(
2001
). “
Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source
,”
J. Audio Eng. Soc.
49
,
904
916
.
7.
Blauert
,
J.
(
1969
). “
Sound localization in the median plane
,”
Acustica
22
,
205
213
.
8.
Boothroyd
,
A.
(
2004
). “
Hearing aid accessories for adults: The remote FM microphone
,”
Ear Hear.
25
,
22
33
.
9.
Boyd
,
A. W.
,
Whitmer
,
W. M.
,
Soraghan
,
J. J.
, and
Akeroyd
,
M. A.
(
2012
). “
Auditory externalization in hearing-impaired listeners: The effect of pinna cues and number of talkers
,”
J. Acoust. Soc. Am
131
,
EL268
EL274
.
10.
Bradley
,
J. S.
(
1986
). “
Speech intelligibility studies in classrooms
,”
J. Acoust. Soc. Am.
80
,
846
854
.
11.
Bradley
,
J. S.
,
Sato
,
H.
, and
Picard
,
M.
(
2003
). “
On the importance of early reflections for speech in rooms
,”
J. Acoust. Soc. Am.
113
,
3233
3244
.
12.
Brimijoin
,
W. O.
,
Boyd
,
A. W.
, and
Akeroyd
,
M. A.
(
2013
). “
The contribution of head movement to the externalization and internalization of sounds
,”
PLoS One
8
,
e83068
.
13.
Bronkhorst
,
A. W.
(
2000
). “
The cocktail party phenomenon: A review of research on speech intelligibility in multiple-talker conditions
,”
Acoustica
86
,
117
128
.
14.
Bronkhorst
,
A. W.
, and
Houtgast
,
T.
(
1999
). “
Auditory distance perception in rooms
,”
Nature
397
,
517
520
.
15.
Bronkhorst
,
A. W.
, and
Plomp
,
R.
(
1989
). “
Binaural speech intelligibility in noise for hearing-impaired listeners
,”
J. Acoust. Soc. Am.
86
,
1374
1383
.
16.
Brown
,
C. P.
(
1996
). “
Modeling the elevation characteristics of the head-related transfer function
,” M.Sci. thesis, San Jose State University, San Jose, CA.
17.
Brown
,
C. P.
, and
Duda
,
R. O.
(
1998
). “
A structural model for binaural sound synthesis
,”
IEEE Trans. Speech Audio Proc.
6
,
476
488
.
18.
Burkhard
,
M. D.
, and
Sacks
,
R. M.
(
1975
). “
Anthropometric manikin for acoustic research
,”
J. Acoust. Soc. Am.
58
,
214
222
.
19.
Byrne
,
D.
, and
Dillon
,
H.
(
1986
). “
The National Acoustic Laboratories' (NAL) new procedure for selecting gain and frequency response of a hearing aid
,”
Ear Hear.
7
,
257
265
.
20.
Carlile
,
S.
, and
Blackman
,
T.
(
2014
). “
Relearning auditory spectral cues for locations inside and outside the visual field
,”
J. Assoc. Res. Otolaryngol.
15
,
249
263
.
21.
Catic
,
J.
,
Santurette
,
S.
, and
Dau
,
T.
(
2015
). “
The role of reverberation-related binaural cues in the externalization of speech
,”
J. Acoust. Soc. Am.
138
,
1154
1167
.
22.
Courtois
,
G. A.
(
2016
). “
Spatial hearing rendering in wireless microphone systems for binaural hearing aids
,” Ph.D. thesis, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
23.
Crawford-Emery
,
R.
, and
Lee
,
H.
(
2014
). “
The subjective effect of BRIR length perceived headphone sound externalisation and tonal colouration
,” in
Proceedings of the 136th Audio Engineering Society Convention
, Berlin (April 24–26, 2014).
24.
Farmani
,
M.
,
Pedersen
,
M. S.
,
Tan
,
Z-H.
, and
Jensen
,
J.
(
2017
). “
Informed sound source localization using relative transfer functions for hearing aid applications
,”
IEEE/ACM Trans. Audio Speech Sign. Proc.
25
,
611
623
.
25.
Gupta
,
N.
,
Barreto
,
A.
, and
Ordonez
,
C.
(
2002
). “
Improving sound spatialization by modifying head-related transfer functions to emulate protruding pinnae
,” in
Proceedings of IEEE SoutheastCon
, Columbia, SC (April 5–7, 2002), pp.
446
450
.
26.
Hartley
,
R. V. L.
, and
Fry
,
T. C.
(
1921
). “
The binaural location of pure tones
,”
Phys. Rev.
18
,
431
442
.
27.
Hartmann
,
W. M.
, and
Wittenberg
,
A.
(
1996
). “
On the externalization of sound images
,”
J. Acoust. Soc. Am.
99
,
3678
3688
.
28.
Hebrank
,
J.
, and
Wright
,
D.
(
1974
). “
Spectral cues used in the localization of sound sources in the median plane
,”
J. Acoust. Soc. Am.
56
,
1829
1834
.
29.
Hofman
,
P. M.
,
Van Riswick
,
J. G.
, and
Van Opstal
,
A. J.
(
1998
). “
Relearning sound localization with new ears
,”
Nat. Neurosci.
1
,
417
421
.
30.
Honda
,
A.
,
Shibata
,
H.
,
Hidaka
,
S.
,
Gyoba
,
J.
,
Iwaya
,
Y.
, and
Suzuki
,
Y.
(
2013
). “
Effects of head movement and proprioceptive feedback in training of sound localization
,”
i-Perception
4
,
253
264
.
31.
Kates
,
J. M.
(
1988
). “
A computer simulation of hearing aid response and the effects of ear canal size
,”
J. Acoust. Soc. Am.
83
,
1952
1963
.
32.
Kim
,
S-M.
, and
Choi
,
W.
(
2005
). “
On the externalization of virtual sound images in headphone reproduction: A Wiener filter approach
,”
J. Acoust. Soc. Am.
117
,
3657
3665
.
33.
Kim
,
Y. G.
,
Chun
,
C. J.
,
Kim
,
H. K.
,
Lee
,
Y. J.
,
Jang
,
D. Y.
, and
Kang
,
K.
(
2010
). “
An integrated approach of 3D sound rendering techniques for sound externalization
,” in
Advances in Multimedia Information Processing—PCM 2010
, edited by
G.
Qiu
,
K. M.
Lam
,
H.
Kiya
,
X.-Y.
Xue
,
C.-C. J.
Kuo
, and
M. S.
Lew
, pp.
682
693
.
34.
Klein
,
F.
, and
Werner
,
S.
(
2016
). “
Auditory adaptation to non-individual HRTF cues in binaural audio reproduction
,”
J. Audio Eng. Soc.
64
,
45
54
.
35.
Kolarik
,
A. J.
,
Moore
,
B. C. J.
,
Zahorik
,
P.
,
Cirstea
,
S.
, and
Pardhan
,
S.
(
2016
). “
Auditory distance perception in humans: A review of cues, development, neuronal bases, and effects of sensory loss
,”
Atten. Percept. Psychophys.
78
,
373
395
.
36.
Kuhn
,
G. F.
(
1977
). “
Model for the interaural time differences in the azimuthal plane
,”
J. Acoust. Soc. Am.
62
,
157
167
.
37.
Mendonça
,
C.
(
2014
). “
A review on auditory space adaptations to altered head-related cues
,”
Front. Neurosci.
8
,
219
.
38.
Mershon
,
D. H.
,
Ballenger
,
W. L.
,
Little
,
A. D.
,
McMurty
,
P. L.
, and
Buchanan
,
J. L.
(
1989
). “
Effects of room reflectance and background noise on perceived auditory distance
,”
Perception
18
,
403
416
.
39.
Middlebrooks
,
J. C.
(
1999
). “
Individual differences in external-ear transfer functions reduced by scaling in frequency
,”
J. Acoust. Soc. Am.
106
,
1480
1492
.
40.
Middlebrooks
,
J. C.
, and
Green
,
D. M.
(
1991
). “
Sound localization by human listeners
,”
Annu. Rev. Psych.
42
,
135
159
.
41.
Middlebrooks
,
J. C.
,
Macpherson
,
E. A.
, and
Onsan
,
Z. A.
(
2000
). “
Psychophysical customization of directional transfer functions for virtual sound localization
,”
J. Acoust. Soc. Am.
108
,
3088
3091
.
42.
Møller
,
H.
,
Sørensen
,
M. F.
,
Hammershøi
,
D.
, and
Jensen
,
C. B.
(
1995
). “
Head-related transfer functions of human subjects
,”
J. Audio Eng. Soc.
43
,
300
321
.
43.
Nábělek
,
A. K.
, and
Robinette
,
L.
(
1978
). “
Influence of the precedence effect on word identification by normally hearing and hearing-impaired subjects
,”
J. Acoust. Soc. Am.
63
,
187
194
.
44.
Nasreddine
,
Z. S.
,
Philips
,
N. A.
,
Bédirian
,
V.
,
Charbonneau
,
S.
,
Whitehead
,
V.
,
Collin
,
I.
,
Cummings
,
J. L.
, and
Chertkow
,
H.
(
2005
). “
The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment
,”
J. Am. Geriatr. Soc.
53
,
695
699
.
45.
Nilsson
,
M.
,
Soli
,
S.
, and
Sullivan
,
J.
(
1994
). “
Development of the hearing in noise test for the measurement of speech reception thresholds in quiet and in noise
,”
J. Acoust. Soc. Am.
95
,
1085
1099
.
46.
Odelius
,
J.
, and
Johansson
,
O.
(
2010
). “
Self-assessment of classroom assistive listening devices
,”
Int. J. Audiol.
49
,
508
517
.
47.
Ohl
,
B.
,
Laugesen
,
S.
,
Buchholz
,
J.
, and
Dau
,
T.
(
2010
). “
Externalization versus internalization of sound in normal-hearing and hearing-impaired listeners
,” in
Proceeding of the Deutsche Arbeitsgemeinschaft für Akustik 2010
, p
136
.
48.
Parseihian
,
G.
, and
Katz
,
B. F. G.
(
2012
). “
Rapid head-related transfer function adaptation using a virtual auditory environment
,”
J. Acoust. Soc. Am.
131
,
2948
2957
.
49.
Satarzadeh
,
P.
,
Algazi
,
R. V.
, and
Duda
,
R. O.
(
2007
). “
Physical and filter pinna models based on anthropometry
,” in
Proceedings of the 122nd Convention of the Audio Engineering Society
, Vienna, Austria, May 5–8, 2007.
50.
Shaw
,
E. A. G.
(
1997
). “
Acoustical features of the human external ear
,” in
Binaural and Spatial Hearing in Real and Virtual Environments
, edited by
R. H.
Gilkey
and
T. R.
Anderson
(
Lawrence Erlbaum
,
Mahwah, NJ
), pp.
25
47
.
51.
Shaw
,
E. A. G.
, and
Teranishi
,
R.
(
1968
). “
Sound pressure generated in an external-ear replica and real human ears by a nearby point source
,”
J. Acoust. Soc. Am.
44
,
240
249
.
52.
Shinn-Cunningham
,
B. G.
(
2000
). “
Distance cues for virtual auditory space
,” in
Proceedings of IEEE PCM2000, Sydney
, Australia, pp.
227
230
.
53.
Shinn-Cunningham
,
B. G.
,
Santarelli
,
S.
, and
Kopko
,
N.
(
2000
). “
Tori of confusion: Binaural localization cues for sources within reach of a listener
,”
J. Acoust. Soc. Am.
107
,
1627
1636
.
54.
So
,
R. H. Y.
,
Leung
,
N. M.
,
Horner
,
A. B.
,
Braasch
,
J.
, and
Leung
,
K. L.
(
2011
). “
Effects of spectral manipulation on nonindividualized head-related transfer functions (HRTFs)
,”
Human Fact.
53
,
271
283
.
55.
Spagnol
,
S.
,
Geronazzo
,
M.
, and
Avanzini
,
F.
(
2013
). “
On the relation between pinna reflection patterns and head-related transfer function features
,”
IEEE Trans. Audio Speech Lang. Proc.
21
,
508
519
.
56.
Tan
,
C.-J.
, and
Gan
,
W.-S.
(
1998
). “
User-defined spectral manipulation of HRTF for improved localization in 3D sound systems
,”
Electron. Lett.
34
,
2387
2389
.
57.
Udesen
,
J.
,
Piechowiak
,
T.
, and
Gran
,
F.
(
2015
). “
The effect of vision on psychoacoustic testing with headphone-based virtual sound
,”
J. Audio Eng. Soc.
63
,
552
561
.
58.
Völk
,
F.
(
2009
). “
Externalization in data-based binaural synthesis: Effects of impulse response length
,” in
Proceedings of NAG/DAGA 2009
, Rotterdam, pp.
1075
1078
.
59.
Völk
,
F.
,
Heinemann
,
F.
, and
Fastl
,
H.
(
2008
). “
Externalization in binaural synthesis: Effects of recording environment and measurement procedure
,” in
Proceedings of Acoustics 2008
, Paris, pp.
6419
6424
.
60.
Wenzel
,
E. M.
,
Arruda
,
M.
,
Kistler
,
D. J.
, and
Wightman
,
F. L.
(
1993
). “
Localization using nonindividualized head-related transfer functions
,”
J. Acoust. Soc. Am.
94
,
111
123
.
61.
Wiener
,
F. M.
(
1947
). “
On the diffraction of a progressive sound wave by the human head
,”
J. Acoust. Soc. Am.
19
,
143
146
.
62.
Wightman
,
F. L.
, and
Kistler
,
D. J.
(
1989
). “
Headphone simulation of free-field listening. I: Stimulus synthesis
,”
J. Acoust. Soc. Am.
85
,
858
867
.
63.
Wightman
,
F. L.
, and
Kistler
,
D. J.
(
1999
). “
Resolution of front-back ambiguity in spatial hearing by listener and source movement
,”
J. Acoust. Soc. Am.
105
,
2841
2853
.
64.
Wolfe
,
J.
,
Duke
,
M. M.
,
Schafer
,
E.
,
Jones
,
C.
,
Mülder
,
H. E.
,
John
,
A.
, and
Hudson
,
M.
(
2015
). “
Evaluation of performance with an adaptive digital remote microphone system and a digital remote microphone audio-streaming accessory system
,”
Am. J. Audiol.
24
,
440
450
.
65.
Yang
,
W.
, and
Hodgson
,
M.
(
2006
). “
Auralization study of optimum reverberation times for speech intelligibility for normal and hearing-impaired listeners in classrooms with diffuse sound fields
,”
J. Acoust. Soc. Am.
120
,
801
807
.
66.
Zahorik
,
P.
(
2001
). “
Estimating sound source distance with and without vision
,”
Optom. Vis. Sci.
78
,
270
275
.
67.
Zahorik
,
P.
(
2002
). “
Assessing auditory distance perception using virtual acoustics
,”
J. Acoust. Soc. Am.
111
,
1832
1846
.
68.
Zahorik
,
P.
,
Bangayan
,
P.
,
Sundareswaran
,
V.
,
Wang
,
K.
, and
Tam
,
C.
(
2006
). “
Perceptual recalibration in human sound localization: Learning to remediate front-back reversals
,”
J. Acoust. Soc. Am.
120
,
343
359
.
69.
Zahorik
,
P.
,
Brungart
,
D. S.
, and
Bronkhorst
,
A. W.
(
2005
). “
Auditory distance perception in humans: A summary of past and present research
,”
Acta Acust. Acust.
91
,
409
420
.
70.
Zotkin
,
D. N.
,
Hwang
,
J.
,
Duraiswami
,
R.
, and
Davis
,
L. S.
(
2003
). “
HRTF personalization using anthropometric measurements
,” in
Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics
, New Paltz, NY (October 19–22, 2003), pp.
157
160
.
71.
Zwislocki
,
J.
(
1971
). “
An ear-like coupler for earphone calibration
,”
Report No. LSC-S-9
, Laboratory of Sensory Communication, Syracuse University, Syracuse, NY.
You do not currently have access to this content.