To investigate the mechanisms by which unattended speech impairs short-term memory performance, speech samples were systematically degraded by means of a noise vocoder. For experiment 1, recordings of German and Japanese sentences were passed through a filter bank dividing the spectrum between 50 and 7000 Hz into 20 critical-band channels or combinations of those, yielding 20, 4, 2, or just 1 channel(s) of noise-vocoded speech. Listening tests conducted with native speakers of both languages showed a monotonic decrease in speech intelligibility as the number of frequency channels was reduced. For experiment 2, 40 native German and 40 native Japanese participants were exposed to speech processed in the same manner while trying to memorize visually presented sequences of digits in the correct order. Half of each sample received the German, the other half received the Japanese speech samples. The results show large irrelevant-speech effects increasing in magnitude with the number of frequency channels. The effects are slightly larger when subjects are exposed to their own native language. The results are neither predicted very well by the speech transmission index, nor by psychoacoustical fluctuation strength, most likely, since both metrics fail to disentangle amplitude and frequency modulations in the signals.
References
1.
Banbury
, S. P.
, Macken
, W. J.
, Tremblay
, S.
, and Jones
, D. M.
(2001
). “Auditory distraction and short-term memory: Phenomena and practical implications
,” Hum. Factors
43
12
–29
.2.
Bell
, R.
, Mund
, I.
, and Buchner
, A.
(2011
). “Disruption of short-term memory by distractor speech: Does content matter?
,” Quart. J. Exp. Psychol.
64
(1
) 146
–168
.3.
Buchner
, A.
, Rothermund
, K.
, Wentura
, D.
, and Mehl
, B.
(2004
). “Valence of distractor words increases the effects of irrelevant speech on serial recall
,” Mem. Cognit.
32
(5
) 722
–731
.4.
Colle
, H. A.
, and Welsh
, H.
(1976
). “Acoustic masking in primary memory
,” J. Verbal Learning Verbal Behav.
15
, 17
–23
.5.
Dorman
, M. F.
, Loizou
, P. C.
, and Rainey
, D.
(1997
). “Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs
,” J. Acoust. Soc. Am.
102
, 2403
–2411
.6.
Dorsi
, J.
(2013
). “Recall disruption produced by noise-vocoded speech: A study of the irrelevant sound effect
,” Masters thesis, State University of New York
, New Paltz, NY
, http://hdl.handle.net/1951/63031 (Last viewed March 25, 2015).7.
Ebissou
, A.
(2015
). (private communication).8.
Ellermeier
, W.
, and Zimmer
, K.
(2014
). “The psychoacoustics of the irrelevant sound effect: A review
,” Acoust. Sci. Technol.
35
(1
), 10
–16
.9.
Fastl
, H.
, and Zwicker
, E.
(2007
). Psychoacoustics—Facts and Models
, 3rd ed. (Springer
, Berlin
), Chap. 10, pp. 247
–256
.10.
Hellbrück
, J.
, Kuwano
, S.
, and Namba
, S.
(1996
). “Irrelevant background speech and human performance: Is there long-term habituation?
,” J. Acoust. Soc. Jpn. (E)
17
, 239
–247
.11.
Hongisto
, V.
(2005
). “A model predicting the effect of speech of varying intelligibility on work performance
,” Indoor Air
15
, 458
–468
.12.
Hygge
, S.
, Boman
, E.
, and Enmarker
, I.
(2003
). “The effects of road traffic noise and meaningful irrelevant speech on different memory systems
,” Scand. J. Psychol.
44
(1
), 13
–21
.14.
International Organization for Standardization
(1998
). ISO 389-1. Acoustics—Reference Zero for the Calibration of Audiometric Equipment—Part 2: Reference Equivalent Threshold Sound Pressure Levels for Pure Tones and Supraaural Earphones
(International Organization for Standardization
, Geneva, Switzerland
).15.
Jones
, D. M.
, Alford
, D.
, Bridges
, A.
, Tremblay
, S.
, and Macken
, W. J.
(1999
). “Organizational factors in selective attention: The interplay of acoustic distinctiveness and auditory streaming in the irrelevant sound effect
,” J. Exp. Psychol.: Learn. Mem. Cogn.
25
(2
), 464
–473
.16.
Jones
, D. M.
, Alford
, D.
, Macken
, W. J.
, Banbury
, S. P.
, and Tremblay
, S.
(2000
). “Interference from degraded auditory stimuli: Linear effects of changing state in the irrelevant sequence
,” J. Acoust. Soc. Am.
108
(3
), 1082
–1088
.17.
Jones
, D. M.
, Miles
, C.
, and Page
, J.
(1990
). “Disruption of proofreading by irrelevant speech: Effects of attention, arousal, or memory
,” Appl. Cognit. Psychol.
4
, 89
–108
.18.
Klatte
, M.
, Kilcher
, H.
, and Hellbrück
, J.
(1995
). “Wirkungen der zeitlichen Struktur von Hintergrundschall auf das Arbeitsgedächtnis und ihre theoretischen und praktischen Implikationen” (“Effects of the temporal structure of background noise on working memory and their theoretical and practical implications”)
, Z. Exp. Psychol.
42
, 517
–544
.19.
Klatte
, M.
, Meis
, M.
, Sukowski
, H.
, and Schick
, A.
(2007
). “Effects of irrelevant speech and traffic noise on speech perception and cognitive performance in elementary school children
,” Noise Health
9
, 64
–74
.20.
LeCompte
, D. C.
, Neely
, C. B.
, and Wilson
, J. R.
(1997
). “Irrelevant speech and irrelevant tones: The relative importance of speech to the irrelevant speech effect
,” J. Exp. Psychol.: Learn. Mem. Cogn.
23
(2
), 1
–12
.21.
Murray
, A.
, and Jones
, D. M.
(2002
). “Articulatory complexity at item boundaries in serial recall: The case of Welsh and English digit span
,” J. Exp. Psychol.: Learn. Mem. Cogn.
28
(3
), 594
–598
.22.
NTT-AT
(2002
). “Multilingual speech database 2002
” (NTT Advanced Technology Corporation, Tokyo, Japan). http://www.ntt-at.com/product/speech2002/ (Last viewed October 22, 2014).23.
Park
, M.
, Kohlrausch
, A.
, and van Leest
, A.
(2013
). “Irrelevant speech under stationary and adaptive masking conditions
,” J. Acoust. Soc. Am.
134
(3
), 1970
–1981
.24.
Pisoni
, D. B.
, Aslin
, R. N.
, Percy
, A. J.
, and Hennessy
, B. L.
(1982
). “Some effects of laboratory training on identification and discrimination of voicing contrasts in stop consonants
,” J. Exp. Psychol.: Human Perc. Perform.
8
, 297
–314
.25.
Roberts
, B.
, Summers
, R. J.
, and Bailey
, P. J.
(2010
). “The perceptual organization of sine wave speech under competitive conditions
,” J. Acoust. Soc. Am.
128
(2
), 804
–817
.26.
Roberts
, B.
, Summers
, R. J.
, and Bailey
, P. J.
(2011
). “The intelligibility of noise-vocoded speech: Spectral information available from across-channel comparison of amplitude envelopes
,” Proc. R. Soc. B
278
, 1595
–1600
.27.
Roberts
, B.
, Summers
, R. J.
, and Bailey
, P. J.
(2014
). “Formant-frequency variation and informational masking of speech by extraneous formants: Evidence against dynamic and speech-specific acoustical constraints
,” J. Exp. Psychol.: Human Perc. Perform.
40
(4
), 1507
–1525
.28.
Salamé
, P.
, and Baddeley
, A.
(1982
). “Disruption of short-term memory by unattended speech: Implications for the structure of working memory
,” J. Verbal Learning Verbal Behav.
21
, 150
–164
.29.
Schlittmeier
, S. J.
, Weißgerber
, T.
, Kerber
, S.
, Fastl
, H.
, and Hellbrück
, J.
(2012
). “Algorithmic modeling of the irrelevant sound effect (ISE) by the hearing sensation fluctuation strength
,” Atten. Percept. Psycho.
74
, 194
–203
.30.
Shannon
, R. V.
, Zeng
, F.-G.
, Kamath
, V.
, Wygonski
, J.
, and Ekelid
, M.
(1995
). “Speech recognition with primarily temporal cues
,” Science
270
, 303
–304
.31.
Smith
, Z. M.
, Delgutte
, B.
, and Oxenham
, A. J.
(2002
). “Chimaeric sounds reveal dichotomies in auditory perception
,” Nature
416
, 87
–90
.32.
Steeneken
, H. J. M.
, and Houtgast
, T.
(1980
). “A physical method for measuring speech-transmission quality
,” J. Acoust. Soc. Am.
67
, 318
–326
.33.
Summers
, R. J.
, Bailey
, P. J.
, and Roberts
, B.
(2012
). “Effects of the rate of formant-frequency variation on the grouping of formants in speech perception
,” J. Assoc. Res. Otolaryngol.
13
, 269
–280
.34.
Surprenant
, A. M.
, Neath
, I.
, and Bireta
, T. J.
(2007
). “Changing state and the irrelevant sound effect
,” Can. Acoust.
35
, 86
–87
.35.
Tremblay
, S.
, and Jones
, D. M.
(1999
). “Change of intensity fails to produce an irrelevant sound effect: Implications for the representation of unattended sound
,” J. Exp. Psychol.: Hum. Perc. Perform.
25
(4
), 1005
–1015
.36.
Tremblay
, S.
, Nicholls
, A. P.
, Alford
, D.
, and Jones
, D. M.
(2000
). “The irrelevant sound effect: Does speech play a special role?
,” J. Exp. Psychol.: Learn. Mem. Cogn.
26
(6
), 1750
–1754
.37.
Ueda
, K.
, and Nakajima
, Y.
(2008
). “A consistent clustering of power fluctuations in British English, French, German, and Japanese
,” Trans. Technol. Comm. Physiol. Psychol. Acoust. Acoust. Soc. Jpn.
38
(8
), 771
–776
.38.
Ueda
, K.
, Nakajima
, Y.
, and Araki
, T.
(2009
). “An acoustic language universal: Perceptual experiments employing noise-vocoded speech
,” in Proceedings of the 25th Annual Meeting of the International Society for Psychophysics
, edited by M. A.
Elliott
, S.
Antonijevic
, S.
Berthaud
, P.
Mulcahy
, C.
Martyn
, B.
Bargery
, and H.
Schmidt
(ISP
, Galway, Ireland
), pp. 523
–528
.39.
Ueda
, K.
, Nakajima
, Y.
, and Satsukawa
, Y.
(2010
). “Effects of frequency-band elimination on syllable identification of Japanese noise-vocoded speech: Analysis of confusion matrices
,” in Proceedings of the 26th Annual Meeting of the International Society for Psychophysics
, edited by A.
Bastianelli
and G.
Vidotto
(ISP
, Padova, Italy
), pp. 39
–44
.© 2015 Acoustical Society of America.
2015
Acoustical Society of America
You do not currently have access to this content.