Monitoring the sensory consequences of articulatory movements supports speaking. For example, delaying auditory feedback of a speaker's voice disrupts speech production. Also, there is evidence that this disruption may be decreased by immediate visual feedback, i.e., seeing one's own articulatory movements. It is, however, unknown whether delayed visual feedback affects speech production in fluent speakers. Here, the effects of delayed auditory and visual feedback on speech fluency (i.e., speech rate and errors), vocal control (i.e., intensity and pitch), and speech rhythm were investigated. Participants received delayed (by 200 ms) or immediate auditory feedback, while repeating sentences. Moreover, they received either no visual feedback, immediate visual feedback, or delayed visual feedback (by 200, 400, and 600 ms). Delayed auditory feedback affected fluency, vocal control, and rhythm. Immediate visual feedback had no effect on any of the speech measures when it was combined with delayed auditory feedback. Delayed visual feedback did, however, affect speech fluency when it was combined with delayed auditory feedback. In sum, the findings show that delayed auditory feedback disrupts fluency, vocal control, and rhythm and that delayed visual feedback can strengthen the disruptive effect of delayed auditory feedback on fluency.
References
1.
Boersma
, P.
(2001
). Praat, a system for doing phonetics by computer. Glot International
5:9/10, 341
–345
.2.
Brendel
, B.
, Lowit
, A.
, and Howell
, P.
(2004
). “ The effects of delayed and frequency shifted feedback on speakers with Parkinson's Disease
,” J. Med. Speech Lang. Pathol.
12
, 131
–138
.3.
Calvert
, G. A.
, Bullmore
, E. T.
, Brammer
, M. J.
, Campbell
, R.
, Williams
, S. C.
, McGuire
, P. K.
, Woodruff
, P. W.
, Iversen
, S. D.
, and David
, A. S.
(1997
). “ Activation of auditory cortex during silent lipreading
,” Science
276
(5312
), 593
–596
.4.
Civier
, O.
, Tasko
, S. M.
, and Guenther
, F. H.
(2010
). “ Overreliance on auditory feedback may lead to sound/syllable repetitions: Simulations of stuttering and fluency-inducing conditions with a neural model of speech production
,” J. Fluency Disord.
35
(3
), 246
–279
.5.
Davis
, M. H.
, Ford
, M. A.
, Kherif
, F.
, and Johnsrude
, I. S.
(2011
). “ Does semantic context benefit speech understanding through ‘top-down’ processes? Evidence from time-resolved sparse fMRI
,” J. Cognit. Neurosci.
23
(12
), 3914
–3932
.6.
Dellwo
, V.
, and P.
Wagner
(2003
). “ Relations between language rhythm and speech rate
,” in Proceedings of the 15th International Congress of Phonetics Sciences
, pp. 471
–474
.7.
Elman
, J. L.
(1981
). “ Effects of frequency-shifted feedback on the pitch of vocal productions
,” J. Acoust. Soc. Am.
70
(1
), 45
–50
.8.
Fairbanks
, G.
(1955
). “ Selective vocal effects of delayed auditory feedback
,” J. Speech Hearing Disorders
20
(4
), 333
–346
.9.
Fairbanks
, G.
, and Guttman
, N.
(1958
). “ Effects of delayed auditory feedback upon articulation
,” J. Speech Hearing Res.
1
(1
), 12
–22
.10.
Fridriksson
, J.
, Hubbard
, H. I.
, Hudspeth
, S. G.
, Holland
, A. L.
, Bonilha
, L.
, Fromm
, D.
, and Rorden
, C.
(2012
). “ Speech entrainment enables patients with Broca's aphasia to produce fluent speech
,” Brain
135
(Pt. 12
), 3815
–3829
.11.
Guenther
, F. H.
, Ghosh
, S. S.
, and Tourville
, J. A.
(2006
). “ Neural modeling and imaging of the cortical interactions underlying syllable production
,” Brain Lang.
96
(3
), 280
–301
.12.
Houde
, J. F.
, and Jordan
, M. I.
(1998
). “ Sensorimotor adaptation in speech production
,” Science
279
(5354
), 1213
–1216
.13.
Howell
, P.
(1990
). “ Changes in voice level caused by several forms of altered feedback in fluent speakers and stutterers
,” Language Speech
33
, 325
–338
.14.
Howell
, P.
(2004
). “ Effects of delayed auditory feedback and frequency-shifted feedback on speech control and some potentials for future development of prosthetic aids for stammering
,” Stammering Res.
1
(1
), 31
–46
.15.
Howell
, P.
, and Archer
, A.
(1984
). “ Susceptibility to the effects of delayed auditory feedback
,” Percept. Psychophys.
36
(3
), 296
–302
.16.
Howell
, P.
, Powell
, D. J.
, and Khan
, I.
(1983
). “ Amplitude contour of the delayed signal and interference in delayed auditory-feedback tasks
,” J. Exp. Psychol.
9
(5
), 772
–784
.17.
Howell
, P.
, and Sackin
, S.
(2002
). “ Timing interference to speech in altered listening conditions
,” J. Acoust. Soc. Am.
111
(6
), 2842
–2852
.18.
Howell
, P.
, Wingfield
, T.
, and Johnson
, M.
(1988
). “ Characteristics of the speech of stutterers during normal and altered auditory feedback
,” in Proceedings of Speech'88
, edited by W. A. H.
Ainsworth
, J. N.
Lawrence
(Institute of Acoustics
, Edinburgh, UK
), pp. 1069
–1076
.19.
Hudock
, D.
, Dayalu
, V. N.
, Saltuklaroglu
, T.
, Stuart
, A.
, Zhang
, J.
, and Kalinowski
, J.
(2010
). “ Stuttering inhibition via visual feedback at normal and fast speech rates
,” Int. J. Lang. Commun. Disorders
46
, 169
–178
.20.
Jayaram
, M.
(1983
). “ Phonetic influences on stuttering in monolingual and bilingual stutterers
,” J. Commun. Disorders
16
(4
), 287
–297
.21.
Jones
, J. A.
, and Munhall
, K. G.
(2000
). “ Perceptual calibration of F0 production: Evidence from feedback perturbation
,” J. Acoust. Soc. Am.
108
(Pt. 1
), 1246
–1251
.22.
Jones
, J. A.
, and Munhall
, K. G.
(2005
). “ Remapping auditory-motor representations in voice production
,” Curr. Biol.
15
(19
), 1768
–1772
.23.
Jones
, J. A.
, and Striemer
, D.
(2007
). “ Speech disruption during delayed auditory feedback with simultaneous visual feedback
,” J. Acoust. Soc. Am.
122
(4
), 135
–141
.24.
Kalinowski
, J.
, and Stuart
, A.
(1996
). “ Stuttering amelioration at various auditory feedback delays and speech rates
,” Eur. J. Disorders Commun.
31
(3
), 259
–269
.25.
Kalinowski
, J.
, Stuart
, A.
, Rastatter
, M. P.
, Snyder
, G.
, and Dayalu
, V.
(2000
). “ Inducement of fluent speech in persons who stutter via visual choral speech
,” Neurosci. Lett.
281
(2–3
), 198
–200
.26.
Kuhl
, P. K.
, and Meltzoff
, A. N.
(1982
). “ The bimodal perception of speech in infancy
,” Science
218
(4577
), 1138
–1141
.27.
Kulpa
, J. D.
, and Pfordresher
, P. Q.
(2013
). “ Effects of delayed auditory and visual feedback on sequence production
,” Exp. Brain Res.
224
(1
), 69
–77
.28.
Lechner
, B. K.
(1979
). “ Effects of delayed auditory-feedback and masking on the fundamental-frequency of stutterers and non-stutterers
,” J. Speech Hearing Res.
22
(2
), 343
–353
.29.
Lee
, B. S.
(1950a
). “ Effects of delayed speech feedback
,” J. Acoust. Soc. Am.
22
(6
), 824
–826
.30.
Lee
, B. S.
(1950b
). “ Some effects of side-tone delay
,” J. Acoust. Soc. Am.
22
(5
), 639
–640
.31.
Liss
, J. M.
, White
, L.
, Mattys
, S. L.
, Lansford
, K.
, Lotto
, A. J.
, Spitzer
, S. M.
, and Caviness
, J. N.
(2009
). “ Quantifying speech rhythm abnormalities in the dysarthrias
,” J. Speech Language Hearing Res.
52
(5
), 1334
–1352
.32.
McGurk
, H.
, and MacDonald
, J.
(1976
). “ Hearing lips and seeing voices
,” Nature
264
, 746
–748
.33.
Mottonen
, R.
, Krause
, C. M.
, Tiippana
, K.
, and Sams
, M.
(2002
). “ Processing of changes in visual speech in the human auditory cortex
,” Brain Res.
13
(3
), 417
–425
.34.
Pfordresher
, P. Q.
, and Benitez
, B.
(2007
). “ Temporal coordination between actions and sound during sequence production
,” Human Movement Sci.
26
(5
), 742
–756
.35.
Pfordresher
, P. Q.
, and Palmer
, C.
(2002
). “ Effects of delayed auditory feedback on timing of music performance
,” Psychol. Res.
66
(1
), 71
–79
.36.
Ramus
, F.
, Nespor
, M.
, and Mehler
, J.
(1999
). “ Correlates of linguistic rhythm in the speech signal
,” Cognition
73
(3
), 265
–292
.37.
Repp
, B. H.
, and Penel
, A.
(2002
). “ Auditory dominance in temporal processing: New evidence from synchronization with simultaneous visual and auditory sequences
,” J. Exp. Psychol.
28
(5
), 1085
–1099
.38.
Repp
, B. H.
, and Penel
, A.
(2004
). “ Rhythmic movement is attracted more strongly to auditory than to visual rhythms
,” Psychol. Res.
68
(4
), 252
–270
.39.
Rosenbek
, J. C.
, Lemme
, M. L.
, Ahern
, M. B.
, Harris
, E. H.
, and Wertz
, R. T.
(1973
). “ A treatment for apraxia of speech in adults
,” J. Speech Hearing Disorders
38
(4
), 462
–472
.40.
Shiller
, D. M.
, Sato
, M.
, Gracco
, V. L.
, and Baum
, S. R.
(2009
). “ Perceptual recalibration of speech sounds following speech motor learning
,” J. Acoust. Soc. Am.
125
(2
), 1103
–1113
.41.
Siegel
, G. M.
, and Pick
, H. L.
, Jr. (1974
). “ Auditory feedback in the regulation of voice
,” J. Acoust. Soc. Am.
56
(5
), 1618
–1624
.42.
Snyder
, G. J.
, Hough
, M. S.
, Blanchet
, P.
, Ivy
, L. J.
, and Waddell
, D.
(2009
). “ The effects of self-generated synchronous and asynchronous visual speech feedback on overt stuttering frequency
,” J. Commun. Disorders
42
, 235
–244
.43.
Stager
, S. V.
, and Ludlow
, C. L.
(1993
). “ Speech production changes under fluency-evoking conditions in nonstuttering speakers
,” J. Speech Hearing Res.
36
(2
), 245
–253
.44.
Stuart
, A.
, Kalinowski
, J.
, Rastatter
, M. P.
, and Lynch
, K.
(2002
). “ Effect of delayed auditory feedback on normal speakers at two speech rates
,” J. Acoust. Soc. Am.
111
(Pt. 1
), 2237
–2241
.45.
Sumby
, W. H.
, and Pollack
, I.
(1954
). “ Visual contribution to speech intelligibility in noise
,” J. Acoust. Soc. Am.
26
(2
), 212
–215
.46.
Summerfield
, Q.
(1992
). “ Lipreading and audio-visual speech perception
,” Philos. Trans. R. Soc. London B
335
(1273
), 71
–78
.47.
Tourville
, J. A.
, and Guenther
, F. H.
(2011
). “ The DIVA model: A neural theory of speech acquisition and production
,” Language Cognit. Processes
26
(7
), 952
–981
.48.
Tye-Murray
, N.
(1986
). “ Visual feedback during speech production
,” J. Acoust. Soc. Am.
79
(4
), 1169
–1171
.49.
van Wassenhove
, V.
, Grant
, K. W.
, and Poeppel
, D.
(2007
). “ Temporal window of integration in auditory-visual speech perception
,” Neuropsychologia
45
(3
), 598
–607
.50.
Weikum
, W. M.
, Vouloumanos
, A.
, Navarra
, J.
, Soto-Faraco
, S.
, Sebastian-Galles
, N.
, and Werker
, J. F.
(2007
). “ Visual language discrimination in infancy
,” Science
316
(5828
), 1159
.51.
White
, L.
, and Mattys
, S. L.
(2007
). “ Calibrating rhythm: First language and second language studies
,” J. Phonetics
35
(4
), 501
–522
.52.
Williams
, P.
(2009
). “ The Nuffield approach to childhood apraxia of speech and other severe speech disorders
,” in Children's Speech Sound Disorders
, edited by C.
Bowen
(Wiley-Blackwell
, Oxford, UK
), pp. 270
–275
.53.
54.
Yates
, A. J.
(1963
). “ Delayed auditory feedback
,” Psychol. Bull.
60
, 213
–232
.55.
Yuan
, J.
, and Liberman
, M.
(2008
). “ Speaker identification on the SCOTUS corpus
,” Proc. Acoust.
2008
, 5687
–5690
.© 2015 Acoustical Society of America.
2015
Acoustical Society of America
You do not currently have access to this content.