Research has shown that talkers reliably coordinate the timing of articulator movements across variation in production rate and syllable stress, and that this precision of inter-articulator timing instantiates phonetic structure in the resulting acoustic signal. We here tested the hypothesis that immediate auditory feedback helps regulate that consistent articulatory timing control. Talkers with normal hearing recorded 480 /tV#Cat/ utterances using electromagnetic articulography, with alternative V (/ɑ/-/ɛ/) and C (/t/-/d/), across variation in production rate (fast-normal) and stress (first syllable stressed-unstressed). Utterances were split between two listening conditions: unmasked and masked. To quantify the effect of immediate auditory feedback on the coordination between the jaw and tongue-tip, the timing of tongue-tip raising onset for C, relative to the jaw opening-closing cycle for V, was obtained in each listening condition. Across both listening conditions, any manipulation that shortened the jaw opening-closing cycle reduced the latency of tongue-tip movement onset, relative to the onset of jaw opening. Moreover, tongue-tip latencies were strongly affiliated with utterance type. During auditory masking, however, tongue-tip latencies were less strongly affiliated with utterance type, demonstrating that talkers use afferent auditory signals in real-time to regulate the precision of inter-articulator timing in service to phonetic structure.

1.
Abbs
,
J. H.
, and
Gracco
,
V. L.
(
1984
). “
Control of complex motor gestures: Orofacial muscle responses to load perturbations of lip during speech
,”
J. Neurophysiol.
51
(
4
),
705
723
.
2.
Alm
,
P. A.
(
2004
). “
Stuttering and the basal ganglia circuits: A critical review of possible relations
,”
J. Commun. Disord.
37
(
4
),
325
369
.
3.
Benoit
,
C.
(
1986
). “
Note on the use of correlations in speech timing
,”
J. Acoust. Soc. Am.
80
,
1846
1849
.
4.
Cai
,
S.
,
Ghosh
,
S. S.
,
Guenther
,
F. H.
, and
Perkell
,
J. S.
(
2011
). “
Focal manipulations of formant trajectories reveal a role of auditory feedback in the online control of both within-syllable and between-syllable speech timing
,”
J. Neurosci.
31
(
45
),
16483
16490
.
5.
Civier
,
O.
,
Tasko
,
S. M.
, and
Guenther
,
F. H.
(
2010
). “
Overreliance on auditory feedback may lead to sound/syllable repetitions: Simulations of stuttering and fluency-inducing conditions with a neural model of speech production
,”
J. Fluency Disord.
35
(
3
),
246
279
.
6.
Diedrichsen
,
J.
,
Hashambhoy
,
Y.
,
Rane
,
T.
, and
Shadmehr
,
R.
(
2005
). “
Neural correlates of reach errors
,”
J. Neurosci.
25
(
43
),
9919
9931
.
7.
Dromey
,
C.
,
Hunter
,
E.
, and
Nissen
,
S. L.
(
2018
). “
Speech adaptation to kinematic recording sensors: Perceptual and acoustic findings
,”
J. Speech Lang. Hear. Res.
61
(
3
),
593
603
.
8.
Fairbanks
,
G.
(
1955
). “
Selective vocal effects of delayed auditory feedback
,”
J. Speech Hear. Disord.
20
,
333
345
.
9.
Feng
,
Y.
,
Gracco
,
V. L.
, and
Max
,
L.
(
2011
). “
Integration of auditory and somatosensory error signals in the neural control of speech movements
,”
J. Neurophysiol.
106
(
2
),
667
679
.
10.
Folkins
,
J. W.
, and
Abbs
,
J. H.
(
1975
). “
Lip and jaw motor control during speech: Responses to resistive loading of the jaw
,”
J. Speech Lang. Hear. Res.
18
,
207
220
.
11.
Fowler
,
C. A.
(
1979
). “ 
‘Perceptual centers’ in speech production and perception
,”
Percept. Psychophys.
25
,
375
388
.
12.
Fowler
,
C. A.
(
1980
). “
Coarticulation and theories of extrinsic timing
,”
J. Phon.
8
(
1
),
113
133
.
13.
Frisch
,
S. A.
,
Maxfield
,
N.
, and
Belmont
,
A.
(
2016
). “
Anticipatory coarticulation and stability of speech in typically fluent speakers and people who stutter
,”
Clin. Linguist. Phon.
30
(
3
),
277
291
.
14.
Gammon
,
S. A.
,
Smith
,
P. J.
,
Daniloff
,
R. G.
, and
Kim
,
C. W.
(
1971
). “
Articulation and stress/juncture production under oral anesthetization and masking
,”
J. Speech Hear. Res.
14
,
271
282
.
15.
Garnier
,
M.
,
Ménard
,
L.
, and
Alexandre
,
B.
(
2007
). “
Hyper-articulation in Lombard speech: An active communicative strategy to enhance visible speech cues?
J. Acoust. Soc. Am.
144
(
2
),
1059
1074
.
16.
Gracco
,
V. L.
(
1988
). “
Timing factors in the coordination of speech movements
,”
J. Neurosci.
8
(
12
),
4628
4639
.
17.
Gracco
,
V. L.
, and
Abbs
,
J. H.
(
1986
). “
Variant and invariant characteristics of speech movement planning
,”
Exp. Brain Res.
65
,
156
166
.
18.
Guenther
,
F. H.
(
2016
).
Neural Control of Speech
(
Massachusetts Institute of Technology Press
,
Cambridge, MA
).
19.
Hardcastle
,
W. J.
(
1975
). “
Some aspects of speech production under controlled conditions of oral anaesthesia and auditory masking
,”
J. Phon.
3
,
197
214
.
20.
Harris
,
K. S.
,
Tuller
,
B.
, and
Kelso
,
J. A. S.
(
1986
). “
Temporal invariance in the production of speech
,” in
Invariance and Variability in Speech Processes
, edited by
J. S.
Perkell
and
D. H.
Klatt
(
Earlbaum
,
Hillsdale, NJ
).
21.
Houde
,
J. F.
, and
Jordan
,
M. I.
(
1998
). “
Sensorimotor adaptation in speech production
,”
Science
279
,
1213
1216
.
22.
Kelso
,
J. A. S.
(
1986
). “
Pattern formation in speech and limb movements involving many degrees of freedom
,”
Exp. Brain Res.
15
,
105
128
, available at https://haskinslabs.org/sites/default/files/files/Reprints/HL0564.pdf.
23.
Kelso
,
J. A. S.
,
Saltzman
,
E. L.
, and
Tuller
,
B.
(
1986
). “
The dynamical perspective on speech production: Data and theory
,”
J. Phon.
14
,
29
59
.
24.
Kelso
,
J. A. S.
, and
Tuller
,
B.
(
1987
). “
Intrinsic timing in speech production: Theory, methodology, and preliminary observations
,” in
Motor and Sensory Processes of Language
, edited by
E.
Keller
and
M.
Gopnik
(
Earlbaum
,
Hillsdale, NJ
), pp.
203
222
.
25.
Kelso
,
J. A. S.
,
Tuller
,
B.
,
Bateson
,
E. V.
, and
Fowler
,
C. A.
(
1984
). “
Functionally specific articulatory cooperation following jaw perturbations during speech: Evidence for coordinative structures
,”
J. Exp. Psychol. Hum. Percept. Perform.
10
,
812
832
.
26.
Kent
,
R. D.
, and
Moll
,
K. L.
(
1975
). “
Articulatory timing in selected consonant sequences
,”
Brain Lang.
2
,
304
323
.
27.
Lametti
,
D. R.
,
Sazzad
,
N. M.
, and
Ostry
,
D. J.
(
2012
). “
Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback
,”
J. Neurosci.
27
,
9351
9358
.
28.
Lametti
,
D. R.
,
Smith
,
H. J.
,
Watkins
,
K. E.
, and
Shiller
,
D. M.
(
2018
). “
Robust sensorimotor learning during variable sentence-level speech
,”
Curr. Biol.
28
,
3106
3113
.
29.
Lane
,
H.
, and
Perkell
,
J. S.
(
2005
). “
Control of voice-onset time in the absence of hearing: A review
,”
J. Speech Lang. Hear. Res.
48
(
6
),
1334
1343
.
30.
Lane
,
H.
, and
Tranel
,
B.
(
1971
). “
The Lombard sign and the role of hearing in speech
,”
J. Speech Hear. Res.
14
,
677
709
.
31.
Löfqvist
,
A.
(
1991
). “
Proportional timing in speech motor control
,”
J. Phon.
19
,
343
350
.
32.
Lombard
,
E.
(
1911
). “
Le signe de l'élévation de la voix” (“The sign of the elevation of the voice”)
,
Ann. Mal. l'Oreille, Larynx, Nez Pharynx
37
,
101
119
.
33.
Masapollo
,
M.
, and
Nittrouer
,
S.
(
2021
). “
MIPA: A theory of phonological acquisition and speech motor control
,”
J. Acoust. Soc. Am.
150
,
A111
.
34.
Masapollo
,
M.
, and
Nittrouer
,
S.
(
2023
). “
Interarticulator speech coordination: Timing is of the essence
,”
J. Speech Lang. Hear. Res.
66
,
901
915
.
35.
Masapollo
,
M.
,
Nittrouer
,
S.
,
Gendron
,
R.
,
Ménard
,
L.
, and
Ostry
,
D. J.
(submitted). “
Differential use of auditory feedback in the real-time control of speech movements by deaf talkers with cochlear implants and peers with normal-hearing
,” in
48th Annual MidWinter Meeting of the Association for Research in Otolaryngology
,
Orlando, FL
.
36.
Max
,
L.
,
Caruso
,
A. J.
, and
Gracco
,
V. L.
(
2003
). “
Kinematic analyses of speech, orofacial nonspeech, and finger movements in stuttering and nonstuttering adults
,”
J. Speech Lang. Hear. Res.
46
(
1
),
215
232
.
37.
Max
,
L.
,
Guenther
,
F. H.
,
Gracco
,
V. L.
,
Ghosh
,
S. S.
, and
Wallace
,
M. E.
(
2004
). “
Unstable or insufficiently activated internal models and feedback-biased motor control as sources of dysfluency: A theoretical model of stuttering
,”
Contemp. Issues Commun. Sci. Disord.
31
,
105
122
.
38.
Mixdorff
,
H.
,
Pech
,
U.
,
Davis
,
C.
, and
Kim
,
J.
(
2007
). “
Map task dialogs in noise — a paradigm for examining Lombard speech
,” in
XVI Meeting of the International Congress of Phonetic Sciences
,
Saarbrücken, Germany
, pp.
1329
1332
.
39.
Munhall
,
K.
(
1985
). “
An examination of intra-articulator relative timing
,”
J. Acoust. Soc. Am.
78
(
5
),
1548
1553
.
40.
Nasir
,
S. M.
, and
Ostry
,
D. J.
(
2008
). “
Speech motor learning in profoundly deaf adults
,”
Nat. Neurosci.
11
(
10
),
1217
1222
.
41.
Neto Henriques
,
R.
, and
van Lieshout
,
P.
(
2013
). “
A comparison of methods for decoupling tongue and lower lip from jaw movements in 3D articulography
,”
J. Speech Lang. Hear. Res.
56
(
5
),
1503
1516
.
42.
Nittrouer
,
S.
(
1991
). “
Phase relations of jaw and tongue tip movements in the production of VCV utterances
,”
J. Acoust. Soc. Am.
90
,
1806
1815
.
43.
Nittrouer
,
S.
,
Munhall
,
K.
,
Kelso
,
A. S.
,
Tuller
,
B.
, and
Harris
,
K. S.
(
1988
). “
Patterns of inter-articulator phasing and their relation to linguistic structure
,”
J. Acoust. Soc. Am.
84
,
1653
1660
.
44.
Okalidou
,
A.
, and
Harris
,
K. S.
(
1999
). “
A comparison of intergestural patterns in deaf and hearing adult speakers: Implications from an acoustic analysis of disyllables
,”
J. Acoust. Soc. Am.
106
(
1
),
394
409
.
45.
Perkell
,
J. S.
,
Guenther
,
F. H.
,
Lane
,
H.
,
Matthies
,
M. L.
,
Perrier
,
P.
,
Vick
,
J.
,
Wilhelms-Tricarico
,
R.
, and
Zandipour
,
M.
(
2000
). “
A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss
,”
J. Phon.
28
(
3
),
233
272
.
46.
Perkell
,
J. S.
,
Lane
,
H.
,
Ghosh
,
S.
,
Matthies
,
M. L.
,
Tiede
,
M.
,
Guenther
,
F.
, and
Ménard
,
L.
(
2008
). “
Mechanisms of vowel production: Auditory goals and speaker acuity
,” in
Proceedings of the 8th International Seminar on Speech Production
, edited by
R.
Sock
,
S.
Fuchs
, and
Y.
Laprie
, pp.
29
32
.
47.
Popp
,
N. J.
,
Hernandez-Castillo
,
C. R.
,
Gribble
,
P. L.
, and
Diedrichsen
,
J.
(
2022
). “
The role of feedback in the production of skilled finger sequences
,”
J. Neurophysiol.
127
,
829
839
.
48.
Purcell
,
D. W.
, and
Munhall
,
K. G.
(
2006
). “
Compensation following real-time manipulation of formants in isolated vowels
,”
J. Acoust. Soc. Am.
119
,
2288
2297
.
49.
Rauschecker
,
J. P.
, and
Scott
,
S. K.
(
2009
). “
Maps and streams in the auditory cortex: Nonhuman primates illuminate human speech processing
,”
Nat. Neurosci.
12
(
6
),
718
724
.
50.
Rebernik
,
T.
,
Jacobi
,
J.
,
Jonkers
,
R.
,
Noiray
,
A.
, and
Wieling
,
M.
(
2021
). “
A review of data collection practices using electromagnetic articulography
,”
Lab. Phonol.
12
,
6
.
51.
Saltzman
,
E.
,
Lofqvist
,
A.
,
Kay
,
B.
,
Kinsella-Shaw
,
J.
, and
Rubin
,
P.
(
1998
). “
Dynamics of intergestural timing: A perturbation study of lip-larynx coordination
,”
Exp. Brain Res.
123
,
412
424
.
52.
Smith
,
A.
,
Sadagopan
,
N.
,
Walsh
,
B.
, and
Weber-Fox
,
C.
(
2010
). “
Increasing phonological complexity reveals heightened instability in inter-articulatory coordination in adults who stutter
,”
J. Fluency Disord.
35
(
1
),
1
18
.
53.
Sorensen
,
T.
,
Toutios
,
A.
,
Goldstein
,
L.
, and
Narayanan
,
S.
(
2019
). “
Task-dependence of articulator synergies
,”
J. Acoust. Soc. Am.
145
(
3
),
1504
1520
.
54.
Summers
,
W. V.
,
Pisoni
,
D. B.
,
Bernacki
,
R. H.
,
Pedlow
,
R. I.
, and
Stokes
,
M. A.
(
1988
). “
Effects of noise on speech production: Acoustic and perceptual analyses
,”
J. Acoust. Soc. Am.
84
,
917
928
.
55.
Sussman
,
H. M.
,
Byrd
,
C. T.
, and
Guitar
,
B.
(
2011
). “
The integrity of anticipatory coarticulation in fluent and non-fluent tokens of adults who stutter
,”
Clin. Linguist. Phon.
25
(
3
),
169
186
.
56.
Tiede
,
M.
(
2005
). “
MVIEW: Software for visualization and analysis of concurrently recorded movement data
,” (
Haskins Laboratory Report
,
New Haven, CT
).
57.
Tiede
,
M.
(
2010
). “
MVIEW: Multi-channel visualization application for displaying dynamic sensor movement
,” (
Haskins Laboratory Report
,
New Haven, CT
).
58.
Tourville
,
J. A.
,
Reilly
,
K. J.
, and
Guenther
,
F. H.
(
2008
). “
Neural mechanisms underlying auditory feedback control of speech
,”
Neuroimage
39
,
1429
1443
.
59.
Tremblay
,
S.
,
Shiller
,
D. M.
, and
Ostry
,
D. J.
(
2003
). “
Somatosensory basis of speech production
,”
Nature
423
(
6942
),
866
869
.
60.
Tuller
,
B.
, and
Kelso
,
A. S.
(
1984
). “
The timing of articulatory gestures: Evidence for relational invariants
,”
J. Acoust. Soc. Am.
76
,
1030
1036
.
61.
Tuller
,
B.
,
Kelso
,
A. S.
, and
Harris
,
K. S.
(
1982
). “
Inter-articulator phasing as an index of temporal regularity in speech
,”
J. Exp. Psychol. Hum. Percept. Perform.
8
,
460
472
.
62.
Tuller
,
B.
,
Kelso
,
A. S.
, and
Harris
,
K. S.
(
1983
). “
Further evidence for the role of relative timing in speech: A reply to Barry
,”
J. Exp. Psychol. Hum. Percept. Perform.
9
,
829
833
.
63.
Turgeon
,
C.
,
Trudeau-Fisette
,
P.
,
Fitzpatrick
,
E.
, and
Ménard
,
L.
(
2017
). “
Vowel intelligibility in children with cochlear implants: An acoustic and articulatory study
,”
Int. J. Pediatr. Otorhinolaryngol.
101
,
87
96
.
64.
Turk
,
A.
, and
Shattuck-Hufnagel
,
S.
(
2020
). “
Speech timing: Implications for theories of phonology, phonetics, and speech motor control
,” in
Oxford Studies in Phonology and Phonetics
(
Oxford University Press
,
Oxford
), Vol.
5
.
65.
Weismer
,
G.
, and
Bunton
,
K.
(
1999
). “
Influences of pellet markers on speech production behavior: Acoustical and perceptual measures
,”
J. Acoust. Soc. Am.
105
,
2882
2894
.
66.
Westbury
,
J. R.
,
Lindstrom
,
M. J.
, and
McClean
,
M. D.
(
2002
). “
Tongues and lips without jaws: A comparison of methods for decoupling speech movements
,”
J. Speech Lang. Hear. Res.
45
,
651
662
.

Supplementary Material

You do not currently have access to this content.