Research has shown that talkers reliably coordinate the timing of articulator movements across variation in production rate and syllable stress, and that this precision of inter-articulator timing instantiates phonetic structure in the resulting acoustic signal. We here tested the hypothesis that immediate auditory feedback helps regulate that consistent articulatory timing control. Talkers with normal hearing recorded 480 /tV#Cat/ utterances using electromagnetic articulography, with alternative V (/ɑ/-/ɛ/) and C (/t/-/d/), across variation in production rate (fast-normal) and stress (first syllable stressed-unstressed). Utterances were split between two listening conditions: unmasked and masked. To quantify the effect of immediate auditory feedback on the coordination between the jaw and tongue-tip, the timing of tongue-tip raising onset for C, relative to the jaw opening-closing cycle for V, was obtained in each listening condition. Across both listening conditions, any manipulation that shortened the jaw opening-closing cycle reduced the latency of tongue-tip movement onset, relative to the onset of jaw opening. Moreover, tongue-tip latencies were strongly affiliated with utterance type. During auditory masking, however, tongue-tip latencies were less strongly affiliated with utterance type, demonstrating that talkers use afferent auditory signals in real-time to regulate the precision of inter-articulator timing in service to phonetic structure.
REFERENCES
1.
Abbs
,
J. H.
, and
Gracco
,
V. L.
(1984
). “
Control of complex motor gestures: Orofacial muscle responses to load perturbations of lip during speech
,” J. Neurophysiol.
51
(4
), 705
–723
.2.
Alm
,
P. A.
(2004
). “
Stuttering and the basal ganglia circuits: A critical review of possible relations
,” J. Commun. Disord.
37
(4
), 325
–369
.3.
Benoit
,
C.
(1986
). “
Note on the use of correlations in speech timing
,” J. Acoust. Soc. Am.
80
, 1846
–1849
.4.
Cai
,
S.
,
Ghosh
,
S. S.
,
Guenther
,
F. H.
, and
Perkell
,
J. S.
(2011
). “
Focal manipulations of formant trajectories reveal a role of auditory feedback in the online control of both within-syllable and between-syllable speech timing
,” J. Neurosci.
31
(45
), 16483
–16490
.5.
Civier
,
O.
,
Tasko
,
S. M.
, and
Guenther
,
F. H.
(2010
). “
Overreliance on auditory feedback may lead to sound/syllable repetitions: Simulations of stuttering and fluency-inducing conditions with a neural model of speech production
,” J. Fluency Disord.
35
(3
), 246
–279
.6.
Diedrichsen
,
J.
,
Hashambhoy
,
Y.
,
Rane
,
T.
, and
Shadmehr
,
R.
(2005
). “
Neural correlates of reach errors
,” J. Neurosci.
25
(43
), 9919
–9931
.7.
Dromey
,
C.
,
Hunter
,
E.
, and
Nissen
,
S. L.
(2018
). “
Speech adaptation to kinematic recording sensors: Perceptual and acoustic findings
,” J. Speech Lang. Hear. Res.
61
(3
), 593
–603
.8.
Fairbanks
,
G.
(1955
). “
Selective vocal effects of delayed auditory feedback
,” J. Speech Hear. Disord.
20
, 333
–345
.9.
Feng
,
Y.
,
Gracco
,
V. L.
, and
Max
,
L.
(2011
). “
Integration of auditory and somatosensory error signals in the neural control of speech movements
,” J. Neurophysiol.
106
(2
), 667
–679
.10.
Folkins
,
J. W.
, and
Abbs
,
J. H.
(1975
). “
Lip and jaw motor control during speech: Responses to resistive loading of the jaw
,” J. Speech Lang. Hear. Res.
18
, 207
–220
.11.
Fowler
,
C. A.
(1979
). “
‘Perceptual centers’ in speech production and perception
,” Percept. Psychophys.
25
, 375
–388
.12.
Fowler
,
C. A.
(1980
). “
Coarticulation and theories of extrinsic timing
,” J. Phon.
8
(1
), 113
–133
.13.
Frisch
,
S. A.
,
Maxfield
,
N.
, and
Belmont
,
A.
(2016
). “
Anticipatory coarticulation and stability of speech in typically fluent speakers and people who stutter
,” Clin. Linguist. Phon.
30
(3
), 277
–291
.14.
Gammon
,
S. A.
,
Smith
,
P. J.
,
Daniloff
,
R. G.
, and
Kim
,
C. W.
(1971
). “
Articulation and stress/juncture production under oral anesthetization and masking
,” J. Speech Hear. Res.
14
, 271
–282
.15.
Garnier
,
M.
,
Ménard
,
L.
, and
Alexandre
,
B.
(2007
). “
Hyper-articulation in Lombard speech: An active communicative strategy to enhance visible speech cues?
” J. Acoust. Soc. Am.
144
(2
), 1059
–1074
.16.
Gracco
,
V. L.
(1988
). “
Timing factors in the coordination of speech movements
,” J. Neurosci.
8
(12
), 4628
–4639
.17.
Gracco
,
V. L.
, and
Abbs
,
J. H.
(1986
). “
Variant and invariant characteristics of speech movement planning
,” Exp. Brain Res.
65
, 156
–166
.18.
Guenther
,
F. H.
(2016
). Neural Control of Speech
(
Massachusetts Institute of Technology Press
,
Cambridge, MA
).19.
Hardcastle
,
W. J.
(1975
). “
Some aspects of speech production under controlled conditions of oral anaesthesia and auditory masking
,” J. Phon.
3
, 197
–214
.20.
Harris
,
K. S.
,
Tuller
,
B.
, and
Kelso
,
J. A. S.
(1986
). “
Temporal invariance in the production of speech
,” in Invariance and Variability in Speech Processes
, edited by
J. S.
Perkell
and
D. H.
Klatt
(
Earlbaum
,
Hillsdale, NJ
).21.
Houde
,
J. F.
, and
Jordan
,
M. I.
(1998
). “
Sensorimotor adaptation in speech production
,” Science
279
, 1213
–1216
.22.
Kelso
,
J. A. S.
(1986
). “
Pattern formation in speech and limb movements involving many degrees of freedom
,” Exp. Brain Res.
15
, 105
–128
, available at https://haskinslabs.org/sites/default/files/files/Reprints/HL0564.pdf.23.
Kelso
,
J. A. S.
,
Saltzman
,
E. L.
, and
Tuller
,
B.
(1986
). “
The dynamical perspective on speech production: Data and theory
,” J. Phon.
14
, 29
–59
.24.
Kelso
,
J. A. S.
, and
Tuller
,
B.
(1987
). “
Intrinsic timing in speech production: Theory, methodology, and preliminary observations
,” in Motor and Sensory Processes of Language
, edited by
E.
Keller
and
M.
Gopnik
(
Earlbaum
,
Hillsdale, NJ
), pp. 203
–222
.25.
Kelso
,
J. A. S.
,
Tuller
,
B.
,
Bateson
,
E. V.
, and
Fowler
,
C. A.
(1984
). “
Functionally specific articulatory cooperation following jaw perturbations during speech: Evidence for coordinative structures
,” J. Exp. Psychol. Hum. Percept. Perform.
10
, 812
–832
.26.
Kent
,
R. D.
, and
Moll
,
K. L.
(1975
). “
Articulatory timing in selected consonant sequences
,” Brain Lang.
2
, 304
–323
.27.
Lametti
,
D. R.
,
Sazzad
,
N. M.
, and
Ostry
,
D. J.
(2012
). “
Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback
,” J. Neurosci.
27
, 9351
–9358
.28.
Lametti
,
D. R.
,
Smith
,
H. J.
,
Watkins
,
K. E.
, and
Shiller
,
D. M.
(2018
). “
Robust sensorimotor learning during variable sentence-level speech
,” Curr. Biol.
28
, 3106
–3113
.29.
Lane
,
H.
, and
Perkell
,
J. S.
(2005
). “
Control of voice-onset time in the absence of hearing: A review
,” J. Speech Lang. Hear. Res.
48
(6
), 1334
–1343
.30.
Lane
,
H.
, and
Tranel
,
B.
(1971
). “
The Lombard sign and the role of hearing in speech
,” J. Speech Hear. Res.
14
, 677
–709
.31.
Löfqvist
,
A.
(1991
). “
Proportional timing in speech motor control
,” J. Phon.
19
, 343
–350
.32.
Lombard
,
E.
(1911
). “
Le signe de l'élévation de la voix” (“The sign of the elevation of the voice”)
, Ann. Mal. l'Oreille, Larynx, Nez Pharynx
37
, 101
–119
.33.
Masapollo
,
M.
, and
Nittrouer
,
S.
(2021
). “
MIPA: A theory of phonological acquisition and speech motor control
,” J. Acoust. Soc. Am.
150
, A111
.34.
Masapollo
,
M.
, and
Nittrouer
,
S.
(2023
). “
Interarticulator speech coordination: Timing is of the essence
,” J. Speech Lang. Hear. Res.
66
, 901
–915
.35.
Masapollo
,
M.
,
Nittrouer
,
S.
,
Gendron
,
R.
,
Ménard
,
L.
, and
Ostry
,
D. J.
(submitted). “
Differential use of auditory feedback in the real-time control of speech movements by deaf talkers with cochlear implants and peers with normal-hearing
,” in 48th Annual MidWinter Meeting of the Association for Research in Otolaryngology
,
Orlando, FL
.36.
Max
,
L.
,
Caruso
,
A. J.
, and
Gracco
,
V. L.
(2003
). “
Kinematic analyses of speech, orofacial nonspeech, and finger movements in stuttering and nonstuttering adults
,” J. Speech Lang. Hear. Res.
46
(1
), 215
–232
.37.
Max
,
L.
,
Guenther
,
F. H.
,
Gracco
,
V. L.
,
Ghosh
,
S. S.
, and
Wallace
,
M. E.
(2004
). “
Unstable or insufficiently activated internal models and feedback-biased motor control as sources of dysfluency: A theoretical model of stuttering
,” Contemp. Issues Commun. Sci. Disord.
31
, 105
–122
.38.
Mixdorff
,
H.
,
Pech
,
U.
,
Davis
,
C.
, and
Kim
,
J.
(2007
). “
Map task dialogs in noise — a paradigm for examining Lombard speech
,” in XVI Meeting of the International Congress of Phonetic Sciences
,
Saarbrücken, Germany
, pp. 1329
–1332
.39.
Munhall
,
K.
(1985
). “
An examination of intra-articulator relative timing
,” J. Acoust. Soc. Am.
78
(5
), 1548
–1553
.40.
Nasir
,
S. M.
, and
Ostry
,
D. J.
(2008
). “
Speech motor learning in profoundly deaf adults
,” Nat. Neurosci.
11
(10
), 1217
–1222
.41.
Neto Henriques
,
R.
, and
van Lieshout
,
P.
(2013
). “
A comparison of methods for decoupling tongue and lower lip from jaw movements in 3D articulography
,” J. Speech Lang. Hear. Res.
56
(5
), 1503
–1516
.42.
Nittrouer
,
S.
(1991
). “
Phase relations of jaw and tongue tip movements in the production of VCV utterances
,” J. Acoust. Soc. Am.
90
, 1806
–1815
.43.
Nittrouer
,
S.
,
Munhall
,
K.
,
Kelso
,
A. S.
,
Tuller
,
B.
, and
Harris
,
K. S.
(1988
). “
Patterns of inter-articulator phasing and their relation to linguistic structure
,” J. Acoust. Soc. Am.
84
, 1653
–1660
.44.
Okalidou
,
A.
, and
Harris
,
K. S.
(1999
). “
A comparison of intergestural patterns in deaf and hearing adult speakers: Implications from an acoustic analysis of disyllables
,” J. Acoust. Soc. Am.
106
(1
), 394
–409
.45.
Perkell
,
J. S.
,
Guenther
,
F. H.
,
Lane
,
H.
,
Matthies
,
M. L.
,
Perrier
,
P.
,
Vick
,
J.
,
Wilhelms-Tricarico
,
R.
, and
Zandipour
,
M.
(2000
). “
A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss
,” J. Phon.
28
(3
), 233
–272
.46.
Perkell
,
J. S.
,
Lane
,
H.
,
Ghosh
,
S.
,
Matthies
,
M. L.
,
Tiede
,
M.
,
Guenther
,
F.
, and
Ménard
,
L.
(2008
). “
Mechanisms of vowel production: Auditory goals and speaker acuity
,” in Proceedings of the 8th International Seminar on Speech Production
, edited by
R.
Sock
,
S.
Fuchs
, and
Y.
Laprie
, pp. 29
–32
.47.
Popp
,
N. J.
,
Hernandez-Castillo
,
C. R.
,
Gribble
,
P. L.
, and
Diedrichsen
,
J.
(2022
). “
The role of feedback in the production of skilled finger sequences
,” J. Neurophysiol.
127
, 829
–839
.48.
Purcell
,
D. W.
, and
Munhall
,
K. G.
(2006
). “
Compensation following real-time manipulation of formants in isolated vowels
,” J. Acoust. Soc. Am.
119
, 2288
–2297
.49.
Rauschecker
,
J. P.
, and
Scott
,
S. K.
(2009
). “
Maps and streams in the auditory cortex: Nonhuman primates illuminate human speech processing
,” Nat. Neurosci.
12
(6
), 718
–724
.50.
Rebernik
,
T.
,
Jacobi
,
J.
,
Jonkers
,
R.
,
Noiray
,
A.
, and
Wieling
,
M.
(2021
). “
A review of data collection practices using electromagnetic articulography
,” Lab. Phonol.
12
, 6
.51.
Saltzman
,
E.
,
Lofqvist
,
A.
,
Kay
,
B.
,
Kinsella-Shaw
,
J.
, and
Rubin
,
P.
(1998
). “
Dynamics of intergestural timing: A perturbation study of lip-larynx coordination
,” Exp. Brain Res.
123
, 412
–424
.52.
Smith
,
A.
,
Sadagopan
,
N.
,
Walsh
,
B.
, and
Weber-Fox
,
C.
(2010
). “
Increasing phonological complexity reveals heightened instability in inter-articulatory coordination in adults who stutter
,” J. Fluency Disord.
35
(1
), 1
–18
.53.
Sorensen
,
T.
,
Toutios
,
A.
,
Goldstein
,
L.
, and
Narayanan
,
S.
(2019
). “
Task-dependence of articulator synergies
,” J. Acoust. Soc. Am.
145
(3
), 1504
–1520
.54.
Summers
,
W. V.
,
Pisoni
,
D. B.
,
Bernacki
,
R. H.
,
Pedlow
,
R. I.
, and
Stokes
,
M. A.
(1988
). “
Effects of noise on speech production: Acoustic and perceptual analyses
,” J. Acoust. Soc. Am.
84
, 917
–928
.55.
Sussman
,
H. M.
,
Byrd
,
C. T.
, and
Guitar
,
B.
(2011
). “
The integrity of anticipatory coarticulation in fluent and non-fluent tokens of adults who stutter
,” Clin. Linguist. Phon.
25
(3
), 169
–186
.56.
Tiede
,
M.
(2005
). “
MVIEW: Software for visualization and analysis of concurrently recorded movement data
,” (
Haskins Laboratory Report
,
New Haven, CT
).57.
Tiede
,
M.
(2010
). “
MVIEW: Multi-channel visualization application for displaying dynamic sensor movement
,” (
Haskins Laboratory Report
,
New Haven, CT
).58.
Tourville
,
J. A.
,
Reilly
,
K. J.
, and
Guenther
,
F. H.
(2008
). “
Neural mechanisms underlying auditory feedback control of speech
,” Neuroimage
39
, 1429
–1443
.59.
Tremblay
,
S.
,
Shiller
,
D. M.
, and
Ostry
,
D. J.
(2003
). “
Somatosensory basis of speech production
,” Nature
423
(6942
), 866
–869
.60.
Tuller
,
B.
, and
Kelso
,
A. S.
(1984
). “
The timing of articulatory gestures: Evidence for relational invariants
,” J. Acoust. Soc. Am.
76
, 1030
–1036
.61.
Tuller
,
B.
,
Kelso
,
A. S.
, and
Harris
,
K. S.
(1982
). “
Inter-articulator phasing as an index of temporal regularity in speech
,” J. Exp. Psychol. Hum. Percept. Perform.
8
, 460
–472
.62.
Tuller
,
B.
,
Kelso
,
A. S.
, and
Harris
,
K. S.
(1983
). “
Further evidence for the role of relative timing in speech: A reply to Barry
,” J. Exp. Psychol. Hum. Percept. Perform.
9
, 829
–833
.63.
Turgeon
,
C.
,
Trudeau-Fisette
,
P.
,
Fitzpatrick
,
E.
, and
Ménard
,
L.
(2017
). “
Vowel intelligibility in children with cochlear implants: An acoustic and articulatory study
,” Int. J. Pediatr. Otorhinolaryngol.
101
, 87
–96
.64.
Turk
,
A.
, and
Shattuck-Hufnagel
,
S.
(2020
). “
Speech timing: Implications for theories of phonology, phonetics, and speech motor control
,” in Oxford Studies in Phonology and Phonetics
(
Oxford University Press
,
Oxford
), Vol.
5
.65.
Weismer
,
G.
, and
Bunton
,
K.
(1999
). “
Influences of pellet markers on speech production behavior: Acoustical and perceptual measures
,” J. Acoust. Soc. Am.
105
, 2882
–2894
.66.
Westbury
,
J. R.
,
Lindstrom
,
M. J.
, and
McClean
,
M. D.
(2002
). “
Tongues and lips without jaws: A comparison of methods for decoupling speech movements
,” J. Speech Lang. Hear. Res.
45
, 651
–662
.© 2024 Acoustical Society of America.
2024
Acoustical Society of America
You do not currently have access to this content.