Biomechanical models of the oropharynx facilitate the study of speech function by providing information that cannot be directly derived from imaging data, such as internal muscle forces and muscle activation patterns. Such models, when constructed and simulated based on anatomy and motion captured from individual speakers, enable the exploration of inter-subject variability of speech biomechanics. These models also allow one to answer questions, such as whether speakers produce similar sounds using essentially the same motor patterns with subtle differences, or vastly different motor equivalent patterns. Following this direction, this study uses speaker-specific modeling tools to investigate the muscle activation variability in two simple speech tasks that move the tongue forward (/ə-ɡis/) vs backward (/ə-suk/). Three dimensional tagged magnetic resonance imaging data were used to inversely drive the biomechanical models in four English speakers. Results show that the genioglossus is the workhorse muscle of the tongue, with activity levels of 10% in different subdivisions at different times. Jaw and hyoid positioners (inferior pterygoid and digastric) also show high activation during specific phonemes. Other muscles may be more involved in fine tuning the shapes. For example, slightly more activation of the anterior portion of the transverse is found during apical than laminal /s/, which would protrude the tongue tip to a greater extent for the apical /s/.

1.
Anderson
,
P.
,
Harandi
,
N. M.
,
Moisik
,
S.
,
Stavness
,
I.
, and
Fels
,
S.
(
2015
). “
A comprehensive 3D biomechanically-driven vocal tract model including inverse dynamics for speech research
,” in
Proceedings of InterSpeech
, pp.
2395
2399
.
2.
Badin
,
P.
,
Bailly
,
G.
,
Reveret
,
L.
,
Baciu
,
M.
,
Segebarth
,
C.
, and
Savariaux
,
C.
(
2002
). “
Three-dimensional linear articulatory modeling of tongue, lips and face, based on MRI and video images
,”
J. Phon.
30
,
533
553
.
3.
Blemker
,
S. S.
,
Pinsky
,
P. M.
, and
Delp
,
S. L.
(
2005
). “
A 3D model of muscle reveals the causes of nonuniform strains in the biceps brachii
,”
J. Biomech.
38
,
657
665
.
4.
Boersma
,
P.
, and
Weenink
,
D.
(
2015
). “
Praat: Doing phonetics by computer [computer program]
,” Version 5.4.08, available at http://www.praat.org/ (Last viewed March 1, 2016).
5.
Buchaillard
,
S.
,
Perrier
,
P.
, and
Payan
,
Y.
(
2009
). “
A biomechanical model of cardinal vowel production: Muscle activations and the impact of gravity on tongue positioning
,”
J. Acoust. Soc. Am.
126
,
2033
2051
.
6.
Bucki
,
M.
,
Lobos
,
C.
, and
Payan
,
Y.
(
2010
). “
A fast and robust patient specific finite element mesh registration technique: Application to 60 clinical cases
,”
Med. Image Anal.
14
,
303
317
.
7.
Chen
,
M.
,
Lu
,
W.
,
Chen
,
Q.
,
Ruchala
,
K. J.
, and
Olivera
,
G. H.
(
2008
). “
A simple fixed-point approach to invert a deformation field
,”
Med. Phys.
35
,
81
88
.
8.
Dang
,
J.
, and
Honda
,
K.
(
2004
). “
Construction and control of a physiological articulatory model
,”
J. Acoust. Soc. Am.
115
,
853
870
.
9.
Dart
,
S.
(
1991
). “
Articulatory and acoustic properties of apical and laminal articulations
,” in UCLA Working Papers in Phonetics 79.
10.
Erdemir
,
A.
,
McLean
,
S.
,
Herzog
,
W.
, and
van den Bogert
,
A. J.
(
2007
). “
Model-based estimation of muscle forces exerted during movements
,”
Clin. Biomech.
22
,
131
154
.
11.
Fang
,
Q.
,
Fujita
,
S.
,
Lu
,
X.
, and
Dang
,
J.
(
2009
). “
A model-based investigation of activations of the tongue muscles in vowel production
,”
Acoust. Sci. Technol.
30
,
277
287
.
12.
Gérard
,
J. M.
,
Wilhelms-Tricarico
,
R.
,
Perrier
,
P.
, and
Payan
,
Y.
(
2003
). “
A 3D dynamical biomechanical tongue model to study speech motor control
,”
Recent Res. Dev. Biomech.
1
,
49
64
.
13.
Harandi
,
N. M.
,
Abugharbieh
,
R.
, and
Fels
,
S.
(
2014
). “
3D segmentation of the tongue in MRI: A minimally interactive model-based approach
,”
Comput. Methods Biomech. Biomed. Eng. Imag. Vis.
3
,
178
188
.
14.
Harandi
,
N. M.
,
Stavness
,
I.
,
Woo
,
J.
,
Stone
,
M.
,
Abugharbieh
,
R.
, and
Fels
,
S.
(
2015
). “
Subject-specific biomechanical modeling of the oropharynx: Towards speech production
,”
Comput. Methods Biomech. Biomed. Eng. Imaging Vis.
1
11
.
15.
Ho
,
A. K.
,
Nicosia
,
M. A.
,
Dietsch
,
A.
,
Pearson
,
W.
,
Rieger
,
J.
,
Solomon
,
N.
,
Stone
,
M.
,
Inamoto
,
Y.
,
Saitoh
,
E.
,
Green
,
S.
, and
Fels
,
S.
(
2014
). “
3D dynamic visualization of swallowing from multi-slice computed tomography
,” in ACM SIGGRAPH Posters, no. 103.
16.
Liu
,
X.
,
Abd-Elmoniem
,
K.
,
Stone
,
M.
,
Murano
,
E.
,
Zhuo
,
J.
,
Gullapalli
,
R. P.
, and
Prince
,
J. L.
(
2012
). “
Incompressible deformation estimation algorithm (IDEA) from tagged MR images
,”
IEEE Trans. Med. Imag.
31
,
326
340
.
17.
Lobos
,
C.
(
2012
). “
A set of mixed-elements patterns for domain boundary approximation in hexahedral meshes
,”
Stud. Health Technol. Inform.
184
,
268
272
.
18.
Masaki
,
S.
,
Tiede
,
M. K.
,
Honda
,
K.
,
Shimada
,
Y.
,
Fujimoto
,
I.
,
Nakamura
,
Y.
, and
Ninomiya
,
N.
(
1999
). “
MRI-based speech production study using a synchronized sampling method
,”
J. Acoust. Soc. Jpn.
20
,
375
379
.
19.
Miyawaki
,
O.
,
Hirose
,
H.
,
Ushijima
,
T.
, and
Sawashima
,
M.
(
1975
). “
A preliminary report on the electromyographic study of the activity of lingual muscles
,”
Ann. Bull. RILP
9
,
406
.
20.
Osman
,
N. F.
,
McVeigh
,
E. R.
, and
Prince
,
J. L.
(
2000
). “
Imaging heart motion using harmonic phase MRI
,”
IEEE Trans. Med. Imaging
19
,
186
202
.
21.
Parthasarathy
,
V.
,
Prince
,
J. L.
,
Stone
,
M.
,
Murano
,
E. Z.
, and
NessAiver
,
M.
(
2007
). “
Measuring tongue motion from tagged cine-MRI using harmonic phase (HARP) processing
,”
J. Acoust. Soc. Am.
121
,
491
504
.
22.
Perrier
,
P.
,
Payan
,
Y.
,
Zandipour
,
M.
, and
Perkell
,
J.
(
2003
). “
Influences of tongue biomechanics on speech movements during the production of velar stop consonants: A modeling study
,”
J. Acoust. Soc. Am.
114
,
1582
1599
.
23.
Reichard
,
R.
,
Stone
,
M.
,
Woo
,
J.
,
Murano
,
E.
, and
Prince
,
J. L.
(
2012
). “
Motion of apical and laminal /s/ in normal and post-glossectomy speakers
,”
J. Acoust. Soc. Am.
131
,
3346
3350
.
24.
Sánchez
,
C. A.
,
Stavness
,
I.
,
Lloyd
,
J. E.
, and
Fels
,
S.
(
2013
). “
Forward dynamics tracking simulation of coupled multibody and finite element models: Application to the tongue and jaw
,” in
Proceedings of CMBBE
, pp.
261
270
.
25.
Sharp
,
G. C.
,
Lee
,
S. W.
, and
Wehe
,
D. K.
(
2002
). “
ICP registration using invariant features
,”
IEEE Trans. Pattern Anal.
24
,
90
102
.
26.
Smith
,
A.
, and
Goffman
,
L.
(
1998
). “
Stability and patterning of speech movement sequences in children and adults
,”
J. Speech Lang. Hear. Res.
41
,
18
30
.
27.
Sokoloff
,
A. J.
, and
Deacon
,
T. W.
(
1992
). “
Musculotopic organization of the hypoglossal nucleus in the cynomolgus monkey, Macaca fascicularis
,”
J. Comp. Neurol.
324
,
81
93
.
28.
Stavness
,
I.
,
Lloyd
,
J. E.
, and
Fels
,
S.
(
2012
). “
Automatic prediction of tongue muscle activations using a finite element model
,”
J. Biomech.
45
,
2841
2848
.
29.
Stavness
,
I.
,
Lloyd
,
J. E.
,
Payan
,
Y.
, and
Fels
,
S.
(
2011
). “
Coupled hard-soft tissue simulation with contact and constraints applied to jaw-tongue-hyoid dynamics
,”
Int. J. Numer. Method Biomed. Eng.
27
,
367
390
.
30.
Stavness
,
I.
,
Nazari
,
M. A.
,
Flynn
,
C.
,
Perrier
,
P.
,
Payan
,
Y.
,
Lloyd
,
J. E.
, and
Fels
,
S.
(
2014a
). “
Coupled biomechanical modeling of the face, jaw, skull, tongue, and hyoid bone
,” in
3D Multiscale Physiological Human
, edited by
Magnenat-Thalmann
,
N.
,
Ratib
,
O.
, and
Choi
,
H. F.
(
Springer
,
London
), pp.
253
274
.
31.
Stavness
,
I.
,
Sánchez
,
C. A.
,
Lloyd
,
J. E.
,
Ho
,
A.
,
Wang
,
J.
,
Fels
,
S.
, and
Huang
,
D.
(
2014b
). “
Unified skinning of rigid and deformable models for anatomical simulations
,” in SIGGRAPH Asia Technical Briefs, pp.
9
.
32.
Stevens
,
K. N.
(
1989
). “
On the quantal nature of speech
,”
J. Phonetics
17
,
3
45
.
33.
Stone
,
M.
,
Epstein
,
M. A.
, and
Iskarous
,
K.
(
2004
). “
Functional segments in tongue movement
,”
Clin. Linguist. Phonet.
18
,
507
521
.
34.
Stone
,
M.
,
Rizk
,
S.
,
Woo
,
J.
,
Murano
,
E. Z.
,
Chen
,
H.
, and
Prince
,
J. L.
(
2012
). “
Frequency of apical and laminal /s/ in normal and post-glossectomy patients
,”
J. Med. Speech Lang. Pathol.
20
,
106
111
.
35.
Stone
,
M.
, and
Vatikiotis-Bateson
,
E.
(
1995
). “
Trade-offs in tongue, jaw and palate contributions to speech production
,”
J. Phonet.
23
,
81
100
.
36.
Stone
,
M.
,
Woo
,
J.
,
Lee
,
J.
,
Poole
,
T.
,
Seagraves
,
A.
,
Chung
,
M.
,
Kim
,
E.
,
Murano
,
E. Z.
,
Prince
,
J. L.
, and
Blemker
,
S. S.
(
2016
). “
Structure and variability in human tongue muscle anatomy
,”
Comput. Methods Biomech. Biomed. Eng. Imag. Vis.
1
9
.
37.
Takano
,
S.
, and
Honda
,
K.
(
2007
). “
An MRI analysis of the extrinsic tongue muscles during vowel production
,”
Speech Commun.
49
,
49
58
.
38.
Takemoto
,
H.
(
2001
). “
Morphological analyses of the human tongue musculature for three-dimensional modeling
,”
J. Speech Lang. Hear. Res.
44
,
95
107
.
39.
Vasconcelos
,
M. J.
,
Ventura
,
S. M.
,
Freitas
,
D. R.
, and
Tavares
,
J. M. R.
(
2012
). “
Inter-speaker speech variability assessment using statistical deformable models from 3.0 Tesla magnetic resonance images
,”
Proc. Inst. Mech. Eng. H
226
,
185
196
.
40.
Ventura
,
S. R.
,
Freitas
,
D. R.
,
Ramos
,
I. M. A.
, and
Tavares
,
J. M. R.
(
2013
). “
Morphologic differences in the vocal tract resonance cavities of voice professionals: An MRI-based study
,”
J. Voice
27
,
132
140
.
41.
Ventura
,
S. R.
,
Freitas
,
D. R.
, and
Tavares
,
J. M. R.
(
2009
). “
Application of MRI and biomedical engineering in speech production study
,”
Comput. Methods Biomech. Biomed. Eng.
12
,
671
681
.
42.
Vercauteren
,
T.
,
Pennec
,
X.
,
Perchant
,
A.
, and
Ayache
,
N.
(
2009
). “
Diffeomorphic demons: Efficient non-parametric image registration
,”
Neuroimage
45
,
S61
S72
.
43.
Vilkman
,
E.
,
Sonninen
,
A.
,
Hurme
,
P.
, and
Körkkö
,
P.
(
1996
). “
External laryngeal frame function in voice production revisited: A review
,”
J. Voice
10
,
78
92
.
44.
Woo
,
J.
,
Lee
,
J.
,
Murano
,
E. Z.
,
Xing
,
F.
,
Al-Talib
,
M.
,
Stone
,
M.
, and
Prince
,
J. L.
(
2015
). “
A high-resolution atlas and statistical model of the vocal tract from structural MRI
,”
Comput. Methods Biomech. Biomed. Eng. Imag. Vis.
3
,
47
60
.
45.
Woo
,
J.
,
Murano
,
E. Z.
,
Stone
,
M.
, and
Prince
,
J. L.
(
2012
). “
Reconstruction of high resolution tongue volumes from MRI
,”
IEEE Trans. Biomed. Eng.
59
,
3511
3524
.
46.
Wrench
,
A. A.
, and
Scobbie
,
J. M.
(
2011
). “
Very high frame rate ultrasound tongue imaging
,” in
Proceedings of ISSP
, pp.
155
162
.
47.
Xing
,
F.
,
Woo
,
J.
,
Murano
,
E. Z.
,
Lee
,
J.
,
Stone
,
M.
, and
Prince
,
J. L.
(
2013
). “
3D tongue motion from tagged and cine MR images
,” in
Proceedings of MICCAI
, pp.
41
48
.
48.
Xing
,
F.
,
Ye
,
C.
,
Woo
,
J.
,
Stone
,
M.
, and
Prince
,
J. L.
(
2015
). “
Relating speech production to tongue muscle compressions using tagged and high-resolution magnetic resonance imaging
,”
Proc. SPIE
2015
,
94131L1
94131L6
.
49.
Yoshida
,
K.
,
Takada
,
K.
,
Adachi
,
S.
, and
Sakuda
,
M.
(
1982
). “
Clinical science EMG approach to assessing tongue activity using miniature surface electrodes
,”
J. Dent. Res.
61
,
1148
1152
.
50.
Yushkevich
,
P. A.
,
Piven
,
J.
,
Hazlett
,
H. C.
,
Smith
,
R. G.
,
Ho
,
S.
,
Gee
,
J. C.
, and
Gerig
,
G.
(
2006
). “
User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability
,”
Neuroimage
31
,
1116
1128
.
51.
Zemlin
,
W. R.
(
1997
).
Speech and Hearing Science, Anatomy and Physiology
, 4th ed. (Pearson, Boston), pp.
277
295
.
You do not currently have access to this content.