A given speech sound will be realized differently depending on the context in which it is produced. Listeners have been found to compensate perceptually for these coarticulatory effects, yet it is unclear to what extent this effect depends on actual production experience. In this study, whether changes in motor-to-sound mappings induced by adaptation to altered auditory feedback can affect perceptual compensation for coarticulation is investigated. Specifically, whether altering how the vowel [i] is produced can affect the categorization of a stimulus continuum between an alveolar and a palatal fricative whose interpretation is dependent on vocalic context is tested. It was found that participants could be sorted into three groups based on whether they tended to oppose the direction of the shifted auditory feedback, to follow it, or a mixture of the two, and that these articulatory responses, not the shifted feedback the participants heard, correlated with changes in perception. These results indicate that sensorimotor adaptation to altered feedback can affect the perception of unaltered yet coarticulatorily-dependent speech sounds, suggesting a modulatory role of sensorimotor experience on speech perception.
References
1.
Adank
, P.
, Hagoort
, P.
, and Bekkering
, H.
(2010
). “Imitation improves language comprehension
,” Psychol. Sci.
21
(12
), 1903
–1909
.2.
Adank
, P.
, Rueschemeyer
, S.-A.
, and Bekkering
, H.
(2013
). “The role of accent imitation in sensorimotor integration during processing of intelligible speech
,” Front. Hum. Neurosci.
7
, 634
.3.
Barr
, D. J.
, Levy
, R.
, Scheepers
, C.
, and Tily
, H. J.
(2013
). “Random effects structure for confirmatory hypothesis testing: Keep it maximal
,” J. Mem. Lang.
68
(3
), 255
–278
.4.
Bates
, D.
, Maechler
, M.
, Bolker
, B. M.
, and Walker
, S.
(2015
). “lme4: Linear mixed-effects models using Eigen and S4
,” J. Stat. Softw.
67
(1
), 1
–48
.5.
Bell-Berti
, F.
, and Krakow
, R. A.
(1991
). “Anticipatory velar lowering: A coproduction account
,” J. Acoust. Soc. Am.
90
(1
), 112
–123
.6.
Blumstein
, S. E.
, and Stevens
, K. N.
(1981
). “Phonetic features and acoustic invariance in speech
,” Cognition
10
(1-3
), 25
–32
.7.
Boersma
, P.
, and Weenink
, D.
(2013
). “Praat: Doing phonetics by computer
” [computer program], version 5.0.1, http://www.praat.org/ (Last viewed 9/12/2016).8.
Bradlow
, A. R.
, Pisoni
, D. B.
, Akahane-Yamada
, R.
, and Tohkura
, Y.
(1997
). “Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production
,” J. Acoust. Soc. Am.
101
(4
), 2299
–2310
.9.
Breslow
, N. E.
, and Clayton
, D. G.
(1993
). “Approximate inference in generalized linear mixed models
,” J. Am. Stat. Assoc.
88
(421
), 9
–25
.10.
Cai
, S.
, Ghosh
, S. S.
, Guenther
, F. H.
, and Perkell
, J. S.
(2010
). “Adaptive auditory feedback control of the production of formant trajectories in the Mandarin triphthong /iau/ and its pattern of generalization
,” J. Acoust. Soc. Am.
128
(4
), 2033
–2048
.11.
Casserly
, E. D.
, and Pisoni
, D. B.
(2010
). “Speech perception and production
,” WIREs Cogn. Sci.
1
(5
), 629
–647
.12.
Dutoit
, T.
, Pagel
, V.
, Pierret
, N.
, Bataille
, F.
, and van der Vrecken
, O.
(1996
). “The MBROLA project: Towards a set of high quality speech synthesizers free of use for non commercial purposes
,” in Proceedings of the Fourth International Conference on Spoken Language Processing. ICSLP'96
, IEEE, Philadelphia, PA
, Vol. 3
, pp. 1393
–1396
.13.
Eimas
, P. D.
, and Corbit
, J. D.
(1973
). “Selective adaptation of linguistic feature detectors
,” Cogn. Psychol.
4
(1
), 99
–109
.14.
Eisner
, F.
, and McQueen
, J. M.
(2006
). “Perceptual learning in speech: Stability over time
,” J. Acoust. Soc. Am.
119
(4
), 1950
–1953
.15.
Elman
, J. L.
, and McClelland
, J. L.
(1988
). “Cognitive penetration of the mechanisms of perception: Compensation for coarticulation of lexically restored phonemes
,” J. Mem. Lang.
27
(2
), 143
–165
.16.
Flagg
, E. J.
, Oram Cardy
, J. E.
, and Roberts
, T. P.
(2006
). “MEG detects neural consequences of anomalous nasalization in vowel-consonant pairs
,” Neurosci. Lett.
397
(3
), 263
–268
.17.
Fowler
, C. A.
(1986
). “An event approach to the study of speech perception from a direct-realist perspective
,” J. Phon.
14
, 3
–28
.18.
Fowler
, C. A.
(2006
). “Compensation for coarticulation reflects gesture perception, not spectral contrast
,” Percept. Psychophys.
68
(2
), 161
–177
.19.
Fowler
, C. A.
, and Brown
, J. M.
(2000
). “Perceptual parsing of acoustic consequences of velum lowering from information for vowels
,” Percept. Psychophys.
62
(1
), 21
–32
.20.
Hickok
, G.
, Houde
, J.
, and Rong
, F.
(2011
). “Sensorimotor integration in speech processing: Computational basis and neural organization
,” Neuron
69
(3
), 407
–422
.21.
Holt
, L. L.
(2005
). “Temporally nonadjacent nonlinguistic sounds affect speech categorization
,” Psychol. Sci.
16
(4
), 305
–312
.22.
Houde
, J. F.
, and Jordan
, M. I.
(1998
). “Sensorimotor adaptation in speech production
,” Science
279
(5354
), 1213
–1216
.23.
Houde
, J. F.
, and Jordan
, M. I.
(2002
). “Sensorimotor adaptation of speech I: Compensation and adaptation
,” J. Speech Lang. Hear. Res.
45
(2
), 295
–310
.24.
Houde
, J. F.
, and Nagarajan
, S. S.
(2011
). “Speech production as state feedback control
,” Front. Hum. Neurosci.
5
, 82
.25.
Jaeger
, T. F.
(2008
). “Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models
,” J. Mem. Lang.
59
(4
), 434
–446
.26.
Jones
, J. A.
, and Munhall
, K. G.
(2005
). “Remapping auditory-motor representations in voice production
,” Curr. Biol.
15
(19
), 1768
–1772
.27.
Katseff
, S.
, Houde
, J.
, and Johnson
, K.
(2012
). “Partial compensation for altered auditory feedback: A tradeoff with somatosensory feedback?
,” Lang. Speech
55
(2
), 295
–308
.28.
Kraljic
, T.
, and Samuel
, A. G.
(2005
). “Perceptual learning for speech: Is there a return to normal?
,” Cogn. Psychol.
51
(2
), 141
–178
.29.
Kunisaki
, O.
, and Fujisaki
, H.
(1977
). “On the influence of context upon perception of voiceless fricative consonants
,” Ann. Bull. Res. Inst. Logoped. Phoniatr., Univ. Tokyo
11
, 85
–91
.30.
Lametti
, D. R.
, Krol
, S. A.
, Shiller
, D. M.
, and Ostry
, D. J.
(2014a
). “Brief periods of auditory perceptual training can determine the sensory targets of speech motor learning
,” Psychol. Sci.
25
, 1325
–1336
.31.
Lametti
, D. R.
, Nasir
, S. M.
, and Ostry
, D. J.
(2012
). “Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback
,” J. Neurosci.
32
(27
), 9351
–9358
.32.
Lametti
, D. R.
, Rochet-Capellan
, A.
, Neufeld
, E.
, Shiller
, D. M.
, and Ostry
, D. J.
(2014b
). “Plasticity in the human speech motor system drives changes in speech perception
,” J. Neurosci.
34
, 10339
–10346
.33.
Liberman
, A.
, Delattre
, P.
, and Cooper
, F.
(1952
). “The role of selected stimulus-variables in the perception of the unvoiced stop consonants
,” Am. J. Psychol.
65
(4
), 497
–516
.34.
Liberman
, A. M.
, and Mattingly
, I. G.
(1985
). “The motor theory of speech perception revised
,” Cognition
21
(1
), 1
–36
.35.
Liberman
, M.
, and Mattingly
, I. G.
(1989
). “A specialization for speech perception
,” Science
243
(4890
), 489
–494
.36.
Liberman
, M.
, and Whalen
, D. H.
(2000
). “On the relation of speech to language
,” Trends Cogn. Sci.
4
, 187
–196
.37.
Liu
, R.
, and Holt
, L. L.
(2015
). “Dimension-based statistical learning of vowels
,” J. Exp. Psychol.: Human Percept. Perform.
41
(6
), 1783
–1798
.38.
Lotto
, A. J.
, and Kluender
, K. R.
(1998
). “General contrast effects in speech perception: Effect of preceding liquid on stop consonant identification
,” Percept. Psychophys.
60
(4
), 602
–619
.39.
MacDonald
, E. N.
, Purcell
, D. W.
, and Munhall
, K. G.
(2011
). “Probing the independence of formant control using altered auditory feedback
,” J. Acoust. Soc. Am.
129
(2
), 955
–965
.40.
Mann
, V.
, and Soli
, S. D.
(1991
). “Perceptual order and the effect of vocalic context of fricative perception
,” Percept. Psychophys.
49
(5
), 399
–411
.41.
Mann
, V. A.
, and Repp
, B. H.
(1980
). “Influence of vocalic context on perception of the [ʃ]-[s] distinction
,” Percept. Psychophys.
28
(3
), 213
–228
.42.
Mathworks
(2012
). “MATLAB and statistics toolbox
” [computer program].43.
Mattar
, A. A. G.
, Nasir
, S. M.
, Darainy
, M.
, and Ostry
, D. J.
(2011
). Enhancing Performance for Action and Perception—Multisensory Integration, Neuroplasticity and Neuroprosthetics, Part I, Vol. 191 of Progress in Brain Research
(Elsevier, Amsterdam
).44.
McQueen
, J. M.
(1991
). “The influence of the lexicon on phonetic categorization: Stimulus quality in word-final ambiguity
,” J. Exp. Psychol. Hum. Percept. Perform.
17
(2
), 433
–443
.45.
McQueen
, J. M.
, Cutler
, A.
, and Norris
, D.
(2006
). “Phonological abstraction in the mental lexicon
,” Cogn. Sci.
30
(6
), 1113
–1126
.46.
Mitsuya
, T.
, MacDonald
, E. N.
, Munhall
, K. G.
, and Purcell
, D. W.
(2015
). “Formant compensation for auditory feedback with English vowels
,” J. Acoust. Soc. Am.
138
(1
), 413
–424
.47.
Mitsuya
, T.
, MacDonald
, E. N.
, Purcell
, D. W.
, and Munhall
, K. G.
(2011
). “A cross-language study of compensation in response to real-time formant perturbation
,” J. Acoust. Soc. Am.
130
, 2978
–2986
.48.
Mitterer
, H.
, and Blomert
, L.
(2003
). “Coping with phonological assimilation in speech perception: Evidence for early compensation
,” Percept. Psychophys.
65
(6
), 956
–969
.49.
Nasir
, S. M.
, and Ostry
, D. J.
(2009
). “Auditory plasticity and speech motor learning
,” Proc. Natl. Acad. Sci. U.S.A.
106
(48
), 20470
–20475
.50.
Nittrouer
, S.
, and Studdert-Kennedy
, M.
(1987
). “The role of coarticulatory effects in the perception of fricatives by children and adults
,” J. Speech Lang. Hear. Res.
30
(3
), 319
–329
.51.
Niziolek
, C. A.
, and Guenther
, F. H.
(2013
). “Vowel category boundaries enhance cortical and behavioral responses to speech feedback alterations
,” J. Neurosci.
33
(29
), 12090
–12098
.52.
Niziolek
, C. A.
, Nagarajan
, S. S.
, and Houde
, J. F.
(2013
). “What does motor efference copy represent? Evidence from speech production
,” J. Neurosci.
33
(41
), 16110
–16116
.53.
Norris
, D.
, McQueen
, J. M.
, and Cutler
, A.
(2003
). “Perceptual learning in speech
,” Cogn. Psychol.
47
(2
), 204
–238
.54.
Nourouzpour
, N.
, Salomonczyk
, D.
, Cressman
, E. K.
, and Henriques
, D. Y. P.
(2015
). “Retention of proprioceptive recalibration following visuomotor adaptation
,” Exp. Brain Res.
233
(3
), 1019
–1029
.55.
Ostry
, D. J.
, Darainy
, M.
, Mattar
, A. A. G.
, Wong
, J.
, and Gribble
, P. L.
(2010
). “Somatosensory plasticity and motor learning
,” J. Neurosci.
30
(15
), 5384
–5393
.56.
Pardo
, J. S.
(2006
). “On phonetic convergence during conversational interaction
,” J. Acoust. Soc. Am.
119
(4
), 2382
–2393
.57.
Poeppel
, D.
, Idsardi
, W. J.
, and Van Wassenhove
, V.
(2008
). “Speech perception at the interface of neurobiology and linguistics
,” Philos. Trans. R. Soc. London B: Biol. Sci.
363
(1493
), 1071
–1086
.58.
Poeppel
, D.
, and Monahan
, P. J.
(2011
). “Feedforward and feedback in speech perception: Revisiting analysis by synthesis
,” Lang. Cogn. Process.
26
(7
), 935
–951
.59.
Purcell
, D. W.
, and Munhall
, K. G.
(2006
). “Adaptive control of vowel formant frequency: Evidence from real-time formant manipulation
,” J. Acoust. Soc. Am.
120
(2
), 966
–977
.60.
Quatieri
, T.
, and McAulay
, R. J.
(1986
). “Speech transformations based on a sinusoidal representation
,” IEEE Trans. (ASSP)
34
(6
), 1449
–1464
.61.
R Development Core Team
(2013
). R [computer program].62.
Reilly
, K. J.
, and Dougherty
, K. E.
(2013
). “The role of vowel perceptual cues in compensatory responses to perturbations of speech auditory feedback
,” J. Acoust. Soc. Am.
134
, 1314
–1323
.63.
Reinisch
, E.
, Wozny
, D. R.
, Mitterer
, H.
, and Holt
, L. L.
(2014
). “Phonetic category recalibration: What are the categories?
,” J. Phon.
45
, 91
–105
.64.
Repp
, B. H.
, and Mann
, V. A.
(1981
). “Perceptual assessment of fricative–stop coarticulation
,” J. Acoust. Soc. Am.
69
(4
), 1154
–1163
.65.
Samuel
, A. G.
, and Kraljic
, T.
(2009
). “Perceptual learning for speech
,” Atten. Percept. Psychophys.
71
(6
), 1207
–1218
.66.
Shiller
, D. M.
, Sato
, M.
, Gracco
, V. L.
, and Baum
, S. R.
(2009
). “Perceptual recalibration of speech sounds following speech motor learning
,” J. Acoust. Soc. Am.
125
, 1103
–1113
.67.
Villacorta
, V. M.
, Perkell
, J. S.
, and Guenther
, F. H.
(2007
). “Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception
,” J. Acoust. Soc. Am.
122
(4
), 2306
–2319
.69.
Viswanathan
, N.
, Magnuson
, J. S.
, and Fowler
, C. A.
(2010
). “Compensation for coarticulation: Disentangling auditory and gestural theories of perception of coarticulatory effects in speech
,” J. Exp. Psychol.: Human Percept. Perform.
36
(4
), 1005
–1015
.70.
Whalen
, D. H.
(1981
). “Effects of vocalic formant transitions and vowel quality on the English [s]–[îs] boundary
,” J. Acoust. Soc. Am.
69
(1
), 275
–282
.© 2017 Acoustical Society of America.
2017
Acoustical Society of America
You do not currently have access to this content.