This study investigated the influence of visual speech information on perceptual processing of neurologically degraded speech. Fifty listeners identified spastic dysarthric speech under both audio (A) and audiovisual (AV) conditions. Condition comparisons revealed that the addition of visual speech information enhanced processing of the neurologically degraded input in terms of (a) acuity (percent phonemes correct) of vowels and consonants and (b) recognition (percent words correct) of predictive and nonpredictive phrases. Listeners exploited stress-based segmentation strategies more readily in AV conditions, suggesting that the perceptual benefit associated with adding visual speech information to the auditory signal—the AV advantage—has both segmental and suprasegmental origins. Results also revealed that the magnitude of the AV advantage can be predicted, to some degree, by the extent to which an individual utilizes syllabic stress cues to inform word recognition in AV conditions. Findings inform the development of a listener-specific model of speech perception that applies to processing of dysarthric speech in everyday communication contexts.
References
1.
Andersson
, U.
, Lyxell
, B.
, Rönnberg
, J.
, and Spens
, K. E.
(2001
). “Cognitive correlates of visual speech understanding in hearing-impaired individuals
,” J. Deaf Studies Deaf Educ.
6
(2
), 103
–116
.2.
Bernstein
, L. E.
, Demorest
, M. E.
, and Tucker
, P. E.
(2000
). “Speech perception without hearing
,” Percept. Psychophys.
62
(2
), 233
–252
.3.
Blamey
, P.
, Cowan
, R.
, Alcantara
, J.
, Whiteford
, L.
, and Clark
, G.
(1989
). “Speech perception using combinations of auditory, visual, and tactile information
,” J. Rehab. Res. Dev.
26
, 15
–24
.4.
Borrie
, S.
, McAuliffe
, M.
, Liss
, J.
, Kirk
, C.
, O'Beirne
, G.
, and Anderson
, T.
(2012a
). “Familiarisation conditions and the mechanisms that underlie improved recognition of dysarthric speech
,” Language Cognit. Process.
27
(7–8
), 1039
–1055
.5.
Borrie
, S.
, McAuliffe
, M.
, Liss
, J.
, O'Beirne
, G.
, and Anderson
, T.
(2012b
). “A follow-up investigation into the mechanisms that underlie improved recognition of dysarthric speech
,” J. Acoust. Soc. Am.
132
(2
), EL102
–EL108
.6.
Borrie
, S.
, McAuliffe
, M.
, Liss
, J.
, O'Beirne
, G.
, and Anderson
, T.
(2013
). “The role of linguistic and indexical information in improved recognition of dysarthric speech
,” J. Acoust. Soc. Am.
133
(1
), 474
–482
.7.
Burnham
, D.
, and Dodd
, B.
(2004
). “Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect
,” Dev. Psychobiol.
45
(4
), 204
–220
.8.
Cutler
, A.
, and Butterfield
, S.
(1992
). “Rhythmic cues to speech segmentation: Evidence from juncture misperception
,” J. Mem. Language
31
(2
), 218
–236
.9.
Darley
, F.
, Aronson
, A.
, and Brown
, J.
(1969a
). “Clusters of deviant speech dimensions in the dysarthrias
,” J. Speech Lang. Hear. Res.
12
, 462
–496
.10.
Darley
, F.
, Aronson
, A.
, and Brown
, J.
(1969b
). “Differential diagnosis patterns of dysarthria
,” J. Speech Lang. Hear. Res.
12
, 246
–269
.11.
Davis
, C.
, and Kim
, J.
(2004
). “Audio-visual interactions with intact clearly audible speech
,” Q. J. Exp. Psychol.
57
, 1103
–1121
.12.
Dickson
, S.
, Barbour
, R. S.
, Brady
, M.
, Clark
, A. M.
, and Paton
, G.
(2008
). “Patients' experiences of disruptions associated with post-stroke dysarthria
,” Int. J. Language Commun. Disord.
43
(2
), 135
–153
.13.
Evitts
, P. M.
, Portugal
, L.
, Van Dine
, A.
, and Holler
, A.
(2010
). “Effects of audio-visual information on the intelligibility of alaryngeal speech
,” J. Commun. Disord.
43
(2
), 92
–104
.14.
Fraser
, S.
, Gagné
, J.-P.
, Alepins
, M.
, and Dubois
, P.
(2010
). “Evaluating the effort expended to understand speech in noise using a dual-task paradigm: The effects of providing visual speech cues
,” J. Speech Lang. Hear. Res.
53
(1
), 18
–33
.54.
Garcia
, J. M.
, and Dagenais
, P.
(1998
). “Dysarthric sentence intelligibility: Contribution of iconic gestures and message predictiveness
,” J. Speech Lang. Hear. Res.
41
, 1282
–1293
.15.
Garcia
, J. M.
, Dagenais
, P. A.
, Terrel
, P.
, and Mallory
, A.
(1992
). “Normal and dysarthric speech intelligibility using audio versus videotaped presentation
,” in Annual Convention of the American Speech-Language-Hearing Association
, San Antonio, TX.16.
Grant
, K.
, and Seitz
, P.
(1998
). “Measures of auditory-visual integration in nonsense syllables and sentences
,” J. Acoust. Soc. Am.
104
(4
), 2438
–2450
.17.
Grant
, K.
, and Seitz
, P.
(2000
). “The use of visible speech cues for improving auditory detection of spoken sentences
,” J. Acoust. Soc. Am.
108
(3
), 1197
–1208
.18.
Grant
, K.
, Walden
, B. E.
, and Seitz
, P.
(1998
). “Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration
,” J. Acoust. Soc. Am.
103
(5
), 2677
–2690
.19.
Helfer
, K. S.
(1997
). “Auditory and auditory-visual perception of clear and conversational speech
,” J. Speech Lang. Hear. Res.
40
(2
), 432
–443
.20.
Humes
, L.
, Lee
, J.
, and Coughlin
, M.
(2006
). “Auditory measures of selective and divided attention in young and older adults using single-talker competition
,” J. Acoust. Soc. Am.
120
, 2926
–2937
.21.
Hunter
, L.
, Pring
, T.
, and Martin
, S.
(1991
). “The use of strategies to increase speech intelligibility in cerebral palsy: An experimental evaluation
,” Br. J. Disord. Commun.
26
, 163
–174
.22.
Hustad
, K. C.
, and Cahill
, M.
(2003
). “Effects of presentation mode and repeated familiarization on intelligibility of dysarthric speech
,” Am. J. Speech Lang. Pathol.
12
(2
), 198
–208
.53.
Hustad
, K. C.
, Dardis
, C. M.
, and McCourt
, K. A.
(2007
). “Effects of visual information on intelligibility of open and closed class words in predictable sentences produced by speakers with dysarthria
,” Clin. Linguist. Phon.
21
(5
), 353
–367
.23.
Jesse
, A.
, and Janse
, E.
(2012
). “Audiovisual benefit for recognition of speech presented with single-talker noise in older listeners
,” Language Cognit. Processes
27
, 1167
–1191
.24.
Jesse
, A.
, and Massaro
, D.
(2010
). “The temporal distribution of information in audiovisual spoken-word identification
,” Atten Percept. Psychophys.
72
, 209
–225
.25.
Jesse
, A.
, and McQueen
, J. M.
(2014
). “Suprasegmental lexical stress cues in visual speech can guide spoken-word recognition
,” Q. J. Exp. Psychol.
67
(4
), 793
–808
.26.
Jordan
, T. R.
, and Sergeant
, P.
(2000
). “Effects of distance on visual and audiovisual speech recognition
,” Language Speech
41
(1
), 107
–124
.27.
Keintz
, C. K.
, Bunton
, K.
, and Hoit
, J. D.
(2007
). “Influence of visual information on the intelligibility of dysarthric speech
,” Am. J. Speech Language Pathol.
16
(3
), 222
–234
.28.
Klasner
, E. R.
, and Yorkston
, K. M.
(2005
). “Speech intelligibility in ALS and HD dysarthria: The everyday listener's perspective
,” J. Med. Speech Language Pathol.
13
(2
), 127
–139
.29.
Klucharev
, V.
, Mottonen
, R.
, and Sams
, M.
(2003
). “Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception
,” Cognit. Brain Res.
18
(1
), 65
–75
.31.
Lansing
, C. R.
, and McConkie
, G. W.
(1994
). “A new method for speech reading research: Eyetracking observers' eye movements
,” J. Acad. Rehab. Audiol.
27
, 25
–43
.32.
Lansing
, C. R.
, and McConkie
, G. W.
(1999
). “Attention to facial regions in segmental and prosodic visual speech perception tasks
,” J. Speech Lang. Hear. Res.
42
(3
), 526
–539
.34.
Liss
, J.
, Spitzer
, S.
, Caviness
, J.
, Adler
, C.
, and Edwards
, B.
(1998
). “Syllabic strength and lexical boundary decisions in the perception of hypokinetic dysarthric speech
,” J. Acoust. Soc. Am.
104
(4
), 2457
–2466
.35.
Liss
, J.
, Spitzer
, S.
, Caviness
, J.
, Adler
, C.
, and Edwards
, B.
(2000
). “Lexical boundary error analysis in hypokinetic and ataxic dysarthria
,” J. Acoust. Soc. Am.
107
(6
), 3415
–3424
.37.
Marassa
, L.
, and Lansing
, C. R.
(1995
). “Visual word recognition in two facial motion conditions: Full-face versus lips-plus-mandible
,” J. Speech Hear. Res.
38
, 1387
–1394
.38.
Mattys
, S.
, Seymour
, F.
, Attwood
, A.
, and Munafò
, M.
(2013
). “Effects of acute anxiety induction on speech perception: Are anxious listeners distracted listeners?
,” Psychol. Sci.
24
(8
), 1606
–1608
.39.
Mattys
, S.
, White
, L.
, and Melhorn
, J. F.
(2005
). “Integration of multiple speech segmentation cues: A hierarchical framework
,” J. Exp. Psychol. Gen.
134
(4
), 477
–500
.40.
McGurk
, H.
, and MacDonald
, J.
(1976
). “Hearing lips and seeing voices
,” Nature
264
, 746
–748
.41.
Munhall
, K. G.
, Jones
, J. A.
, Callan
, D. E.
, Kuratate
, T.
, and Vatikiotis-Bateson
, E.
(2004
). “Visual prosody and speech intelligibility: Head movement improves auditory speech perception
,” Psychol. Sci.
15
(2
), 133
–137
.42.
Neurobehavioral Systems (
2014
). “Presentation® software (version 0.70) [computer program],” www.neurobs.com (Last viewed January 5, 2014).43.
Oden
, G.
, and Massaro
, D.
(1978
). “Integration of featural information in speech perception
,” Psychol. Rev.
85
, 172
–191
.44.
Preminger
, J.
, Lin
, H.
, Payen
, M.
, and Levitt
, H.
(1998
). “Selective masking in speechreading
,” J. Speech Hear. Res.
41
, 564
–575
.45.
Reynolds
, M.
, Fucci
, D.
, and Bond
, Z.
(1997
). “Effect of visual cuing on synthetic speech intelligibility: A comparison of native and nonnative speakers of English
,” Percept. Motor Skills
84
, 695
–698
.46.
Ross
, L.
, Saint-Amour
, D.
, Leavitt
, V.
, Javitt
, D.
, and Foze
, J.
(2007
). “Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments
,” Cereb. Cortex
17
, 1147
–1153
.47.
Rudner
, M.
, and Rönnberg
, J.
(2004
). “Perceptual saliency in the visual channel enhances explicit language processing
,” Iranian Audiol.
3
, 16
–26
.48.
Schumeyer
, R. P.
, and Barner
, K. E.
(1996
). “The effect of visual information on word initial consonant perception of dysarthric speech
,” in Proceeding of Fourth International Conference on Spoken Language Processing
(IEEE
, New York
), Vol. 1
, pp. 46
–49
.49.
Sumby
, W.
, and Pollack
, I.
(1954
). “Visual contribution to speech intelligibility in noise
,” J. Acoust. Soc. Am.
26
, 212
–215
.50.
Tun
, P.
, O'Kane
, G.
, and Wingfield
, A.
(2002
). “Distraction by competing speech in young and older adult listeners
,” Psychol. Aging
17
, 453
–467
.51.
Tun
, P.
, and Wingfield
, A.
(1999
). “One voice too many: Adult age differences in language processing with different types of distracting sounds
,” J. Gerontol. B
54
, P317
–P327
.52.
Weismer
, G.
(2006
). “Philosophy of research in motor speech disorders
,” Clin. Linguist. Phon.
20
(5
), 315
–349
.© 2015 Acoustical Society of America.
2015
Acoustical Society of America
You do not currently have access to this content.