Speechreading by Humans and Machines: Models, Systems, and Applications

Передняя обложка
David G. Stork, Marcus E. Hennecke
Springer Science & Business Media, 1 сент. 1996 г. - Всего страниц: 686
This book is one outcome of the NATO Advanced Studies Institute (ASI) Workshop, "Speechreading by Man and Machine," held at the Chateau de Bonas, Castera-Verduzan (near Auch, France) from August 28 to Septem ber 8, 1995 - the first interdisciplinary meeting devoted the subject of speechreading ("lipreading"). The forty-five attendees from twelve countries covered the gamut of speechreading research, from brain scans of humans processing bi-modal stimuli, to psychophysical experiments and illusions, to statistics of comprehension by the normal and deaf communities, to models of human perception, to computer vision and learning algorithms and hardware for automated speechreading machines. The first week focussed on speechreading by humans, the second week by machines, a general organization that is preserved in this volume. After the in evitable difficulties in clarifying language and terminology across disciplines as diverse as human neurophysiology, audiology, psychology, electrical en gineering, mathematics, and computer science, the participants engaged in lively discussion and debate. We think it is fair to say that there was an atmosphere of excitement and optimism for a field that is both fascinating and potentially lucrative. Of the many general results that can be taken from the workshop, two of the key ones are these: • The ways in which humans employ visual image for speech recogni tion are manifold and complex, and depend upon the talker-perceiver pair, severity and age of onset of any hearing loss, whether the topic of conversation is known or unknown, the level of noise, and so forth.
 

Содержание

Psychology of Human Speechreading
xix
Word Recognition in Speechreading
17
Children with Hearing Loss Speechreading Skills
27
Differences in Visual Intelligibility Across Talkers
43
The Use of Auditory and Visual Information in Phonetic Perception
55
Bimodal Speech Perception A Progress Report
79
AuditoryVisual Speech Perception as a Direct Process The McGurk Effect in Infants and Across Languages
103
Seeing Brains Reading Speech A Review and Speculations
115
Talking Heads and Speech Recognisers That Can See The Computer Processing of Visual Speech Signals
351
Automatic Speechreading using Dynamic Contours
373
Active Shape Models for Visual Speech Feature Extraction
383
2D Deformable Models for Visual Speech Analysis
391
Fast Matching of a Dynamic Lip Model to Color Video Sequences under Regular Illumination Conditions
399
Towards a Robust Speechreading Dialog System
409
Robust Face Feature Analysis for Automatic Speachreading and Character Animation
425
Time Delay Neural Networks for Articulatory Estimation from Speech Suitable Subjective Evaluation Protocols
437

Perception of Conflicting AudioVisual Speech An Examination Across Spanish and German
135
AudioVisual Speech Perception Without Speech Cues A First Report
145
Perception of Synthetic Visual Speech
153
Homopheneity in Speechreading Effects of Phonemic Equivalence Classes on the Structure of the Lexicon
169
Aspects of Modality in AudioVisual Processes
179
Exploiting Sensor Fusion Architectures and Stimuli Complementarity in AV Speech Recognition
193
Does Movement on the Lips Mean Movement in the Mind?
211
The Dynamics of Audiovisual Behavior in Speech
221
Where and When are the Heard and Seen Speech Integrated Magnetoencephalographical MEG Studies
233
Multiphasic Analysis of the Basic Nature of Speechreading
239
How Can Coarticulation Models Account for Speech Sensitivity to AudioVisual Desynchronization?
247
Working Memory and Speechreading
257
Encoding of Visual Speaker Attributes and Recognition Memory for Spoken Words
275
A Study of the Semantic Memory Access by Perceptual Modalities with a Semantic Priming Experiment
283
Lips and Jaw Movements for Vowels and Consonants SpatioTemporal Characteristics and Bimodal Recognition Applications
291
Which Components of the Face Do Humans and Machines Best Speechread?
315
Speechreading by Machines
329
Visionary Speech Looking Ahead to Practical Speechreading Systems
331
Relations of Audio and Visual Speech Signals in a Physical Feature Space Implications for the HearingImpaired
445
On the Integration of Auditory and Visual Parameters in an HMMbased ASR
461
Channel Separability in the AudioVisual Integration of Speech A Bayesian Approach
473
Audiovisual Sensory Integration Using Hidden Markov Models
489
NeuralFuzzy Networks and Phonetic Feature Recognition as a Help for Speechreading
497
Rationale for PhonemeViseme Mapping and Feature Selection in Visual Speech Recognition
505
Panel discussions
517
Human Speechreading Learning and Psychophysics
519
Human Speechreading Psychology and Cognition
525
Sensory Integration by Humans and Machines
533
Databases Standards and Comparisons
541
Machine Recognition and Applications
549
Contributors
557
Patents
561
Bibliography
587
Author Index
669
Subject Index
677
Авторские права

Другие издания - Просмотреть все

Часто встречающиеся слова и выражения

Популярные отрывки

Стр. 622 - XD Huang, Y. Ariki, and MA Jack, 'Hidden Markov models for speech recognition,' Edinburgh University Press, 1990.
Стр. 662 - S. Ullman and R. Basri. Recognition by linear combinations of models.

Ссылки на эту книгу

Библиографические данные