Audio-Visual Speech Processing: Progress and Challenges

Potamianos, G.

This keynote focuses on using visual channel information to improve automatic speech processing for human computer interaction. Two main issues are discussed: the extraction and representation of visual speech, as well as its fusion with traditional acoustic information. The talk mostly considers applying these techniques to automatic speech recognition, however additional areas of interest are also mentioned, for example audio-visual speech detection, enhancement, and synthesis, as well as speaker recognition. The state-of-the-art and remaining challenges in these areas are also discussed.

Cite as: Potamianos, G. (2006). Audio-Visual Speech Processing: Progress and Challenges. In Proc. HCSNet Workshop on the Use of Vision in Human-Computer Interaction, (VisHCI 2006), Canberra, Australia. CRPIT, 56. Goecke, R., Robles-Kelly, A. and Caelli, T., Eds. ACS. 5.

(from crpit.com) (local if available)