QuickFusion: Multimodal Fusion Without Time Thresholds

Sun, Y., Chen, F. and Chung, V.

Multimodal user interfaces can provide natural and efficient interaction between humans and machines in a number of applications. Multimodal fusion integrates information from multiple input channels. Many multimodal fusion approaches exploit the temporal characteristics of inputs to determine the completion of a user's turn and cause a delay in the system response. This paper proposes a multimodal fusion approach, QuickFusion, which utilises syntactic rather than the time-stamp information from inputs to determine the integrity of the inputs, thus avoiding the time delay in the multimodal fusion process. QuickFusion also helps to resolve input ambiguity.

Cite as: Sun, Y., Chen, F. and Chung, V. (2005). QuickFusion: Multimodal Fusion Without Time Thresholds. In Proc. NICTA-HCSNet Multimodal User Interaction Workshop, MMUI 2005, Sydney, Australia. CRPIT, 57. Chen, F. and Epps, J., Eds. ACS. 51-54.

(from crpit.com) (local if available)