Istituto di Scienza e Tecnologie dell'Informazione     
Mäntyjärvi J., Paternò F., Santoro C. Incorporating tilt-based interaction in multimodal user interfaces for mobile devices. Coninx Karin, Luyten Kris, Schneider Kevin A (eds.). (Lecture Notes in Computer Science, vol. 4385). Heidelberg: Springer Verlag, 2007.
Emerging ubiquitous environments raise the need to support multiple interaction modalities in diverse types of devices. Designing multimodal interfaces for ubiquitous environments using development tools creates challenges since target platforms support different resources and interfaces. Model-based approaches have been recognized as useful for managing the increasing complexity consequent to the many available interaction platforms. However, they have usually focused on graphical and/or vocal modalities. This paper presents a solution for enabling the development of tilt-based hand gesture and graphical modalities for mobile devices in a multimodal user interface development tool. The challenges related to developing gesture-based applications for various types of devices involving mobile devices are discussed in detail. The possible solution presented is based on a logical description language for hand-gesture user interfaces. Such language allows us to obtain a user interface implementation on the target mobile platform. The solution is illustrated with an example application that can be accessed from both the desktop and mobile device supporting tilt-based gesture interaction.
DOI: 10.1007/978-3-540-70816-2
Subject Multimodal User Interfaces
H.5.1 Multimedia Information Systems

Icona documento 1) Download Document PDF

Icona documento Open access Icona documento Restricted Icona documento Private


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional