Multimodal and mobile interaction (mmi) - KAIN9M15

Goal(s)

Objectives: Presentation of elements of design and realization of multimodal and mobile interactive systems, allowing a user to communicate with systems in several ways (for example, speech and gesture) and interactive systems on mobile devices such as an iPhone. For multimodal interaction and mobile media, the course is about ergonomic design. Multimodality is presented as a vector of many innovative interaction techniques such as tangible interfaces (Embodied User Interface), interfaces on mobile media.
Skills targeted:

• Knowledge of interaction paradigms other than graphic interfaces
• Knowledge of design principles in mobile and multimodal interaction

Content(s)

1) Introduction: Mobile interaction
Taxonomy - Domain -Terminology - Challenges
2) Introduction: Multimodal
interaction
Terminology - Challenges
3) Examples of interactive systems
Application domains and interaction techniques
4) Design
Underlying concepts and design spaces
Actor of the selection of modalities and selection criteria
Characteristic of a modality
Composition of modalities
Rules of thumb, heuristics
5) Project: Design, development and evaluation of a multimodal/mobile version of the ECOM project (e-commerce).

Human-Computer Interaction: User centered design.