The handbook of multimodal-multisensor interfaces : Foundations, user modeling, and common modality combinations Volume 1

This book Includes bibliographical references and an index.

Chapter 1. Theoretical foundations of multimodal interfaces and systems Chapter 2. The impact of multimodal-multisensory learning on human performance and brain activation patterns Chapter 3. Multisensory haptic interactions Chapter 4. A background perspective on touch as a multimodal (and multisensor) construct Chapter 5. Understanding and supporting modality choices Chapter 6. Using cognitive models to understand multimodal processes Chapter 7. Multimodal feedback in HCI: haptics, non-speech audio, and their applications Chapter 9. Gaze-informed multimodal interaction / Pernilla Qvarfordt Chapter 10. Multimodal speech and pen interfaces Chapter 11. Multimodal gesture recognition Chapter 12. Audio and visual modality combination in speech processing Applications

The content of this handbook would be most appropriate for graduate students, and of primary interest to students studying computer science and information technology, human-computer interfaces, mobile and ubiquitous interfaces, and related multidisciplinary majors. When teaching graduate classes with this book, whether in quarter or semester classes, we recommend initially requiring that students spend two weeks reading the introductory textbook, The Paradigm Shift to Multimodality in Contemporary Interfaces (Morgan Claypool, Human-Centered Interfaces Synthesis Series, 2015). This textbook is suitable for upper-division undergraduate and graduate students. With this orientation, a graduate class providing an overview of multimodal-multisensor interfaces then could select chapters from the handbook distributed across topics in the different sections.--