The three-volume set LNCS 12181, 12182, and 12183 constitutes the refereed proceedings of the Human Computer Interaction thematic area of the 22nd International Conference on Human-Computer Interaction, HCII 2020, which took place in Copenhagen, Denmark, in July 2020.* A total of 1439 papers and 238 posters have been accepted for publication in the HCII 2020 proceedings from a total of 6326 submissions. The 145 papers included in these HCI 2020 proceedings were organized in topical sections as follows: Part I: design theory, methods and practice in HCI; understanding users; usability, user experience and quality; and images, visualization and aesthetics in HCI. Part II: gesture-based interaction; speech, voice, conversation and emotions; multimodal interaction; and human robot interaction. Part III: HCI for well-being and Eudaimonia; learning, culture and creativity; human values, ethics, transparency and trust; and HCI in complex environments. *The conference was held virtually due to the COVID-19 pandemic.

"This book provides concepts, methodologies, and applications used to design and develop multimodal systems"--Provided by publisher.

Here is the third of a four-volume set that constitutes the refereed proceedings of the 12th International Conference on Human-Computer Interaction, HCII 2007, held in Beijing, China, in July 2007, jointly with eight other thematically similar conferences. It covers multimodality and conversational dialogue; adaptive, intelligent and emotional user interfaces; gesture and eye gaze recognition; and interactive TV and media.

The growing emphasis on multimodal interface design is fundamentally inspired by the aim to support natural, easy to learn and use, flexible, efficient, and powerfully expressive means of human-computer interaction. Most of the articles in this special issue present work in support of challenging applications such as algebra instruction, data summaries, and interaction with complex spatial displays. A collection of emerging research ideas on next-generation multimodal interfaces, it also addresses multimodal interface design for portable devices to be used in natural field settings. Additionally, it describes implemented systems that make computing accessible to the visually impaired.

The five-volume set LNCS 8004--8008 constitutes the refereed proceedings of the 15th International Conference on Human-Computer Interaction, HCII 2013, held in Las Vegas, NV, USA in July 2013. The total of 1666 papers and 303 posters presented at the HCII 2013 conferences was carefully reviewed and selected from 5210 submissions. These papers address the latest research and development efforts and highlight the human aspects of design and use of computing systems. The papers accepted for presentation thoroughly cover the entire field of human-computer interaction, addressing major advances in knowledge and effective use of computers in a variety of application areas. This volume contains papers in the thematic area of human-computer interaction, addressing the following major topics: speech, natural language and auditory interfaces; gesture and eye-gaze based Interaction; touch-based interaction; haptic interaction; graphical user interfaces and visualisation.

Advances in technology are enabling novel approaches to human-computer interaction (HCI) in a wide variety of devices and settings (e.g., the Microsoft® Surface, the Nintendo® Wii, iPhone®, etc.). While many of these devices have been commercially successful, the use of multimodal interaction technology is still not well understood from a more principled system design or cognitive science perspective. The long-term goal of our research is to build an intelligent multimodal interface for natural interaction that can serve as a testbed for enabling the formulation of a more principled system design framework for multimodal HCI. This thesis focuses on the gesture input modality. Using a new hand tracking technology capable of tracking 3D hand postures in real-time, we developed a recognition system for continuous natural gestures. By nature gestures, we mean the ones encountered in spontaneous interaction, rather than a set of artificial gestures designed for the convenience of recognition. To date we have achieved 96% accuracy on isolated gesture recognition, and 74% correct rate on continuous gesture recognition with data from different users and twelve gesture classes. We are able to connect the gesture recognition system with Google Earth, enabling gestural control of a 3D map. In particular, users can do 3D tilting of the map using non touch-based gesture which is more intuitive than touch-based ones. We also did an exploratory user study to observe natural behavior under a urban search and rescue scenario with a large tabletop display. The qualitative results from the study provides us with good starting points for understanding how users naturally gesture, and how to integrate different modalities. This thesis has set the stage for further development towards our long-term goal.

This book comprises a variety of breakthroughs and recent advances on Human– Computer Interaction (HCI) intended for both researchers and practitioners. Topics addressed here can be of interest for those people searching for last trends involving such a growing discipline. Important issues concerning this book includes cutti- edge topics such as Semantic Web Interfaces, Natural Language Processing and - bile Interaction, as well as new methodological trends such as Interface-Engineering techniques, User-Centred Design, Usability, Accessibility, Development Meth- ologiesandEmotionalUserInterfaces. Theideabehindthisbookistobringtogether relevant and novel research on diverse interaction paradigms. New trends are gu- anteedaccordingtothedemandingclaimsofbothHCIresearchersandpractitioners, which encourage the explicit arrangement of new industrial and technological topics such as the previously cited Interfaces for the Semantic Web, and Mobile Interfaces, but also Multimodal Interaction, Collaborative Interfaces, End-User Development, Usability and User Interface Engineering. Chapters included in this book comprise a selection of top high-quality papers from Interaccion ́ 2007, which is the most important HCI conference sponsored by AIPO (the Spanish HCI Association). Papers were selected from a ranking - tained through double-blind peer review and later meta-review processes, cons- ering the best evaluated paper from both the review and presentation session. Such a paper selection constitutes only 33% of the papers published in the conference proceedings. We would like to thank the reviewers for their effort in revising the chapters included in this publication, namely Silvia T. Acuna, ̃ Sandra Baldasarri, Crescencio Bravo, Cesar A.

Abstract: "Multimodal interaction is a way to make user interfaces natural and efficient with parallel and synergistic use of two or more input or output modalities. Two-handed interaction is a special case of multimodal interaction that makes use of both hands in a combined and coordinated manner. This dissertation gives a comprehensive survey on issues that are related to multimodal and two-handed interaction. Earlier work in human-computer interaction and related psychology is introduced within both these fields. The constructive part of this dissertation consists of designing and building a group of multimodal interaction techniques that were implemented in two research prototypes. The first prototype is an object-oriented drawing program that implements new tools that are controlled with two-handed input. The second prototype is a multimodal information kiosk that responds to both touch and speech input, and makes use of touch pressure sensing. In order to evaluate the success of constructive research, four empirical studies were conducted to compare the new interaction techniques to the conventional methods and to evaluate how the users react on them. The first of the studies compared a new direct manipulation tool to conventional menu and palette commands. The second evaluation was more informal and determined how an alternative way of drawing would be used by normal users. The third study was aimed at determining what is the best input device configuration to control the new tools. The last study evaluated different touch-based selection techniques in a multimodal touch and speech based information kiosk. The need for extensive interdisciplinary research is pointed out with a group of research questions that need to be answered to better understand multimodal human-computer interaction. The current knowledge only applies to a few special cases, and there is no unified modality theory of multimodal interaction that covers both input and output modalities."

Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.

The need for natural and effective Human-Computer Interaction (HCI) is increasingly important due to the prevalence of computers in human activities. Computer vision and pattern recognition continue to play a dominant role in the HCI realm. However, computer vision methods often fail to become pervasive in the field due to the lack of real-time, robust algorithms, and novel and convincing applications. This state-of-the-art contributed volume is comprised of articles by prominent experts in computer vision, pattern recognition and HCI. It is the first published text to capture the latest research in this rapidly advancing field with exclusive focus on real-time algorithms and practical applications in diverse and numerous industries, and it outlines further challenges in these areas. Real-Time Vision for Human-Computer Interaction is an invaluable reference for HCI researchers in both academia and industry, and a useful supplement for advanced-level courses in HCI and Computer Vision.