Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. This book examines how user models can be used to support such early evaluations in two ways: by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.

This book constitutes the refereed proceedings of the seven workshops co-located with the 14th International Conference on Practical Applications of Agents and Multi-Agent Systems, PAAMS 2016, held in Sevilla, Spain, in June 2016.The 37 full papers presented were carefully reviewed and selected from 77 submissions. The volume presents the papers that have been accepted for the following workshops: Workshop on Agents and Multi-Agent Systems for AAL and e-Health; Workshop on Agent-Based Solutions for Manufacturing and Supply Chain; Workshop on MAS for Complex Networks and Social Computation; Workshop on Decision Making in Dynamic Information Environments; Workshop on Intelligent Systems for Context-based Information Fusion; Workshop on Multi-Agent based Applications for Smart Grids and Sustainable Energy Systems; Workshop on Multiagent System based Learning Environments.

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

In Monitoring Adaptive Spoken Dialog Systems, authors Alexander Schmitt and Wolfgang Minker investigate statistical approaches that allow for recognition of negative dialog patterns in Spoken Dialog Systems (SDS). The presented stochastic methods allow a flexible, portable and accurate use. Beginning with the foundations of machine learning and pattern recognition, this monograph examines how frequently users show negative emotions in spoken dialog systems and develop novel approaches to speech-based emotion recognition using hybrid approach to model emotions. The authors make use of statistical methods based on acoustic, linguistic and contextual features to examine the relationship between the interaction flow and the occurrence of emotions using non-acted recordings several thousand real users from commercial and non-commercial SDS. Additionally, the authors present novel statistical methods that spot problems within a dialog based on interaction patterns. The approaches enable future SDS to offer more natural and robust interactions. This work provides insights, lessons and inspiration for future research and development, not only for spoken dialog systems, but for data-driven approaches to human-machine interaction in general.

The four-volume set LNCS 9296-9299 constitutes the refereed proceedings of the 15th IFIP TC13 International Conference on Human-Computer Interaction, INTERACT 2015, held in Bamberg, Germany, in September 2015. The 74 full and short papers and 4 organizational overviews, 2 panels, 6 tutorials, and 11 workshops included in the fourth volume are organized in topical sections on tangible and tactile interaction; tools for design; touch and haptic; user and task modelling; visualization; visualization 3D; visualization in virtual spaces; wearable computing; demonstrations; and interactive posters.

This book proposes a combination of cognitive modeling with model-based user interface development to tackle the problem of maintaining the usability of applications that target several device types at once (e.g., desktop PC, smart phone, smart TV). Model-based applications provide interesting meta-information about the elements of the user interface (UI) that are accessible through computational introspection. Cognitive user models can capitalize on this meta-information to provide improved predictions of the interaction behavior of future human users of applications under development. In order to achieve this, cognitive processes that link UI properties to usability aspects like effectiveness (user error) and efficiency (task completion time) are established empirically, are explained through cognitive modeling, and are validated in the course of this treatise. In the case of user error, the book develops an extended model of sequential action control based on the Memory for Goals theory and it is confirmed in different behavioral domains and experimental paradigms. This new model of user cognition and behavior is implemented using the MeMo workbench and integrated with the model-based application framework MASP in order to provide automated usability predictions from early software development stages on. Finally, the validity of the resulting integrated system is confirmed by empirical data from a new application, eliciting unexpected behavioral patterns.

This book explores novel aspects of social robotics, spoken dialogue systems, human-robot interaction, spoken language understanding, multimodal communication, and system evaluation. It offers a variety of perspectives on and solutions to the most important questions about advanced techniques for social robots and chat systems. Chapters by leading researchers address key research and development topics in the field of spoken dialogue systems, focusing in particular on three special themes: dialogue state tracking, evaluation of human-robot dialogue in social robotics, and socio-cognitive language processing. The book offers a valuable resource for researchers and practitioners in both academia and industry whose work involves advanced interaction technology and who are seeking an up-to-date overview of the key topics. It also provides supplementary educational material for courses on state-of-the-art dialogue system technologies, social robotics, and related research fields.

This book covers state-of-the-art topics on the practical implementation of Spoken Dialog Systems and intelligent assistants in everyday applications. It presents scientific achievements in language processing that result in the development of successful applications and addresses general issues regarding the advances in Spoken Dialog Systems with applications in robotics, knowledge access and communication. Emphasis is placed on the following topics: speaker/language recognition, user modeling / simulation, evaluation of dialog system, multi-modality / emotion recognition from speech, speech data mining, language resource and databases, machine learning for spoken dialog systems and educational and healthcare applications.

Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is presented which serves as a tool for classifying assessment and evaluation methods, for planning and interpreting evaluation experiments, and for estimating quality. A broad overview of parameters and evaluation methods is given, both on a system-component level and for a fully integrated system. Three experimental investigations illustrate the relationships between system characteristics and perceived quality. The resulting information is needed in all phases of system specification, design, implementation, and operation. Although Quality of Telephone-Based Spoken Dialogue Systems is written from the perspective of an engineer in telecommunications, it is an invaluable source of information for professionals in signal processing, communication acoustics, computational linguistics, speech and language sciences, human factor design and ergonomics