Xuehua Xiang examines multimodal interaction in the marketplace in a multilingual town at the juncture of urbanization in Southern China. Using a collection of data that span nearly 20 years from ethnographic fieldwork, Language, Multimodal Interaction and Transaction: Studies of a Southern Chinese marketplace analyzes multimodal talk-in-interaction in the traditional marketplace as both an economic mechanism and a localized social space. Focusing on how buyers and sellers interact to complete transactions as marketplace shifts from sedimentations of road-side peddling to centralized built space and further to corporate e-commerce, Xiang takes into account the Janus nature of language as both incurring transaction costs and a powerful tool of information and control. By analyzing the socializing functions of language in the marketplace outside of and beyond economic dealings, the study additionally documents and depicts the roles of affect and morality in marketplace encounters. The study offers an overarching framework for future research on the mediating role of language and multimodal interaction in economic activities as well as on the interplay of information, knowledge, affect and morality in social encounters.

Provides a comprehensive and unique examination of global language learning outside of the formal school setting Authored by a prominent team of international experts in their respective fields, The Handbook of Informal Language Learning is a one-of-a-kind reference work and it is a timely and valuable resource for anyone looking to explore informal language learning outside of a formal education environment. It features a comprehensive collection of cutting edge research areas exploring the cultural and historical cases of informal language learning, along with the growing area of digital language learning, and the future of this relevant field in national development and language education. The Handbook of Informal Language Learning examines informal language learning from both theoretical and practical perspectives. Structured across six sections, chapters cover areas of motivation, linguistics, cognition, and multimodality; digital learning, including virtual contexts, gaming, fanfiction, vlogging, mobile devices, and nonformal programs; and media and live contact, including learning through environmental print, tourism/study abroad. The book also provides studies of informal learning in four national contexts, examines the integration of informal and formal classroom learning, and discusses the future of language learning from different perspectives. Edited by respected researchers of computer-mediated communication and second language learning and teacher education Features contributions by leading international scholars reaching out to a global audience Presents an exciting and progressive selection of chapters in a rapidly expanding field of research and teaching Provides a state-of-the-art collection of the theories, as well as the historical, cultural and international cases relating to informal language learning and its future in a digital age Covers 30 key topics that represent pioneering findings and new research The Handbook of Informal Language Learning is an essential resource for researchers, students, and professionals in the fields of language acquisition, English as a second language, and foreign language education.

Using Chinese Classics for Intercultural Communicative Competence presents new strategies and tools for integrating Mandarin language teaching with fostering intercultural competencies through contemporary, global lenses on Chinese classic texts. Chinese classic texts are canonical works in Chinese culture published before 1911. They offer a window into deeply held cultural values which learners of the Chinese language would benefit from studying to facilitate meaningful intercultural dialogues. With chapters covering classic Chinese texts, such as Journey to the West, Dream of the Red Chamber, and The Romance of the Three Kingdoms, this book will demonstrate the value, importance, and feasibility of teaching Chinese classic works for ICC development in the Chinese world language classroom, and equip teachers with carefully planned, classroom-tested lesson models that demonstrate the innovative, integrative models advocated in this book. This book will be valuable for pre- and in-service Mandarin Chinese teachers across various institutional settings at different levels, looking for ready materials and professional development resources. The book can also be used as core material for teacher training programs.

This book constitutes the thoroughly refereed post-proceedings of the First International Workshop on Machine Learning for Multimodal Interaction, MLMI 2004, held in Martigny, Switzerland in June 2004. The 30 revised full papers presented were carefully selected during two rounds of reviewing and revision. The papers are organized in topical sections on HCI and applications, structuring and interaction, multimodal processing, speech processing, dialogue management, and vision and emotion.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.

This book constitutes the thoroughly refereed post-proceedings of the 4th International Workshop on Machine Learning for Multimodal Interaction, MLMI 2007, held in Brno, Czech Republic, in June 2007. The 25 revised full papers presented together with 1 invited paper were carefully selected during two rounds of reviewing and revision from 60 workshop presentations. The papers are organized in topical sections on multimodal processing, HCI, user studies and applications, image and video processing, discourse and dialogue processing, speech and audio processing, as well as the PASCAL speech separation challenge.

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.

This book constitutes the thoroughly refereed post-proceedings of the Second International Workshop on Machine Learning for Multimodal Interaction held in July 2005. The 38 revised full papers presented together with two invited papers were carefully selected during two rounds of reviewing and revision. The papers are organized in topical sections on multimodal processing, HCI and applications, discourse and dialogue, emotion, visual processing, speech and audio processing, and NIST meeting recognition evaluation.

Here is the third of a four-volume set that constitutes the refereed proceedings of the 12th International Conference on Human-Computer Interaction, HCII 2007, held in Beijing, China, in July 2007, jointly with eight other thematically similar conferences. It covers multimodality and conversational dialogue; adaptive, intelligent and emotional user interfaces; gesture and eye gaze recognition; and interactive TV and media.