Computer science as an engineering discipline has been spectacularly successful. Yet it is also a philosophical enterprise in the way it represents the world and creates and manipulates models of reality, people, and action. In this book, Paul Dourish addresses the philosophical bases of human-computer interaction. He looks at how what he calls "embodied interaction"—an approach to interacting with software systems that emphasizes skilled, engaged practice rather than disembodied rationality—reflects the phenomenological approaches of Martin Heidegger, Ludwig Wittgenstein, and other twentieth-century philosophers. The phenomenological tradition emphasizes the primacy of natural practice over abstract cognition in everyday activity. Dourish shows how this perspective can shed light on the foundational underpinnings of current research on embodied interaction. He looks in particular at how tangible and social approaches to interaction are related, how they can be used to analyze and understand embodied interaction, and how they could affect the design of future interactive systems.

Leading international scholars provide a coherent framework for analyzing body movement and talk in the production of meaning.

The author discusses the existing theoretical approaches of semiotically informed research in HCI, what is useful and the limitations. He proposes a radical rethink to this approach through a re-evaluation of important semiotic concepts and applied semiotic methods. Using a semiotic model of interaction he explores this concept through several studies that help to develop his argument. He concludes that this semiotics of interaction is more appropriate than other versions because it focuses on the characteristics of interactive media as they are experienced and the way in which users make sense of them rather than thinking about interface design or usability issues.

The Routledge Companion to Embodied Music Interaction captures a new paradigm in the study of music interaction, as a wave of recent research focuses on the role of the human body in musical experiences. This volume brings together a broad collection of work that explores all aspects of this new approach to understanding how we interact with music, addressing the issues that have roused the curiosities of scientists for ages: to understand the complex and multi-faceted way in which music manifests itself not just as sound but also as a variety of cultural styles, not just as experience but also as awareness of that experience. With contributions from an interdisciplinary and international array of scholars, including both empirical and theoretical perspectives, the Companion explores an equally impressive array of topics, including: Dynamical music interaction theories and concepts Expressive gestural interaction Social music interaction Sociological and anthropological approaches Empowering health and well-being Modeling music interaction Music-based interaction technologies and applications This book is a vital resource for anyone seeking to understand human interaction with music from an embodied perspective.

This is the first book dedicated to the study of the complexities that arise in embodied interaction from the multiplicity of time-scales on which its component processes unfold. It shows in microscopic detail how people synchronize and sequence modal resources such as talk, gaze, gesture, and object-manipulation to accomplish social actions. The studies show that each of these resources has its own temporal trajectory, affordances and restrictions, which enable and constrain the fine-grained work of bodily self-organization and interaction with others. Focusing on extended interactional time scales, some of the contributors investigate ways in which larger interactional episodes and relationships between actions are brought about and how actions build on shared interactional histories. The book makes a strong case for the use of video in the study of social interaction. It proposes an enlarged vision of Conversation Analysis that puts the body and its interactive temporalities center stage.

This book describes research in all aspects of the design, implementation, and evaluation of embodied conversational agents as well as details of specific working systems. Embodied conversational agents are computer-generated cartoonlike characters that demonstrate many of the same properties as humans in face-to-face conversation, including the ability to produce and respond to verbal and nonverbal communication. They constitute a type of (a) multimodal interface where the modalities are those natural to human conversation: speech, facial displays, hand gestures, and body stance; (b) software agent, insofar as they represent the computer in an interaction with a human or represent their human users in a computational environment (as avatars, for example); and (c) dialogue system where both verbal and nonverbal devices advance and regulate the dialogue between the user and the computer. With an embodied conversational agent, the visual dimension of interacting with an animated character on a screen plays an intrinsic role. Not just pretty pictures, the graphics display visual features of conversation in the same way that the face and hands do in face-to-face conversation among humans. This book describes research in all aspects of the design, implementation, and evaluation of embodied conversational agents as well as details of specific working systems. Many of the chapters are written by multidisciplinary teams of psychologists, linguists, computer scientists, artists, and researchers in interface design. The authors include Elisabeth Andre, Norm Badler, Gene Ball, Justine Cassell, Elizabeth Churchill, James Lester, Dominic Massaro, Cliff Nass, Sharon Oviatt, Isabella Poggi, Jeff Rickel, and Greg Sanders.

Interaction design that entails a qualitative shift from a symbolic, language-oriented stance to an experiential stance that encompasses the entire design and use cycle. With the rise of ubiquitous technology, data-driven design, and the Internet of Things, our interactions and interfaces with technology are about to change dramatically, incorporating such emerging technologies as shape-changing interfaces, wearables, and movement-tracking apps. A successful interactive tool will allow the user to engage in a smooth, embodied, interaction, creating an intimate correspondence between users' actions and system response. And yet, as Kristina Höök points out, current design methods emphasize symbolic, language-oriented, and predominantly visual interactions. In Designing with the Body, Höök proposes a qualitative shift in interaction design to an experiential, felt, aesthetic stance that encompasses the entire design and use cycle. Höök calls this new approach soma design; it is a process that reincorporates body and movement into a design regime that has long privileged language and logic. Soma design offers an alternative to the aggressive, rapid design processes that dominate commercial interaction design; it allows (and requires) a slow, thoughtful process that takes into account fundamental human values. She argues that this new approach will yield better products and create healthier, more sustainable companies. Höök outlines the theory underlying soma design and describes motivations, methods, and tools. She offers examples of soma design “encounters” and an account of her own design process. She concludes with “A Soma Design Manifesto,” which challenges interaction designers to “restart” their field—to focus on bodies and perception rather than reasoning and intellect.

Taking a fresh look at the first two centuries of French colonialism in the Americas, this book answers the long-standing question of how and how well Indigenous Americans and the Europeans who arrived on their shores communicated with each other. French explorers and colonists in the sixteenth century noticed that Indigenous peoples from Brazil to Canada used signs to communicate. The French, in response, quickly embraced the nonverbal as a means to overcome cultural and language barriers. Celine Carayon's close examination of their accounts enables her to recover these sophisticated Native practices of embodied expressions. In a colonial world where communication and trust were essential but complicated by a multitude of languages, intimate and sensory expressions ensured that French colonists and Indigenous peoples understood each other well. Understanding, in turn, bred both genuine personal bonds and violent antagonisms. As Carayon demonstrates, nonverbal communication shaped Indigenous responses and resistance to colonial pressures across the Americas just as it fueled the imperial French imagination. Challenging the notion of colonial America as a site of misunderstandings and insurmountable cultural clashes, Carayon shows that Natives and newcomers used nonverbal means to build relationships before the rise of linguistic fluency--and, crucially, well afterward.

Today, people are in an era of digitally mediated Human-to-Human Interaction, which cannot provide full sensorial contact and therefore, emotions cannot be communicated completely. The intimate cover of the human body, i.e. garment is the interface, where many personal traits are embodied. With the improvements in textile and electronics industry, this embodiment can be carried on a higher level, where the garments become dynamic interfaces and extensions of the human body. This book consists of a research on skin, clothes and technology as extensions of human body, emotions, technology-mediated emotions and a design practice that explores the communicative level of wearable technology through turning it into a living surface, which can convert intangible data to tangible in order to provide an emotional communication. This book aims to show how Human-Technology interaction is carried into an alternative context, where technology dissolves in use and starts serving for enhancing HHI.

This book clarifies the role and relevance of the body in social interaction and cognition from an embodied cognitive science perspective. Theories of embodied cognition have during the last decades offered a radical shift in explanations of the human mind, from traditional computationalism, to emphasizing the way cognition is shaped by the body and its sensorimotor interaction with the surrounding social and material world. This book presents a theoretical framework for the relational nature of embodied social cognition, which is based on an interdisciplinary approach that ranges historically in time and across different disciplines. It includes work in cognitive science, artificial intelligence, phenomenology, ethology, developmental psychology, neuroscience, social psychology, linguistics, communication and gesture studies. The theoretical framework is illustrated by empirical work that provides some detailed observational fieldwork on embodied actions captured in three different episodes of spontaneous social interaction and cognition in situ. Furthermore, the theoretical contributions and implications of the study of embodied social cognition are discussed and summed up. Finally, the issue what it would take for an artificial system to be socially embodied is addressed and discussed, as well as the practical relevance for applications to artificial intelligence (AI) and socially interactive technology.