This book draws on visual data, ranging from advertisements to postage stamps to digital personal photography, to offer a complex interpretation of the different social functions realised by these texts as semiotic artefacts. Framed within the media environment of the city of Hong Kong, the study demonstrates the importance of social context to meaning making and social semiotic multimodal analysis. This book will be of interest to readers in the arts, humanities and social sciences, particularly within the fields of semiotics, visual studies, design studies, media and cultural studies, anthropology and sociology.

Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.

This collection brings together a range of perspectives on multimodal communication in intercultural interaction, bridging cognitive, social, and functional approaches towards promoting cross-disciplinary dialogues and taking research at the intersections of these fields into new directions. The volume assembles conversationalist, socially oriented, cognitive, and sensory approaches in considering culture as a dynamic construct, co-constituted and (re)negotiated among participants in interaction and filtering it through a multimodal lens, drawing on a range of examples, such as educational settings or online video platforms. Each chapter offers a unique perspective on "culture" and "intercultural," while also situating their own definitions of these labels against those of the other chapters. Taken together, the chapters form a fluid conversation on the nature of intercultural encounters in today’s globalizsd world, as digital environments intertwine with the physical mobility of people, encouraging researchers across these fields to adopt a more holistic multimodal perspective to approach intercultural interaction. This book will be of interest to students and scholars in intercultural communication, multimodality, sociolinguistics, cognitive and interactional linguistics, and semiotics.

Successful communication requires optimal relevance to a target audience. Relevance theory (RT) provides an excellent model based on this insight, but the impact of the theory has until now been restricted due to an almost exclusive focus on spoken face-to-face communication. Visual and Multimodal Communication: Applying the Relevance Principle is the first book to systematically demonstrate how RT can fulfill its promise to develop into an inclusive theory of communication. In this book, Charles Forceville refines and adapts RT's original claims to show its applicability to static visuals and multimodal discourses in popular culture genres. Using colorful examples, he explains how RT can be expanded and adapted to accommodate mass-communicative visual and visual-plus-verbal messages. Forceville addresses issues such as the difference between drawing prospective addressees' attention to a message and persuading them to accept it; the thorny continuum from implicit to explicit information; and the role of genre. Case studies of pictograms, advertisements, cartoons, and comics provide contemporary and accessible examples of the importance of genre and of how the RT model can be connected to other approaches. By expanding the application of relevance theory to include mass-communicative messages, Visual and Multimodal Communication reintroduces a central framework of cognitive linguistics and pragmatics to a new audience and paves the way for an inclusive theory of communication.

Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.

Multimodal approach to primate communication with focus on its cognitive foundations and how this relates to theories of language evolution.

This volume examines the role of multimodal augmentative and alternative communication (AAC) in supporting speech, language, and communication of individuals with Down syndrome, across the lifespan.

This state-of-the-art account of research and theorizing brings together multimodality, learning and communication through detailed analyses of signmakers and their meaning-making in museums, hospitals, schools and the home environment. By analyzing video recordings, photographs, screenshots and print materials, Jeff Bezemer and Gunther Kress go well beyond the comfortable domains of traditional sites of (social) semiotic and multimodal research. They steer away from spurious invention and naming of ever more new and exciting domains, focusing instead on fundamentals in assembling a set of tools for current tasks: namely, describing and analyzing learning and communication in the contemporary world as one integrated field. The theory outlined in the book is grounded in the findings of the authors’ wide-ranging empirical investigations. Each chapter evaluates the work that is being done and has been done, challenging accepted wisdom and standing much of it on its head. With extensive illustrations and many examples presented to show the reach and applicability of the theory, this book is essential reading for all those working in multimodality, semiotics, applied linguistics and related areas. Images from the book are also available to view online at www.routledge.com/9780415709620/

This highly readable book develops a numanistic, and specifically semiotic approach to multiculturalism. It reveals how semiotics provides fresh and valuable insights into multiculturalism: in contrast to the binary logic of dualistic philosophy, semiotic logic does not understand the value of truth in rigid terms of ‘true’ or ‘false’, ‘right’ or ‘wrong’ only. The value of truth resides in meaning, which is a dynamic, evolutionary phenomenon, rooted, nevertheless, in factuality. Drawing on recent developments in biosemiotics, the book presents a theoretical approach to multiculturalism, regarding the lives of people living in multicultural environments. Rather than analyzing political or economic phenomena, it offers a semiotic analysis of multiculturalism and discusses its educational implications. It also invites readers to regard learning as a phenomenon of ecological sign growth and to understand multiculturalism along the same lines. As such, it brings together the life and social sciences and the humanities in a unified perspective, in an approach fitting postmodernism. Developing a postmodern philosophy for contemporary non-experts, which allows distancing from political discourse in favor of a posthumanistic stand, where altruism is seen as an opportunity, not a threat, this book appeals to a wide readership, from scholars seeking state-of-the-art theories to general readers looking for a thought-provoking and enlightening read.

With the advance of speech, image and video technology, human-computer interaction (HCI) will reach a new phase.In recent years, HCI has been extended to human-machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters.The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface.