What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

Brings together studies from language acquisition and developmental psychology. This title addresses topics such as: gesture use in prelinguistic infants with a focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics

This study investigates the richly diverse but integrated semiotic potential of storytelling. Unlike other interdisciplinary approaches to narrative studies which have privileged the study of words in storytelling, this unique collection provides a much needed analysis of how narrative operates using combinations of visual, typographic, aural, gestural and haptic resources. Although both multimodal theory and narrative studies have been invigorated by a variety of theoretical approaches, this volume seeks to avoid a single dominant paradigm. Instead, the contributors use literary criticism, linguistics and new media frameworks in a series of critical studies that are directly engaged with a range of multimodal stories. The contributors analyze works that include oral accounts of personal experience, opera, cartoons, print literature and new media forms of storytelling such as experimental digital fiction and fanfiction.

This book examines everyday stories of personal experience that are published online in contemporary forms of social media. Taking examples from discussion boards, blogs, social network sites, microblogging sites, wikis, collaborative and participatory storytelling projects, Ruth Page explores how new and existing narrative genres are being (re)shaped in different online contexts. The book shows how the characteristics of social media, which emphasize recency, interpersonal connection and mobile distribution, amplify or reverse different aspects of canonical storytelling. The new storytelling patterns which emerge provide a fresh perspective on some of the key concepts in narrative research: structure, evaluation and the location of speaker and audience in time and space. The online stories are profoundly social in nature, and perform important identity work for their tellers as they interact with their audiences - identities which range from celebrities in Twitter, cancer survivors in the blogosphere to creative writers convening storytelling projects or local histories. Stories and Social Media brings together the stories told in well-known sites like Facebook and lesser-known community archives, providing a landmark survey and critique of personal storytelling as it is being reworked online at the start of the 21st century.

Volume II of the handbook offers a unique collection of exemplary case studies. In five chapters and 99 articles it presents the state of the art on how body movements are used for communication around the world. Topics include the functions of body movements, their contexts of occurrence, their forms and meanings, their integration with speech, and how bodily motion can function as language. By including an interdisciplinary chapter on ‘embodiment’, volume II explores the body and its role in the grounding of language and communication from one of the most widely discussed current theoretical perspectives. Volume II of the handbook thus entails the following chapters: VI. Gestures across cultures, VII. Body movements: functions, contexts and interactions, VIII. Gesture and language, IX. Embodiment: the body and its role for cognition, emotion, and communication, X. Sign Language: Visible body movements as language. Authors include: Mats Andrèn, Richard Asheley, Benjamin Bergen, Ulrike Bohle, Dominique Boutet, Heather Brookes, Penelope Brown, Kensy Cooperrider, Onno Crasborn, Seana Coulson, James Essegby, Maria Graziano, Marianne Gullberg, Simon Harrison, Hermann Kappelhoff, Mardi Kidwell, Irene Kimbara, Stefan Kopp, Grigoriy Kreidlin, Dan Loehr, Irene Mittelberg, Aliyah Morgenstern, Rafael Nuñez, Isabella Poggi, David Quinto-Pozos, Monica Rector, Pio Enrico Ricci-Bitti, Göran Sonesson, Timo Sowa, Gale Stam, Eve Sweetser, Mark Tutton, Ipke Wachsmuth, Linda Waugh, Sherman Wilcox.

Kamishibai (paper-theater), a Japanese picture-storytelling medium, is gaining global interest as we move from a text-based culture to one that emphasizes multiple semiotic systems and performance. This is the first volume to explore the potential of kamishibai as a dynamic "new" interactive medium for teaching multimodal communication and shows how synchronizing oral, visual and gestural modes develops students’ awareness of all modes of communication as potential resources in their learning. By examining the multiple modes involved in kamishibai through actual student performances over several venues, this volume overturns commonly held expectations about literacy in the classroom and provides a critical perspective on assumptions about other media. It offers much-needed information about a medium that is attracting interest from educators, academics and artists worldwide.

The Routledge Handbook of Language and Media provides an accessible and comprehensive overview of state-of-the-art research in media linguistics. This handbook analyzes both language theory and practice, demonstrating the vital role of this research in understanding language use in society. With over thirty chapters contributed by leading academics from around the world, this handbook: addresses issues of language use, form, structure, ideology, practice, and culture in the context of both traditional and new communication media; investigates mediated language use in public spheres, organizations, and personal communication, including newspaper journalism, broadcasting, and social media; examines the interplay of language and media from both linguistic and media perspectives, discussing auditory and visual media and graphic modes, as well as language and gender, multilingualism, and language change; analyzes the advantages and shortcomings of current approaches within media linguistics research and outlines avenues for future research. The Routledge Handbook of Language and Media is a must-have survey of this key field, and is essential reading for those interested in media linguistics.

Transmedia Directors focuses on artist-practitioners who work across media, platforms and disciplines, including film, television, music video, commercials and the internet. Working in the age of media convergence, today's em/impresarios project a distinctive style that points toward a new contemporary aesthetics. The media they engage with enrich their practices – through film and television (with its potential for world-building and sense of the past and future), music video (with its audiovisual aesthetics and rhythm), commercials (with their ability to project a message quickly) and the internet (with its refreshed concepts of audience and participation), to larger forms like restaurants and amusement parks (with their materiality alongside today's digital aesthetics). These directors encourage us to reassess concepts of authorship, assemblage, transmedia, audiovisual aesthetics and world-building. Providing a vital resource for scholars and practitioners, this collection weaves together insights about artist-practitioners' collaborative processes as well as strategies for composition, representation, subversion and resistance.

Body and space refer to vital and interrelated dimensions in the experience of sounds and music. Sounds have an overwhelming impact on feelings of bodily presence and inform us about the space we experience. Even in situations where visual information is artificial or blurred, such as in virtual environments or certain genres of film and computer games, sounds may shape our perceptions and lead to surprising new experiences. This book discusses recent developments in a range of interdisciplinary fields, taking into account the rapidly changing ways of experiencing sounds and music, the consequences for how we engage with sonic events in daily life and the technological advancements that offer insights into state-of-the-art methods and future perspectives. Topics range from the pleasures of being locked into the beat of the music, perception–action coupling and bodily resonance, and affordances of musical instruments, to neural processing and cross-modal experiences of space and pitch. Applications of these findings are discussed for movement sonification, room acoustics, networked performance, and for the spatial coordination of movements in dance, computer gaming and interactive artistic installations.