This book shares the recent debates by systemic functional linguistics and other linguistic forums. Its principal focus is on how we use language to make meaning of the world, on how the systems and structures of the ideational function of language represent the realisation of our experiences of the world around us. The volume captures the endeavours of scholars working in different contexts, disciplines and languages around the world. Their contributions explore what underlies experiential and logical meaning-making through specific analyses of recently-created, contextually diverse, single texts or collections of texts, from mono- to multimodal texts. The issues addressed are: layers of meaning through the transitivity system; agency and subjectivity; what kinds of participants and circumstances are associated with various processes and how these vary across languages; new ways of researching and capturing the interaction of the experiential function with the other functions of language - interpersonal, textual and logical - in communicative contexts; how multimodality and new ways of modelling experience semiotically influence the work of linguists, linguistic description and application. The book displays the dynamic dialogue on theoretical and applied interests of scholars interested in functional linguistics and working in a wide range of academic contexts. At post-graduate level advanced students will benefit from new perspectives, the innovative thinking and research accounts that make up the collection. The papers highlight the flexibility of systemic functional linguistic approach and exemplify how it can offer deeper and further insights into potential ways of exploring meaning-making by drawing on recent seminal developments in ideation.

This edited volume provides research-based knowledge on the use, production and assessment of multimodal texts in the teaching and learning of English as an Additional Language (EAL). The book reflects growing interest in research on EAL, with increasing numbers of learners of English worldwide and the growing relevance of EAL to numerous education systems. The volume examines different aspects of English from a multimodal perspective, showcasing empirical research from across five continents and all three levels of education. Applying frameworks based on Multimodal Social Semiotics and Systemic Functional Linguistics, chapters focus on the use and affordances of multimodal texts in pedagogy, literature, culture, text production, assessment and curriculum development connected to EAL. Directing attention to the significance of modes beyond speech and writing in EAL, the volume provides a wide range of perspectives and experiences that can be applied more widely and inspire other practices in the global and diverse field of EAL teaching, learning and assessment. This collection will be of interest to scholars in multimodality, language education, and teacher education.

Society is characterized by a constant flow of multimodal products, which increasingly blur the lines between screen and reality, and audiovisual translation allows overcoming geographical and linguistic frontiers between small realities across the planet. However, research has long struggled to adapt its methodologies to effectively analyze such phenomena, and even more to scale its results through larger corpus analyses. Dora Renna proposes a pioneering framework, informed by the latest trends in audiovisual translation and multimodality and fit to achieve the complex task of operatively including multimodality in a rigorous corpus analysis of source and target versions of films characterized by language variation as a key element of character design. While language is at the core of her analysis, its role in the broader audiovisual context is explored thanks to a solid network of relations that shed light on linguistic and translational choices as well as on their implications. Framework and methodology are explained in detail and thoroughly applied to the case study to show how this perspective contributes to move a step forward in corpus-based audiovisual translation studies. The results obtained are unexpected and urge readers to overcome old attitudes towards audiovisual translation and multimodal corpora.

This accessible introduction to multimodality illuminates the potential of multimodal research for understanding the ways in which people communicate. Readers will become familiar with the key concepts and methods in various domains while learning how to engage critically with the notion of multimodality. The book challenges widely held assumptions about language and presents the practical steps involved in setting up a multimodal study, including: formulating research questions collecting research materials assessing and developing methods of transcription considering the ethical dimensions of multimodal research. A self-study guide is also included, designed as an optional stand-alone resource or as the basis for a short course. With a wide range of examples, clear practical support and a glossary of terms, Introducing Multimodality is an ideal reference for undergraduate and postgraduate students in multimodality, semiotics, applied linguistics and media and communication studies. Online materials, including colour images and more links to relevant resources, are available on the companion website at www.routledge.com/cw/jewitt and the Routledge Language and Communication Portal.

Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.

This book is based on contributions to the Seventh European Summer School on Language and Speech Communication that was held at KTH in Stockholm, Sweden, in July of 1999 under the auspices of the European Language and Speech Network (ELSNET). The topic of the summer school was "Multimodality in Language and Speech Systems" (MiLaSS). The issue of multimodality in interpersonal, face-to-face communication has been an important research topic for a number of years. With the increasing sophistication of computer-based interactive systems using language and speech, the topic of multimodal interaction has received renewed interest both in terms of human-human interaction and human-machine interaction. Nine lecturers contri buted to the summer school with courses on specialized topics ranging from the technology and science of creating talking faces to human-human communication, which is mediated by computer for the handicapped. Eight of the nine lecturers are represented in this book. The summer school attracted more than 60 participants from Europe, Asia and North America representing not only graduate students but also senior researchers from both academia and industry.

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

Translation and Multimodality: Beyond Words is one of the first books to explore how translation needs to be redefined and reconfigured in contexts where multiple modes of communication, such as writing, images, gesture, and music, occur simultaneously. Bringing together world-leading experts in translation theory and multimodality, each chapter explores important interconnections among these related, yet distinct, disciplines. As communication becomes ever more multimodal, the need to consider translation in multimodal contexts is increasingly vital. The various forms of meaning-making that have become prominent in the twenty-first century are already destabilising certain time-honoured translation-theoretic paradigms, causing old definitions and assumptions to appear inadequate. This ground-breaking volume explores these important issues in relation to multimodal translation with examples from literature, dance, music, TV, film, and the visual arts. Encouraging a greater convergence between these two significant disciplines, this text is essential for advanced students and researchers in Translation Studies, Linguistics, and Communication Studies.

Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.

The aim of this volume is to advance our theoretical and empirical understanding of the relationship between Multimodality and Cognitive Linguistics. The innovative nature of the volume in relation to those existing in the field lies in the fact that it brings together contributions from three of the main approaches dealing with Multimodality - Cognitive Linguistics and multimodal metaphors (Forceville & Urios Aparisi, 2009), social semiotics and systemic functional grammar and multimodal interactional analysis (Jewitt, 2009) -highlighting the importance of multimodal resources, and showing the close relationship between this field of study and Cognitive Linguistics applied to a variety of genres -ranging from comics, films, cartoons, picturebooks or visuals in tapestry to name a few. Originally published in Review of Cognitive Linguistics Vol. 11:2 (2013).