Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.

Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.

This accessible introduction to multimodality illuminates the potential of multimodal research for understanding the ways in which people communicate. Readers will become familiar with the key concepts and methods in various domains while learning how to engage critically with the notion of multimodality. The book challenges widely held assumptions about language and presents the practical steps involved in setting up a multimodal study, including: formulating research questions collecting research materials assessing and developing methods of transcription considering the ethical dimensions of multimodal research. A self-study guide is also included, designed as an optional stand-alone resource or as the basis for a short course. With a wide range of examples, clear practical support and a glossary of terms, Introducing Multimodality is an ideal reference for undergraduate and postgraduate students in multimodality, semiotics, applied linguistics and media and communication studies. Online materials, including colour images and more links to relevant resources, are available on the companion website at www.routledge.com/cw/jewitt and the Routledge Language and Communication Portal.

Beginning with theory, focusing on insider stories about modes, how they work, and how to work with them, then concluding with the implications and application of such information, this text brings the multiple modes together into an integrated theory of multimodality.

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

This volume focuses on the relationship between different modes in the emergence, diffusion, maintenance, and challenge of social meanings and institutions. The contributions demonstrate the potential of multimodal approaches to advance the design of rigorous methods of analysis for the study of multimodal communicative practices.

This edited volume provides research-based knowledge on the use, production and assessment of multimodal texts in the teaching and learning of English as an Additional Language (EAL). The book reflects growing interest in research on EAL, with increasing numbers of learners of English worldwide and the growing relevance of EAL to numerous education systems. The volume examines different aspects of English from a multimodal perspective, showcasing empirical research from across five continents and all three levels of education. Applying frameworks based on Multimodal Social Semiotics and Systemic Functional Linguistics, chapters focus on the use and affordances of multimodal texts in pedagogy, literature, culture, text production, assessment and curriculum development connected to EAL. Directing attention to the significance of modes beyond speech and writing in EAL, the volume provides a wide range of perspectives and experiences that can be applied more widely and inspire other practices in the global and diverse field of EAL teaching, learning and assessment. This collection will be of interest to scholars in multimodality, language education, and teacher education.

Multimodality in Writing attempts to generate and apply new theories, disciplines and methods to account for semiotic processes in texts and during text production. It thus showcases new directions in multimodal research and theorizing writing practices from a multimodal perspective. It explores texts, producers of texts, and readers of texts. It also focuses on teaching multimodal text production and writing pedagogy from different domains and disciplines, such as rhetoric and writing composition, architecture, mathematics, film-making, science and the newsroom. Multimodality in Writing explores the kinds of methodological approaches that can augment social semiotic approaches to analyzing and teaching writing, including rhetoric, Systemic Functional Linguistics, ethnographic approaches, and genre pedagogy. Much of the research shows how the regularities of modes and interest of sign makers are socially shaped to realize convention. Because of this, the approaches are strongly underpinned by social and cultural theories of representation and communication.

This volume explores the relationship between aesthetics and traditional multimodal communication to show how all semiotic resources, not just those situated within fine arts, have an aesthetic function. Bringing together contributions from an interdisciplinary group of researchers, the book meditates on the role of aesthetics in a broader range of semiotic resources, including urban spaces, blogs, digital scrapbooks, children’s literature, music, and online learning environments. The result is a comprehensive collection of new perspectives on how communication and aesthetics enrich and complement one another when meaning is made with semiotic resources, making this key reading for students and scholars in multimodality, fine arts, education studies, and visual culture.