Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a “Moving” Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago

How people acquire and process information has been a fundamental question in psychology since its inception. Cognitive science has devoted much effort to addressing the question, but typically in the domain of vision. Auditory processing has generally received less extensive inquiry, whether in basic perceptual or cognitive psychology or in applied areas such as human factors. Moreover, even within the field of audition, higher-order auditory processes have received less study than such lower-level processes as loudness and pitch perception (Bregman, 1990; Plomp, 2002). Yet over the past two decades there has been a growing base of empirical research on auditory cognition and its role in human performance at work and in everyday life. I describe this work in this book. The notion that listening requires attention and that it can at times be a difficult undertaking is well known to the elementary school teacher. Less well appreciated is the effort that we adults must put forth to comprehend auditory information in our everyday lives. Auditory processing relies on mechanisms of the brain as well as the ear. Describing the mental effort involved in these interacting mechanisms is the primary purpose of this book--

This volume contains the papers presented at the 15th International Symposium on Hearing (ISH), which was held at the Hotel Regio, Santa Marta de Tormes, Salamanca, Spain, between 1st and 5th June 2009. Since its inception in 1969, this Symposium has been a forum of excellence for debating the neurophysiological basis of auditory perception, with computational models as tools to test and unify physiological and perceptual theories. Every paper in this symposium includes two of the following: auditory physiology, psychoph- ics or modeling. The topics range from cochlear physiology to auditory attention and learning. While the symposium is always hosted by European countries, p- ticipants come from all over the world and are among the leaders in their fields. The result is an outstanding symposium, which has been described by some as a “world summit of auditory research. ” The current volume has a bottom-up structure from “simpler” physiological to more “complex” perceptual phenomena and follows the order of presentations at the meeting. Parts I to III are dedicated to information processing in the peripheral au- tory system and its implications for auditory masking, spectral processing, and c- ing. Part IV focuses on the physiological bases of pitch and timbre perception. Part V is dedicated to binaural hearing. Parts VI and VII cover recent advances in und- standing speech processing and perception and auditory scene analysis. Part VIII focuses on the neurophysiological bases of novelty detection, attention, and learning.

Every day, we are beset by millions of sounds-ambient ones like the rumble of the train and the hum of air conditioner, as well as more pronounced sounds, such as human speech, music, and sirens. How do we know which sounds should startle us, which should engage us, and which should turn us off? Why do we often fall asleep on train rides or in the car? Is there really a musical note that can make you sick to your stomach? Why do city folks have trouble sleeping in the country, and vice versa?In this fascinating exploration, research psychologist and sound engineer Seth Horowitz shows how our sense of hearing manipulates the way we think, consume, sleep, and feel. Starting with the basics of the biology, Horowitz explains why we hear what we hear, and in turn, how we've learned to manipulate sound: into music, commercial jingles, car horns, and modern inventions like cochlear implants, ultrasound scans, and the mosquito ringtone. Combining the best parts of This is Your Brain on Music and The Emotional Brain, this book gives new insight into what really makes us tick.

The systematic scientific investigation of human perception began over 130 years ago, yet relatively little is known about how we identify complex patterns. A major reason for this is that historically, most perceptual research focused on the more basic processes involved in the detection and discrimination of simple stimuli. This work progressed in a connectionist fashion, attempting to clarify fundamental mechanisms in depth before addressing the more complex problems of pattern recognition and classification. This extensive and impressive research effort built a firm basis from which to speculate about these issues. What seemed lacking, however, was an overall characterization of the recognition problem – a broad theoretical structure to direct future research in this area. Consequently, our primary objective in this volume, originally published in 1981, was not only to review existing contributions to our understanding of classification and recognition, but to project fruitful areas and directions for future research as well. The book covers four areas: complex visual patterns; complex auditory patterns; multi-dimensional perceptual spaces; theoretical pattern recognition.

The job of any sensory system is to create objects in the world out of the incoming proximal stimulus energy. The energy is neutral; it does not specify the objects itself. Thus, sensory systems must abstract the energy that does specify objects and differentiate it from the noise energy. The perceptual variables that specify objects for both listening and looking become those of contrast and correlated change across space and time, so that perceiving occurs at several spatial and temporal scales in parallel. Given that the perceptual goals and perceptual variables are equivalent, the rules of perceiving will be the same for all senses. The goal of this book is to describe these conceptual similarities and differences between hearing and seeing. Although it is mathematical and conceptually analytical, the book does not make explicit use of advanced mathematical concepts. Each chapter combines information on hearing and seeing, and gives a detailed treatment of a small number of topics. The first three chapters present introductory information, including properties of auditory and visual worlds, how receptive fields are organized to pick out those properties, and whether the receptive fields are optimized to pick up the structure of the sensory world. Each subsequent chapter considers one type of perceptual element: texture, motion, contrast and noise, color, timbre, and object segmentation. Each type of perceptual situation is described as a problem of discovering the correlated energy, and the research presented focuses on how humans manage to perceive given the complicated set of skills required. This book is intended for use in upper-division undergraduate courses in perception and sensation, cognitive psychology, and neuroscience. It will fill the slot between textbooks that cover perception and sensory physiology and neuroscience, and more advanced monographs that cover one sense or topic in detail.

The study of mental imagery has been a central concern of modern psychology, but most of what we know concerns visual imagery. A number of researchers, however, have recently begun to explore auditory imagery; this foundation-level volume presents their work. The topics covered are diverse, a reflection of the fact that auditory imagery seems relevant to numerous research domains -- from the ordinary memory rehearsal of undergraduates to the delusional voices of schizophrenics, from music imagery to imagery for speech. The chapters also address the parallels (and contrasts) between visual and auditory imagery, the relations between "inner speech" and overt speech, and between the "inner ear" and actual hearing. This book provides a valuable resource for students in many areas: imagery, working memory, music, speech, auditory perception, schizophrenia, or deafness.

This revised and updated third edition describes the nature of sound, how sound is analyzed by the auditory system, and the rules and principles governing our interpretation of auditory input. It covers many topics including sound and the auditory system, locating sound sources, the basis for loudness judgments, perception of acoustic sequences, perceptual restoration of obliterated sounds, speech production and perception, and the relation of hearing to perception in general. Whilst keeping the consistent style of the previous editions, many new features have been added, including suggestions for further reading at the end of each chapter, a section on functional imaging of the brain, expanded information on pitch and infrapitch, and additional coverage of speech processing. Advanced undergraduate and graduate students interested in auditory perception, behavioral sciences, psychology, neurobiology, architectural acoustics, and the hearing sciences will find this book an excellent guide.