This volume explores the universal mathematical properties underlying big language data and possible reasons why such properties exist, revealing how we may be unconsciously mathematical in our language use. These properties are statistical and thus different from linguistic universals that contribute to describing the variation of human languages, and they can only be identified over a large accumulation of usages. The book provides an overview of state-of-the art findings on these statistical universals and reconsiders the nature of language accordingly, with Zipf's law as a well-known example. The main focus of the book further lies in explaining the property of long memory, which was discovered and studied more recently by borrowing concepts from complex systems theory. The statistical universals not only possibly lie as the precursor of language system formation, but they also highlight the qualities of language that remain weak points in today's machine learning. In summary, this book provides an overview of language's global properties. It will be of interest to anyone engaged in fields related to language and computing or statistical analysis methods, with an emphasis on researchers and students in computational linguistics and natural language processing. While the book does apply mathematical concepts, all possible effort has been made to speak to a non-mathematical audience as well by communicating mathematical content intuitively, with concise examples taken from real texts.

Languages differ from one another in bewildering and seemingly arbitrary ways. For example, in English, the verb precedes the direct object ('understand the proof'), but in Japanese, the direct object comes first. In some languages, such as Mohawk, it is not even possible to establish a basic word order. Nonetheless, languages do share certain regularities in how they are structured and used. The exact nature and extent of these "language universals" has been the focus of much research and is one of the central explanatory goals in the language sciences. During the past 50 years, there has been tremendous progress, a few major conceptual revolutions, and even the emergence of entirely new fields. The wealth of findings and theories offered by the various language-science disciplines has made it more important than ever to work toward an integrated understanding of the nature of human language universals. This book is the first to examine language universals from a cross-disciplinary perspective. It provides new insights into long standing questions such as: What exactly defines the human capacity for language? Are there universal properties of human languages and, if so, what are they? Can all language universals be explained in the same way, or do some universals require different kinds of explanations from others? Language Universals is unique in starting with the assumption that the best way to approach these and related questions is through a dialogue between a wide range of disciplines, including linguistics, cognitive neuroscience, philosophy, computer science and biology.

This volume provides an up-to-date discussion of a foundational issue that has recently taken centre stage in linguistic typology and which is relevant to the language sciences more generally: To what extent can cross-linguistic generalizations, i.e. statistical universals of linguistic structure, be explained by the diachronic sources of these structures? Everyone agrees that typological distributions are the result of complex histories, as “languages evolve into the variation states to which synchronic universals pertain” (Hawkins 1988). However, an increasingly popular line of argumentation holds that many, perhaps most, typological regularities are long-term reflections of their diachronic sources, rather than being ‘target-driven’ by overarching functional-adaptive motivations. On this view, recurrent pathways of reanalysis and grammaticalization can lead to uniform synchronic results, obviating the need to postulate global forces like ambiguity avoidance, processing efficiency or iconicity, especially if there is no evidence for such motivations in the genesis of the respective constructions. On the other hand, the recent typological literature is equally ripe with talk of "complex adaptive systems", "attractor states" and "cross-linguistic convergence". One may wonder, therefore, how much room is left for traditional functional-adaptive forces and how exactly they influence the diachronic trajectories that shape universal distributions. The papers in the present volume are intended to provide an accessible introduction to this debate. Covering theoretical, methodological and empirical facets of the issue at hand, they represent current ways of thinking about the role of diachronic sources in explaining grammatical universals, articulated by seasoned and budding linguists alike.

A COMPANION TO CHOMSKY Widely considered to be one of the most important public intellectuals of our time, Noam Chomsky has revolutionized modern linguistics. His thought has had a profound impact upon the philosophy of language, mind, and science, as well as the interdisciplinary field of cognitive science which his work helped to establish. Now, in this new Companion dedicated to his substantial body of work and the range of its influence, an international assembly of prominent linguists, philosophers, and cognitive scientists reflect upon the interdisciplinary reach of Chomsky's intellectual contributions. Balancing theoretical rigor with accessibility to the non-specialist, the Companion is organized into eight sections—including the historical development of Chomsky's theories and the current state of the art, comparison with rival usage-based approaches, and the relation of his generative approach to work on linguistic processing, acquisition, semantics, pragmatics, and philosophy of language. Later chapters address Chomsky's rationalist critique of behaviorism and related empiricist approaches to psychology, as well as his insistence upon a "Galilean" methodology in cognitive science. Following a brief discussion of the relation of his work in linguistics to his work on political issues, the book concludes with an essay written by Chomsky himself, reflecting on the history and character of his work in his own words. A significant contribution to the study of Chomsky's thought, A Companion to Chomsky is an indispensable resource for philosophers, linguists, psychologists, advanced undergraduate and graduate students, and general readers with interest in Noam Chomsky's intellectual legacy as one of the great thinkers of the twentieth century.

Word Order Universals

An argument for, and account of linguistic universals in the morphology of comparison, combining empirical breadth and theoretical rigor. This groundbreaking study of the morphology of comparison yields a surprising result: that even in suppletion (the wholesale replacement of one stem by a phonologically unrelated stem, as in good-better-best) there emerge strikingly robust patterns, virtually exceptionless generalizations across languages. Jonathan David Bobaljik describes the systematicity in suppletion, and argues that at least five generalizations are solid contenders for the status of linguistic universals. The major topics discussed include suppletion, comparative and superlative formation, deadjectival verbs, and lexical decomposition. Bobaljik's primary focus is on morphological theory, but his argument also aims to integrate evidence from a variety of subfields into a coherent whole. In the course of his analysis, Bobaljik argues that the assumptions needed bear on choices among theoretical frameworks and that the framework of Distributed Morphology has the right architecture to support the account. In addition to the theoretical implications of the generalizations, Bobaljik suggests that the striking patterns of regularity in what otherwise appears to be the most irregular of linguistic domains provide compelling evidence for Universal Grammar. The book strikes a unique balance between empirical breadth and theoretical detail. The phenomenon that is the main focus of the argument, suppletion in adjectival gradation, is rare enough that Bobaljik is able to present an essentially comprehensive description of the facts; at the same time, it is common enough to offer sufficient variation to explore the question of universals over a significant dataset of more than three hundred languages.

This volume consists of papers presented at the Conference on Language Universals and Second Language Acquisition, University of Southern California, February 1982. Published with the papers are the remarks of the originally assigned discussants. The collection represents an important cross-fertilization between research in grammatical theory and in second language acquisition. Topics dealt with in a number of the papers include word order, markedness, core grammar, accessability hierarchies, and simplified registers. The range of universals discussed embraces phonology, syntax, semantics, and discourse. Universals are also considered with reference to ontology, psychological reality, and evaluation metrics.

This book explores issues at the core of modern linguistics and cognitive science. Why are all languages similar in some ways and in others utterly different? Why do languages change and change variably? How did the human capacity for language evolve, and how far did it do so as an innate ability? Simon Kirby looks at these questions from a broad perspective, arguing that they can (indeed must) be studied together. The author begins by examining how far the universal properties of language may be explained by examining the way it is used, and how far by the way it is structured. He then considers what insights may be gained by combining functional and formal approaches. In doing so he develops a way of treating language as an adaptive system, in which its communicative and formal roles are both crucial and complementary. In order to test the effectiveness of competing theories and explanations, Simon Kirby develops computational models to show what universals emerge given a particular theory of language use or acquisition. He presents here both the methodology and the results. Function, Selection, and Innateness is important for its argument, its methodology, and its conclusions. It is a powerful demonstration of the value of looking at language as an adaptive system and goes to the heart of current debates on the evolution and nature of language.

Morphological structures interact dynamically with lexical processing and storage, with the parameters of morphological typology being partly dependent on cognitive pathways for processing, storage and generalization of word structure, and vice versa. Bringing together a team of well-known scholars, this book examines the relationship between linguistic cognition and the morphological diversity found in the world's languages. It includes research from across linguistic and cognitive science sub-disciplines that looks at the nature of typological diversity and its relationship to cognition, touching on concepts such as complexity, interconnectedness within systems, and emergent organization. Chapters employ experimental, computational, corpus-based and theoretical methods to examine specific morphological phenomena, and an overview chapter provides a synthesis of major research trends, contextualizing work from different methodological and philosophical perspectives. Offering a novel perspective on how cognition contributes to our understanding of word structure, it is essential reading for psycholinguists, theoreticians, typologists, computational modelers and cognitive scientists.

The field of linguistic anthropology looks at human uniqueness and diversity through the lens of language, our species' special combination of art and instinct. Human language both shapes, and is shaped by, our minds, societies, and cultural worlds. This state-of-the-field survey covers a wide range of topics, approaches and theories, such as the nature and function of language systems, the relationship between language and social interaction, and the place of language in the social life of communities. Promoting a broad vision of the subject, spanning a range of disciplines from linguistics to biology, from psychology to sociology and philosophy, this authoritative handbook is an essential reference guide for students and researchers working on language and culture across the social sciences.