Memory-Based Learning (MBL), one of the most influential machine learning paradigms, has been applied with great success to a variety of NLP tasks. This monograph describes the application of MBL to robust parsing. Robust parsing using MBL can provide added functionality for key NLP applications, such as Information Retrieval, Information Extraction, and Question Answering, by facilitating more complex syntactic analysis than is currently available. The text presupposes no prior knowledge of MBL. It provides a comprehensive introduction to the framework and goes on to describe and compare applications of MBL to parsing. Since parsing is not easily characterizable as a classification task, adaptations of standard MBL are necessary. These adaptations can either take the form of a cascade of local classifiers or of a holistic approach for selecting a complete tree.The text provides excellent course material on MBL. It is equally relevant for any researcher concerned with symbolic machine learning, Information Retrieval, Information Extraction, and Question Answering.

Memory-based language processing - a machine learning and problem solving method for language technology - is based on the idea that the direct reuse of examples using analogical reasoning is more suited for solving language processing problems than the application of rules extracted from those examples. This book discusses the theory and practice of memory-based language processing, showing its comparative strengths over alternative methods of language modelling. Language is complex, with few generalizations, many sub-regularities and exceptions, and the advantage of memory-based language processing is that it does not abstract away from this valuable low-frequency information. By applying the model to a range of benchmark problems, the authors show that for linguistic areas ranging from phonology to semantics, it produces excellent results. They also describe TiMBL, a software package for memory-based language processing. The first comprehensive overview of the approach, this book will be invaluable for computational linguists, psycholinguists and language engineers.

This book describes the framework of inductive dependency parsing, a methodology for robust and efficient syntactic analysis of unrestricted natural language text. Coverage includes a theoretical analysis of central models and algorithms, and an empirical evaluation of memory-based dependency parsing using data from Swedish and English. A one-stop reference to dependency-based parsing of natural language, it will interest researchers and system developers in language technology, and is suitable for graduate or advanced undergraduate courses.

Bilingual Sentence Processing

This text provides one of the broadest presentations of parallel processing available, including the structure of parallelprocessors and parallel algorithms. The emphasis is on mapping algorithms to highly parallel computers, with extensive coverage of array and multiprocessor architectures. Early chapters provide insightful coverage on the analysis of parallel algorithms and program transformations, effectively integrating a variety of material previously scattered throughout the literature. Theory and practice are well balanced across diverse topics in this concise presentation. For exceptional clarity and comprehension, the author presents complex material in geometric graphs as well as algebraic notation. Each chapter includes well-chosen examples, tables summarizing related key concepts and definitions, and a broad range of worked exercises. - Overview of common hardware and theoretical models, including algorithm characteristics and impediments to fast performance - Analysis of data dependencies and inherent parallelism through program examples, building from simple to complex - Graphic and explanatory coverage of program transformations - Easy-to-follow presentation of parallel processor structures and interconnection networks, including parallelizing and restructuring compilers - Parallel synchronization methods and types of parallel operating systems - Detailed descriptions of hypercube systems - Specialized chapters on dataflow and on AI architectures

This open access book introduces a general framework that allows natural language researchers to enhance existing competence theories with fully specified performance and processing components. Gradually developing increasingly complex and cognitively realistic competence-performance models, it provides running code for these models and shows how to fit them to real-time experimental data. This computational cognitive modeling approach opens up exciting new directions for research in formal semantics, and linguistics more generally, and offers new ways of (re)connecting semantics and the broader field of cognitive science. The approach of this book is novel in more ways than one. Assuming the mental architecture and procedural modalities of Anderson's ACT-R framework, it presents fine-grained computational models of human language processing tasks which make detailed quantitative predictions that can be checked against the results of self-paced reading and other psycho-linguistic experiments. All models are presented as computer programs that readers can run on their own computer and on inputs of their choice, thereby learning to design, program and run their own models. But even for readers who won't do all that, the book will show how such detailed, quantitatively predicting modeling of linguistic processes is possible. A methodological breakthrough and a must for anyone concerned about the future of linguistics! (Hans Kamp) This book constitutes a major step forward in linguistics and psycholinguistics. It constitutes a unique synthesis of several different research traditions: computational models of psycholinguistic processes, and formal models of semantics and discourse processing. The work also introduces a sophisticated python-based software environment for modeling linguistic processes. This book has the potential to revolutionize not only formal models of linguistics, but also models of language processing more generally. (Shravan Vasishth) .

The proceedings of the tenth annual CAIA include technical sessions of a technology-related nature (scheduling, neural nets and machine learning, natural language, explanation, expert systems, enabling technology, and diagnosis) as well as those with a focus on applications (CAD/VLSI, case-based app