Risto Miikkulainen draws on recent connectionist work in language comprehension tocreate a model that can understand natural language. Using the DISCERN system as an example, hedescribes a general approach to building high-level cognitive models from distributed neuralnetworks and shows how the special properties of such networks are useful in modeling humanperformance. In this approach connectionist networks are not only plausible models of isolatedcognitive phenomena, but also sufficient constituents for complete artificial intelligencesystems.Distributed neural networks have been very successful in modeling isolated cognitivephenomena, but complex high-level behavior has been tractable only with symbolic artificialintelligence techniques. Aiming to bridge this gap, Miikkulainen describes DISCERN, a completenatural language processing system implemented entirely at the subsymbolic level. In DISCERN,distributed neural network models of parsing, generating, reasoning, lexical processing, andepisodic memory are integrated into a single system that learns to read, paraphrase, and answerquestions about stereotypical narratives.Miikkulainen's work, which includes a comprehensive surveyof the connectionist literature related to natural language processing, will prove especiallyvaluable to researchers interested in practical techniques for high-level representation,inferencing, memory modeling, and modular connectionist architectures.Risto Miikkulainen is anAssistant Professor in the Department of Computer Sciences at The University of Texas atAustin.

This study explores the design and application of natural language text-based processing systems, based on generative linguistics, empirical copus analysis, and artificial neural networks. It emphasizes the practical tools to accommodate the selected system.

Connection science is a new information-processing paradigm which attempts to imitate the architecture and process of the brain, and brings together researchers from disciplines as diverse as computer science, physics, psychology, philosophy, linguistics, biology, engineering, neuroscience and AI. Work in Connectionist Natural Language Processing (CNLP) is now expanding rapidly, yet much of the work is still only available in journals, some of them quite obscure. To make this research more accessible this book brings together an important and comprehensive set of articles from the journal CONNECTION SCIENCE which represent the state of the art in Connectionist natural language processing; from speech recognition to discourse comprehension. While it is quintessentially Connectionist, it also deals with hybrid systems, and will be of interest to both theoreticians as well as computer modellers. Range of topics covered: Connectionism and Cognitive Linguistics Motion, Chomsky's Government-binding Theory Syntactic Transformations on Distributed Representations Syntactic Neural Networks A Hybrid Symbolic/Connectionist Model for Understanding of Nouns Connectionism and Determinism in a Syntactic Parser Context Free Grammar Recognition Script Recognition with Hierarchical Feature Maps Attention Mechanisms in Language Script-Based Story Processing A Connectionist Account of Similarity in Vowel Harmony Learning Distributed Representations Connectionist Language Users Representation and Recognition of Temporal Patterns A Hybrid Model of Script Generation Networks that Learn about Phonological Features Pronunciation in Text-to-Speech Systems

This book is based on the workshop on New Approaches to Learning for Natural Language Processing, held in conjunction with the International Joint Conference on Artificial Intelligence, IJCAI'95, in Montreal, Canada in August 1995. Most of the 32 papers included in the book are revised selected workshop presentations; some papers were individually solicited from members of the workshop program committee to give the book an overall completeness. Also included, and written with the novice reader in mind, is a comprehensive introductory survey by the volume editors. The volume presents the state of the art in the most promising current approaches to learning for NLP and is thus compulsory reading for researchers in the field or for anyone applying the new techniques to challenging real-world NLP problems.

This book provides readers with a practical guide to the principles of hybrid approaches to natural language processing (NLP) involving a combination of neural methods and knowledge graphs. To this end, it first introduces the main building blocks and then describes how they can be integrated to support the effective implementation of real-world NLP applications. To illustrate the ideas described, the book also includes a comprehensive set of experiments and exercises involving different algorithms over a selection of domains and corpora in various NLP tasks. Throughout, the authors show how to leverage complementary representations stemming from the analysis of unstructured text corpora as well as the entities and relations described explicitly in a knowledge graph, how to integrate such representations, and how to use the resulting features to effectively solve NLP tasks in a range of domains. In addition, the book offers access to executable code with examples, exercises and real-world applications in key domains, like disinformation analysis and machine reading comprehension of scientific literature. All the examples and exercises proposed in the book are available as executable Jupyter notebooks in a GitHub repository. They are all ready to be run on Google Colaboratory or, if preferred, in a local environment. A valuable resource for anyone interested in the interplay between neural and knowledge-based approaches to NLP, this book is a useful guide for readers with a background in structured knowledge representations as well as those whose main approach to AI is fundamentally based on logic. Further, it will appeal to those whose main background is in the areas of machine and deep learning who are looking for ways to leverage structured knowledge bases to optimize results along the NLP downstream.

Computational Architectures Integrating Neural and Symbolic Processes: A Perspective on the State of the Art focuses on a currently emerging body of research. With the reemergence of neural networks in the 1980s with their emphasis on overcoming some of the limitations of symbolic AI, there is clearly a need to support some form of high-level symbolic processing in connectionist networks. As argued by many researchers, on both the symbolic AI and connectionist sides, many cognitive tasks, e.g. language understanding and common sense reasoning, seem to require high-level symbolic capabilities. How these capabilities are realized in connectionist networks is a difficult question and it constitutes the focus of this book. Computational Architectures Integrating Neural and Symbolic Processes addresses the underlying architectural aspects of the integration of neural and symbolic processes. In order to provide a basis for a deeper understanding of existing divergent approaches and provide insight for further developments in this field, this book presents: (1) an examination of specific architectures (grouped together according to their approaches), their strengths and weaknesses, why they work, and what they predict, and (2) a critique/comparison of these approaches. Computational Architectures Integrating Neural and Symbolic Processes is of interest to researchers, graduate students, and interested laymen, in areas such as cognitive science, artificial intelligence, computer science, cognitive psychology, and neurocomputing, in keeping up-to-date with the newest research trends. It is a comprehensive, in-depth introduction to this new emerging field.

Spanning the multi-disciplinary scope of information technology, the Encyclopedia of Information Systems and Technology draws together comprehensive coverage of the inter-related aspects of information systems and technology. The topics covered in this encyclopedia encompass internationally recognized bodies of knowledge, including those of The IT BOK, the Chartered Information Technology Professionals Program, the International IT Professional Practice Program (British Computer Society), the Core Body of Knowledge for IT Professionals (Australian Computer Society), the International Computer Driving License Foundation (European Computer Driving License Foundation), and the Guide to the Software Engineering Body of Knowledge. Using the universally recognized definitions of IT and information systems from these recognized bodies of knowledge, the encyclopedia brings together the information that students, practicing professionals, researchers, and academicians need to keep their knowledge up to date. Also Available Online This Taylor & Francis encyclopedia is also available through online subscription, offering a variety of extra benefits for researchers, students, and librarians, including:  Citation tracking and alerts  Active reference linking  Saved searches and marked lists  HTML and PDF format options Contact Taylor and Francis for more information or to inquire about subscription options and print/online combination packages. US: (Tel) 1.888.318.2367; (E-mail) [email protected] International: (Tel) +44 (0) 20 7017 6062; (E-mail) [email protected]

This volume features the complete text of the material presented at the Twenty-Fifth Annual Conference of the Cognitive Science Society. As in previous years, the symposium included an interesting mixture of papers on many topics from researchers with diverse backgrounds and different goals, presenting a multifaceted view of cognitive science. This volume includes all papers, posters, and summaries of symposia presented at the leading conference that brings cognitive scientists together. The theme of this year's conference was the social, cultural, and contextual elements of cognition, including topics on collaboration, cultural learning, distributed cognition, and interaction.

This book presents the complete collection of peer-reviewed presentations at the 1999 Cognitive Science Society meeting, including papers, poster abstracts, and descriptions of conference symposia. For students and researchers in all areas of cognitive science.