Designing Distributed Learning Environments with Intelligent Software Agents reports on the most recent advances in agent technologies for distributed learning. Chapters are devoted to the various aspects of intelligent software agents in distributed learning, including the methodological and technical issues on where and how intelligent agents can contribute to meeting distributed learning needs today and tomorrow. This book benefits the AI (artificial intelligence) and educational communities in their research and development, offering new and interesting research issues surrounding the development of distributed learning environments in the Semantic Web age. In addition, the ideas presented in the book are applicable to other domains such as Agent-Supported Web Services, distributed business process and resource integration, computer-supported collaborative work (CSCW) and e-Commerce.

The concept of an intelligent agent – a computational system capable of performing certain tasks autonomously – derived from the growing potential of digital computers in the mid 20th century and had been widely adopted by the early 1990s. Partly in parallel with this concept, the perspective of ambient intelligence (AmI) emerged in the late 1990s. Agent technology and AmI have many similarities, and the main purpose of this book is to provide an overview of the state-of-the-art of the scientific area that integrates these two. The book addresses a wide variety of topics related to agents and AmI, including theoretical, practical, design, implementation, ethical and philosophical issues. The 12 chapters are arranged in four sections. The first consists of three chapters discussing ethical and philosophical issues; the second part explores various approaches that can be used to develop agent-based AmI Systems; the third part contains three chapters that share the goal to endow AmI systems with useful properties like intelligence and adaptivity and the last section presents concrete applications of agent-based AmI systems. This book provides an insight into recent achievements and future challenges at the intersection of agent technology and ambient intelligence and will assist the development of more intelligent, flexible, effective and user-friendly systems as well as posing critical questions about the future of the role of agents within the AmI perspective.

This book constitutes the refereed proceedings of the 4th International Conference on Artificial General Intelligence, AGI 2011, held in Mountain View, CA, USA, in August 2011. The 28 revised full papers and 26 short papers were carefully reviewed and selected from 103 submissions. The papers are written by leading academic and industry researchers involved in scientific and engineering work and focus on the creation of AI systems possessing general intelligence at the human level and beyond.

Personal motivation. The dream of creating artificial devices that reach or outperform human inteUigence is an old one. It is also one of the dreams of my youth, which have never left me. What makes this challenge so interesting? A solution would have enormous implications on our society, and there are reasons to believe that the AI problem can be solved in my expected lifetime. So, it's worth sticking to it for a lifetime, even if it takes 30 years or so to reap the benefits. The AI problem. The science of artificial intelligence (AI) may be defined as the construction of intelligent systems and their analysis. A natural definition of a system is anything that has an input and an output stream. Intelligence is more complicated. It can have many faces like creativity, solving prob lems, pattern recognition, classification, learning, induction, deduction, build ing analogies, optimization, surviving in an environment, language processing, and knowledge. A formal definition incorporating every aspect of intelligence, however, seems difficult. Most, if not all known facets of intelligence can be formulated as goal driven or, more precisely, as maximizing some utility func tion. It is, therefore, sufficient to study goal-driven AI; e. g. the (biological) goal of animals and humans is to survive and spread. The goal of AI systems should be to be useful to humans.

Multiagent systems is an expanding field that blends classical fields like game theory and decentralized control with modern fields like computer science and machine learning. This monograph provides a concise introduction to the subject, covering the theoretical foundations as well as more recent developments in a coherent and readable manner. The text is centered on the concept of an agent as decision maker. Chapter 1 is a short introduction to the field of multiagent systems. Chapter 2 covers the basic theory of singleagent decision making under uncertainty. Chapter 3 is a brief introduction to game theory, explaining classical concepts like Nash equilibrium. Chapter 4 deals with the fundamental problem of coordinating a team of collaborative agents. Chapter 5 studies the problem of multiagent reasoning and decision making under partial observability. Chapter 6 focuses on the design of protocols that are stable against manipulations by self-interested agents. Chapter 7 provides a short introduction to the rapidly expanding field of multiagent reinforcement learning. The material can be used for teaching a half-semester course on multiagent systems covering, roughly, one chapter per lecture.

Implement intelligent agents using PyTorch to solve classic AI problems, play console games like Atari, and perform tasks such as autonomous driving using the CARLA driving simulator Key Features Explore the OpenAI Gym toolkit and interface to use over 700 learning tasks Implement agents to solve simple to complex AI problems Study learning environments and discover how to create your own Book Description Many real-world problems can be broken down into tasks that require a series of decisions to be made or actions to be taken. The ability to solve such tasks without a machine being programmed requires a machine to be artificially intelligent and capable of learning to adapt. This book is an easy-to-follow guide to implementing learning algorithms for machine software agents in order to solve discrete or continuous sequential decision making and control tasks. Hands-On Intelligent Agents with OpenAI Gym takes you through the process of building intelligent agent algorithms using deep reinforcement learning starting from the implementation of the building blocks for configuring, training, logging, visualizing, testing, and monitoring the agent. You will walk through the process of building intelligent agents from scratch to perform a variety of tasks. In the closing chapters, the book provides an overview of the latest learning environments and learning algorithms, along with pointers to more resources that will help you take your deep reinforcement learning skills to the next level. What you will learn Explore intelligent agents and learning environments Understand the basics of RL and deep RL Get started with OpenAI Gym and PyTorch for deep reinforcement learning Discover deep Q learning agents to solve discrete optimal control tasks Create custom learning environments for real-world problems Apply a deep actor-critic agent to drive a car autonomously in CARLA Use the latest learning environments and algorithms to upgrade your intelligent agent development skills Who this book is for If you’re a student, game/machine learning developer, or AI enthusiast looking to get started with building intelligent agents and algorithms to solve a variety of problems with the OpenAI Gym interface, this book is for you. You will also find this book useful if you want to learn how to build deep reinforcement learning-based agents to solve problems in your domain of interest. Though the book covers all the basic concepts that you need to know, some working knowledge of Python programming language will help you get the most out of it.

This volume includes 15 papers from the National Academy of Engineering's 2006 U.S. Frontiers of Engineering (USFOE) Symposium held in September 2006. USFOE meetings bring together 100 outstanding engineers (ages 30 to 45) to exchange information about leading-edge technologies in a range of engineering fields. The 2006 symposium covered four topic areas: intelligent software systems and machines, the nano/bio interface, engineering personal mobility for the 21st century, and supply chain management. A paper by dinner speaker Dr. W. Dale Compton, Lillian M. Gilbreth Distinguished Professor of Industrial Engineering, Emeritus, is also included. The papers describe leading-edge research on commercializing auditory neuroscience, future developments in bionanotechnology, sustainable urban transportation, and managing disruptions to supply chains, among other topics. Appendixes include information about contributors, the symposium program, and a list of meeting participants. This is the twelfth volume in the USFOE series.

Reasoning about knowledge—particularly the knowledge of agents who reason about the world and each other's knowledge—was once the exclusive province of philosophers and puzzle solvers. More recently, this type of reasoning has been shown to play a key role in a surprising number of contexts, from understanding conversations to the analysis of distributed computer algorithms. Reasoning About Knowledge is the first book to provide a general discussion of approaches to reasoning about knowledge and its applications to distributed systems, artificial intelligence, and game theory. It brings eight years of work by the authors into a cohesive framework for understanding and analyzing reasoning about knowledge that is intuitive, mathematically well founded, useful in practice, and widely applicable. The book is almost completely self-contained and should be accessible to readers in a variety of disciplines, including computer science, artificial intelligence, linguistics, philosophy, cognitive science, and game theory. Each chapter includes exercises and bibliographic notes.

Artificial Intelligence: A Modern Approach offers the most comprehensive, up-to-date introduction to the theory and practice of artificial intelligence. Number one in its field, this textbook is ideal for one or two-semester, undergraduate or graduate-level courses in Artificial Intelligence.