A rigorous introduction to optimal control theory, which will enable engineers and scientists to put the theory into practice.

The calculus of variations is used to find functions that optimize quantities expressed in terms of integrals. Optimal control theory seeks to find functions that minimize cost integrals for systems described by differential equations. This book is an introduction to both the classical theory of the calculus of variations and the more modern developments of optimal control theory from the perspective of an applied mathematician. It focuses on understanding concepts and how to apply them. The range of potential applications is broad: the calculus of variations and optimal control theory have been widely used in numerous ways in biology, criminology, economics, engineering, finance, management science, and physics. Applications described in this book include cancer chemotherapy, navigational control, and renewable resource harvesting. The prerequisites for the book are modest: the standard calculus sequence, a first course on ordinary differential equations, and some facility with the use of mathematical software. It is suitable for an undergraduate or beginning graduate course, or for self study. It provides excellent preparation for more advanced books and courses on the calculus of variations and optimal control theory.

This textbook offers a concise yet rigorous introduction to calculus of variations and optimal control theory, and is a self-contained resource for graduate students in engineering, applied mathematics, and related subjects. Designed specifically for a one-semester course, the book begins with calculus of variations, preparing the ground for optimal control. It then gives a complete proof of the maximum principle and covers key topics such as the Hamilton-Jacobi-Bellman theory of dynamic programming and linear-quadratic optimal control. Calculus of Variations and Optimal Control Theory also traces the historical development of the subject and features numerous exercises, notes and references at the end of each chapter, and suggestions for further study. Offers a concise yet rigorous introduction Requires limited background in control theory or advanced mathematics Provides a complete proof of the maximum principle Uses consistent notation in the exposition of classical and modern topics Traces the historical development of the subject Solutions manual (available only to teachers) Leading universities that have adopted this book include: University of Illinois at Urbana-Champaign ECE 553: Optimum Control Systems Georgia Institute of Technology ECE 6553: Optimal Control and Optimization University of Pennsylvania ESE 680: Optimal Control Theory University of Notre Dame EE 60565: Optimal Control

EDITORIAL REVIEW: This book provides a guided tour in introducing optimal control theory from a practitioner's point of view. As in the first edition, Ross takes the contrarian view that it is not necessary to prove Pontryagin's Principle before using it. Using the same philosophy, the second edition expands the ideas over four chapters: In Chapter 1, basic principles related to problem formulation via a structured approach are introduced: What is a state variable? What is a control variable? What is state space? And so on. In Chapter 2, Pontryagin's Principle is introduced using intuitive ideas from everyday life: Like the process of "measuring" a sandwich and how it relates to costates. A vast number of illustrations are used to explain the concepts without going into the minutia of obscure mathematics. Mnemonics are introduced to help a beginner remember the collection of conditions that constitute Pontryagin's Principle. In Chapter 3, several examples are worked out in detail to illustrate a step-by-step process in applying Pontryagin's Principle. Included in this example is Kalman's linear-quadratic optimal control problem. In Chapter 4, a large number of problems from applied mathematics to management science are solved to illustrate how Pontryagin's Principle is used across the disciplines. Included in this chapter are test problems and solutions. The style of the book is easygoing and engaging. The classical calculus of variations is an unnecessary prerequisite for understanding optimal control theory. Ross uses original references to weave an entertaining historical account of various events. Students, particularly beginners, will embark on a minimum-time trajectory to applying Pontryagin's Principle.

A focused presentation of how sparse optimization methods can be used to solve optimal control and estimation problems.

This is an intuitively motivated presentation of many topics in classical mechanics and related areas of control theory and calculus of variations. All topics throughout the book are treated with zero tolerance for unrevealing definitions and for proofs which leave the reader in the dark. Some areas of particular interest are: an extremely short derivation of the ellipticity of planetary orbits; a statement and an explanation of the "tennis racket paradox"; a heuristic explanation (and a rigorous treatment) of the gyroscopic effect; a revealing equivalence between the dynamics of a particle and statics of a spring; a short geometrical explanation of Pontryagin's Maximum Principle, and more. In the last chapter, aimed at more advanced readers, the Hamiltonian and the momentum are compared to forces in a certain static problem. This gives a palpable physical meaning to some seemingly abstract concepts and theorems. With minimal prerequisites consisting of basic calculus and basic undergraduate physics, this book is suitable for courses from an undergraduate to a beginning graduate level, and for a mixed audience of mathematics, physics and engineering students. Much of the enjoyment of the subject lies in solving almost 200 problems in this book.

Geared toward advanced undergraduate and graduate engineering students, this text introduces the theory and applications of optimal control. It serves as a bridge to the technical literature, enabling students to evaluate the implications of theoretical control work, and to judge the merits of papers on the subject. Rather than presenting an exhaustive treatise, Optimal Control offers a detailed introduction that fosters careful thinking and disciplined intuition. It develops the basic mathematical background, with a coherent formulation of the control problem and discussions of the necessary conditions for optimality based on the maximum principle of Pontryagin. In-depth examinations cover applications of the theory to minimum time, minimum fuel, and to quadratic criteria problems. The structure, properties, and engineering realizations of several optimal feedback control systems also receive attention. Special features include numerous specific problems, carried through to engineering realization in block diagram form. The text treats almost all current examples of control problems that permit analytic solutions, and its unified approach makes frequent use of geometric ideas to encourage students' intuition.

This is a long-overdue volume dedicated to space trajectory optimization. Interest in the subject has grown, as space missions of increasing levels of sophistication, complexity, and scientific return - hardly imaginable in the 1960s - have been designed and flown. Although the basic tools of optimization theory remain an accepted canon, there has been a revolution in the manner in which they are applied and in the development of numerical optimization. This volume purposely includes a variety of both analytical and numerical approaches to trajectory optimization. The choice of authors has been guided by the editor's intention to assemble the most expert and active researchers in the various specialities presented. The authors were given considerable freedom to choose their subjects, and although this may yield a somewhat eclectic volume, it also yields chapters written with palpable enthusiasm and relevance to contemporary problems.

Control Theory is at the heart of information and communication technologies of complex systems. It can contribute to meeting the energy and environmental challenges we are facing. The textbook is organized in the way an engineer classically proceeds to solve a control problem, that is, elaboration of a mathematical model capturing the process behavior, analysis of this model and design of a control to achieve the desired objectives. It is divided into three Parts. The first part of the text addresses modeling aspects through state space and input-output representations. The notion of the internal state of a system (for example mechanical, thermal or electrical), as well as its description using a finite number of variables, is also emphasized. The second part is devoted to the stability analysis of an equilibrium point. The authors present classical tools for stability analysis, such as linearization techniques and Lyapunov functions. Central to Control Theory are the notions of feedback and of closed-loop, and the third part of the textbook describes the linear control synthesis in a continuous and discrete-time framework and also in a probabilistic context. Quadratic optimization and Kalman filtering are presented, as well as the polynomial representation, a convenient approach to reject perturbations on the system without making the control law more complex. Throughout the text, different examples are developed, both in the chapters and in the exercises.

When the Tyrian princess Dido landed on the North African shore of the Mediterranean sea she was welcomed by a local chieftain. He offered her all the land that she could enclose between the shoreline and a rope of knotted cowhide. While the legend does not tell us, we may assume that Princess Dido arrived at the correct solution by stretching the rope into the shape of a circular arc and thereby maximized the area of the land upon which she was to found Carthage. This story of the founding of Carthage is apocryphal. Nonetheless it is probably the first account of a problem of the kind that inspired an entire mathematical discipline, the calculus of variations and its extensions such as the theory of optimal control. This book is intended to present an introductory treatment of the calculus of variations in Part I and of optimal control theory in Part II. The discussion in Part I is restricted to the simplest problem of the calculus of variations. The topic is entirely classical; all of the basic theory had been developed before the turn of the century. Consequently the material comes from many sources; however, those most useful to me have been the books of Oskar Bolza and of George M. Ewing. Part II is devoted to the elementary aspects of the modern extension of the calculus of variations, the theory of optimal control of dynamical systems.