Based on the results of over 10 years of research and development by the authors, this book presents a broad cross section of dynamic programming (DP) techniques applied to the optimization of dynamical systems. The main goal of the research effort was to develop a robust path planning/trajectory optimization tool that did not require an initial guess. The goal was partially met with a combination of DP and homotopy algorithms. DP algorithms are presented here with a theoretical development, and their successful application to variety of practical engineering problems is emphasized.

This comprehensive study of dynamic programming applied to numerical solution of optimization problems. It will interest aerodynamic, control, and industrial engineers, numerical analysts, and computer specialists, applied mathematicians, economists, and operations and systems analysts. Originally published in 1962. The Princeton Legacy Library uses the latest print-on-demand technology to again make available previously out-of-print books from the distinguished backlist of Princeton University Press. These editions preserve the original texts of these important books while presenting them in durable paperback and hardcover editions. The goal of the Princeton Legacy Library is to vastly increase access to the rich scholarly heritage found in the thousands of books published by Princeton University Press since its founding in 1905.

This work is aimed at mathematics and engineering graduate students and researchers in the areas of optimization, dynamical systems, control sys tems, signal processing, and linear algebra. The motivation for the results developed here arises from advanced engineering applications and the emer gence of highly parallel computing machines for tackling such applications. The problems solved are those of linear algebra and linear systems the ory, and include such topics as diagonalizing a symmetric matrix, singular value decomposition, balanced realizations, linear programming, sensitivity minimization, and eigenvalue assignment by feedback control. The tools are those, not only of linear algebra and systems theory, but also of differential geometry. The problems are solved via dynamical sys tems implementation, either in continuous time or discrete time , which is ideally suited to distributed parallel processing. The problems tackled are indirectly or directly concerned with dynamical systems themselves, so there is feedback in that dynamical systems are used to understand and optimize dynamical systems. One key to the new research results has been the recent discovery of rather deep existence and uniqueness results for the solution of certain matrix least squares optimization problems in geomet ric invariant theory. These problems, as well as many other optimization problems arising in linear algebra and systems theory, do not always admit solutions which can be found by algebraic methods.

This book provides a comprehensive presentation of classical and advanced topics in estimation and control of dynamical systems with an emphasis on stochastic control. Many aspects which are not easily found in a single text are provided, such as connections between control theory and mathematical finance, as well as differential games. The book is self-contained and prioritizes concepts rather than full rigor, targeting scientists who want to use control theory in their research in applied mathematics, engineering, economics, and management science. Examples and exercises are included throughout, which will be useful for PhD courses and graduate courses in general. Dr. Alain Bensoussan is Lars Magnus Ericsson Chair at UT Dallas and Director of the International Center for Decision and Risk Analysis which develops risk management research as it pertains to large-investment industrial projects that involve new technologies, applications and markets. He is also Chair Professor at City University Hong Kong.

Mathematical models are used to simulate, and sometimes control, the behavior of physical and artificial processes such as the weather and very large-scale integration (VLSI) circuits. The increasing need for accuracy has led to the development of highly complex models. However, in the presence of limited computational accuracy and storage capabilities model reduction (system approximation) is often necessary. Approximation of Large-Scale Dynamical Systems provides a comprehensive picture of model reduction, combining system theory with numerical linear algebra and computational considerations. It addresses the issue of model reduction and the resulting trade-offs between accuracy and complexity. Special attention is given to numerical aspects, simulation questions, and practical applications.

A practical, entry-level text integrating the basic principles of applied mathematics and probability, and computational science.

This treatment provides an exposition of discrete time dynamic processes evolving over an infinite horizon. Chapter 1 reviews some mathematical results from the theory of deterministic dynamical systems, with particular emphasis on applications to economics. The theory of irreducible Markov processes, especially Markov chains, is surveyed in Chapter 2. Equilibrium and long run stability of a dynamical system in which the law of motion is subject to random perturbations is the central theme of Chapters 3-5. A unified account of relatively recent results, exploiting splitting and contractions, that have found applications in many contexts is presented in detail. Chapter 6 explains how a random dynamical system may emerge from a class of dynamic programming problems. With examples and exercises, readers are guided from basic theory to the frontier of applied mathematical research.

This book addresses modern nonlinear programming (NLP) concepts and algorithms, especially as they apply to challenging applications in chemical process engineering. The author provides a firm grounding in fundamental NLP properties and algorithms, and relates them to real-world problem classes in process optimization, thus making the material understandable and useful to chemical engineers and experts in mathematical optimization.

A focused presentation of how sparse optimization methods can be used to solve optimal control and estimation problems.

This book introduces key concepts for systematically controlling engineering systems that possess interacting phenomena occurring at widely different speeds. The aim is to present the reader with control techniques that extend the benefits of model reduction of singular perturbation theory to a larger class of nonlinear dynamical systems. New results and relevant background are presented through insightful examples that cover a wide range of applications from different branches of engineering. This book is unique because it: presents a new perspective on existing control methods and thus broadens their application to a larger class of nonlinear dynamical systems; discusses general rather than problem-specific developments to certain applications or disciplines in order to provide control engineers with useful analytical tools ; addresses new control problems using singular perturbation methods, including closed-form results for control of nonminimum phase systems.