Optimal control deals with the problem of finding a control law for a given system such that a certain optimality criterion is achieved. An optimal control is a set of differential equations describing the paths of the control variables that minimize the cost functional. This book, Continuous Time Dynamical Systems: State Estimation and Optimal Control with Orthogonal Functions, considers different classes of systems with quadratic performance criteria. It then attempts to find the optimal control law for each class of systems using orthogonal functions that can optimize the given performance criteria. Illustrated throughout with detailed examples, the book covers topics including: Block-pulse functions and shifted Legendre polynomials State estimation of linear time-invariant systems Linear optimal control systems incorporating observers Optimal control of systems described by integro-differential equations Linear-quadratic-Gaussian control Optimal control of singular systems Optimal control of time-delay systems with and without reverse time terms Optimal control of second-order nonlinear systems Hierarchical control of linear time-invariant and time-varying systems

This book gives a mathematical treatment of the introduction to qualitative differential equations and discrete dynamical systems. The treatment includes theoretical proofs, methods of calculation, and applications. The two parts of the book, continuous time of differential equations and discrete time of dynamical systems, can be covered independently in one semester each or combined together into a year long course. The material on differential equations introduces the qualitative or geometric approach through a treatment of linear systems in any dimension. There follows chapters where equilibria are the most important feature, where scalar (energy) functions is the principal tool, where periodic orbits appear, and finally, chaotic systems of differential equations. The many different approaches are systematically introduced through examples and theorems. The material on discrete dynamical systems starts with maps of one variable and proceeds to systems in higher dimensions. The treatment starts with examples where the periodic points can be found explicitly and then introduces symbolic dynamics to analyze where they can be shown to exist but not given in explicit form. Chaotic systems are presented both mathematically and more computationally using Lyapunov exponents. With the one-dimensional maps as models, the multidimensional maps cover the same material in higher dimensions. This higher dimensional material is less computational and more conceptual and theoretical. The final chapter on fractals introduces various dimensions which is another computational tool for measuring the complexity of a system. It also treats iterated function systems which give examples of complicated sets. In the second edition of the book, much of the material has been rewritten to clarify the presentation. Also, some new material has been included in both parts of the book. This book can be used as a textbook for an advanced undergraduate course on ordinary differential equations and/or dynamical systems. Prerequisites are standard courses in calculus (single variable and multivariable), linear algebra, and introductory differential equations.

This textbook is aimed at newcomers to nonlinear dynamics and chaos, especially students taking a first course in the subject. The presentation stresses analytical methods, concrete examples, and geometric intuition. The theory is developed systematically, starting with first-order differential equations and their bifurcations, followed by phase plane analysis, limit cycles and their bifurcations, and culminating with the Lorenz equations, chaos, iterated maps, period doubling, renormalization, fractals, and strange attractors.

Mathematical Modeling, Third Edition is a general introduction to an increasingly crucial topic for today's mathematicians. Unlike textbooks focused on one kind of mathematical model, this book covers the broad spectrum of modeling problems, from optimization to dynamical systems to stochastic processes. Mathematical modeling is the link between mathematics and the rest of the world. Meerschaert shows how to refine a question, phrasing it in precise mathematical terms. Then he encourages students to reverse the process, translating the mathematical solution back into a comprehensible, useful answer to the original question. This textbook mirrors the process professionals must follow in solving complex problems. Each chapter in this book is followed by a set of challenging exercises. These exercises require significant effort on the part of the student, as well as a certain amount of creativity. Meerschaert did not invent the problems in this book--they are real problems, not designed to illustrate the use of any particular mathematical technique. Meerschaert's emphasis on principles and general techniques offers students the mathematical background they need to model problems in a wide range of disciplines. Increased support for instructors, including MATLAB material New sections on time series analysis and diffusion models Additional problems with international focus such as whale and dolphin populations, plus updated optimization problems

Hybrid dynamical systems exhibit continuous and instantaneous changes, having features of continuous-time and discrete-time dynamical systems. Filled with a wealth of examples to illustrate concepts, this book presents a complete theory of robust asymptotic stability for hybrid dynamical systems that is applicable to the design of hybrid control algorithms--algorithms that feature logic, timers, or combinations of digital and analog components. With the tools of modern mathematical analysis, Hybrid Dynamical Systems unifies and generalizes earlier developments in continuous-time and discrete-time nonlinear systems. It presents hybrid system versions of the necessary and sufficient Lyapunov conditions for asymptotic stability, invariance principles, and approximation techniques, and examines the robustness of asymptotic stability, motivated by the goal of designing robust hybrid control algorithms. This self-contained and classroom-tested book requires standard background in mathematical analysis and differential equations or nonlinear systems. It will interest graduate students in engineering as well as students and researchers in control, computer science, and mathematics.

In the analysis and synthesis of contemporary systems, engineers and scientists are frequently confronted with increasingly complex models that may simultaneously include components whose states evolve along continuous time and discrete instants; components whose descriptions may exhibit nonlinearities, time lags, transportation delays, hysteresis effects, and uncertainties in parameters; and components that cannot be described by various classical equations, as in the case of discrete-event systems, logic commands, and Petri nets. The qualitative analysis of such systems requires results for finite-dimensional and infinite-dimensional systems; continuous-time and discrete-time systems; continuous continuous-time and discontinuous continuous-time systems; and hybrid systems involving a mixture of continuous and discrete dynamics. Filling a gap in the literature, this textbook presents the first comprehensive stability analysis of all the major types of system models described above. Throughout the book, the applicability of the developed theory is demonstrated by means of many specific examples and applications to important classes of systems, including digital control systems, nonlinear regulator systems, pulse-width-modulated feedback control systems, artificial neural networks (with and without time delays), digital signal processing, a class of discrete-event systems (with applications to manufacturing and computer load balancing problems) and a multicore nuclear reactor model. The book covers the following four general topics: * Representation and modeling of dynamical systems of the types described above * Presentation of Lyapunov and Lagrange stability theory for dynamical systems defined on general metric spaces * Specialization of this stability theory to finite-dimensional dynamical systems * Specialization of this stability theory to infinite-dimensional dynamical systems Replete with exercises and requiring basic knowledge of linear algebra, analysis, and differential equations, the work may be used as a textbook for graduate courses in stability theory of dynamical systems. The book may also serve as a self-study reference for graduate students, researchers, and practitioners in applied mathematics, engineering, computer science, physics, chemistry, biology, and economics.

Models of dynamical systems are required for various purposes in the field of systems and control. The models are handled either in discrete time (DT) or in continuous time (CT). Physical systems give rise to models only in CT because they are based on physical laws which are invariably in CT. In system identification, indirect methods provide DT models which are then converted into CT. Methods of directly identifying CT models are preferred to the indirect methods for various reasons. The direct methods involve a primary stage of signal processing, followed by a secondary stage of parameter estimation. In the primary stage, the measured signals are processed by a general linear dynamic operation—computational or realized through prefilters, to preserve the system parameters in their native CT form—and the literature is rich on this aspect. In this book: Identification of Continuous-Time Systems-Linear and Robust Parameter Estimation, Allamaraju Subrahmanyam and Ganti Prasada Rao consider CT system models that are linear in their unknown parameters and propose robust methods of estimation. This book complements the existing literature on the identification of CT systems by enhancing the secondary stage through linear and robust estimation. In this book, the authors provide an overview of CT system identification, consider Markov-parameter models and time-moment models as simple linear-in-parameters models for CT system identification, bring them into mainstream model parameterization via basis functions, present a methodology to robustify the recursive least squares algorithm for parameter estimation of linear regression models, suggest a simple off-line error quantification scheme to show that it is possible to quantify error even in the absence of informative priors, and indicate some directions for further research. This modest volume is intended to be a useful addition to the literature on identifying CT systems.

This book is about dynamical systems that are "hybrid" in the sense that they contain both continuous and discrete state variables. Recently there has been increased research interest in the study of the interaction between discrete and continuous dynamics. The present volume provides a first attempt in book form to bring together concepts and methods dealing with hybrid systems from various areas, and to look at these from a unified perspective. The authors have chosen a mode of exposition that is largely based on illustrative examples rather than on the abstract theorem-proof format because the systematic study of hybrid systems is still in its infancy. The examples are taken from many different application areas, ranging from power converters to communication protocols and from chaos to mathematical finance. Subjects covered include the following: definition of hybrid systems; description formats; existence and uniqueness of solutions; special subclasses (variable-structure systems, complementarity systems); reachability and verification; stability and stabilizability; control design methods. The book will be of interest to scientists from a wide range of disciplines including: computer science, control theory, dynamical system theory, systems modeling and simulation, and operations research.

It has been widely recognized nowadays the importance of introducing mathematical models that take into account possible sudden changes in the dynamical behavior of a high-integrity systems or a safety-critical system. Such systems can be found in aircraft control, nuclear power stations, robotic manipulator systems, integrated communication networks and large-scale flexible structures for space stations, and are inherently vulnerable to abrupt changes in their structures caused by component or interconnection failures. In this regard, a particularly interesting class of models is the so-called Markov jump linear systems (MJLS), which have been used in numerous applications including robotics, economics and wireless communication. Combining probability and operator theory, the present volume provides a unified and rigorous treatment of recent results in control theory of continuous-time MJLS. This unique approach is of great interest to experts working in the field of linear systems with Markovian jump parameters or in stochastic control. The volume focuses on one of the few cases of stochastic control problems with an actual explicit solution and offers material well-suited to coursework, introducing students to an interesting and active research area. The book is addressed to researchers working in control and signal processing engineering. Prerequisites include a solid background in classical linear control theory, basic familiarity with continuous-time Markov chains and probability theory, and some elementary knowledge of operator theory. ​

This work is aimed at mathematics and engineering graduate students and researchers in the areas of optimization, dynamical systems, control sys tems, signal processing, and linear algebra. The motivation for the results developed here arises from advanced engineering applications and the emer gence of highly parallel computing machines for tackling such applications. The problems solved are those of linear algebra and linear systems the ory, and include such topics as diagonalizing a symmetric matrix, singular value decomposition, balanced realizations, linear programming, sensitivity minimization, and eigenvalue assignment by feedback control. The tools are those, not only of linear algebra and systems theory, but also of differential geometry. The problems are solved via dynamical sys tems implementation, either in continuous time or discrete time , which is ideally suited to distributed parallel processing. The problems tackled are indirectly or directly concerned with dynamical systems themselves, so there is feedback in that dynamical systems are used to understand and optimize dynamical systems. One key to the new research results has been the recent discovery of rather deep existence and uniqueness results for the solution of certain matrix least squares optimization problems in geomet ric invariant theory. These problems, as well as many other optimization problems arising in linear algebra and systems theory, do not always admit solutions which can be found by algebraic methods.