This second edition of Mathematical Methods in the Robust Control of Linear Stochastic Systems includes a large number of recent results in the control of linear stochastic systems. More specifically, the new results presented are: - A unified and abstract framework for Riccati type equations arising in the stochastic control - Stability and control problems for systems perturbed by homogeneous Markov processes with infinite number of states - Mixed H2 / H∞ control problem and numerical procedures - Linear differential equations with positive evolution on ordered Banach spaces with applications for stochastic systems including both multiplicative white noise and Markovian jumps represented by a Markov chain with countable infinite set of states - Kalman filtering for stochastic systems subject both to state dependent noise and Markovian jumps - H∞ reduced order filters for stochastic systems The book will appeal to graduate students, researchers in advanced control engineering, finance, mathematical systems theory, applied probability and stochastic processes, and numerical analysis. From Reviews of the First Edition: This book is concerned with robust control of stochastic systems. One of the main features is its coverage of jump Markovian systems. ... Overall, this book presents results taking into consideration both white noise and Markov chain perturbations. It is clearly written and should be useful for people working in applied mathematics and in control and systems theory. The references cited provide further reading sources. (George Yin, Mathematical Reviews, Issue 2007 m) This book considers linear time varying stochastic systems, subjected to white noise disturbances and system parameter Markovian jumping, in the context of optimal control ... robust stabilization, and disturbance attenuation. ... The material presented in the book is organized in seven chapters. ... The book is very well written and organized. ... is a valuable reference for all researchers and graduate students in applied mathematics and control engineering interested in linear stochastic time varying control systems with Markovian parameter jumping and white noise disturbances. (Zoran Gajic, SIAM Review, Vol. 49 (3), 2007)

The book covers the necessary pre-requisites from probability theory, stochastic processes, stochastic integrals and stochastic differential equations. It includes detailed treatment of the fundamental properties of stochastic systems subjected both to multiplicative white noise and to jump Markovian perturbations. Systematic presentation leads the reader in a natural way to the original results. New theoretical results accompanied by detailed numerical examples, and the book proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations.

In this monograph the authors develop a theory for the robust control of discrete-time stochastic systems, subjected to both independent random perturbations and to Markov chains. Such systems are widely used to provide mathematical models for real processes in fields such as aerospace engineering, communications, manufacturing, finance and economy. The theory is a continuation of the authors’ work presented in their previous book entitled "Mathematical Methods in Robust Control of Linear Stochastic Systems" published by Springer in 2006. Key features: - Provides a common unifying framework for discrete-time stochastic systems corrupted with both independent random perturbations and with Markovian jumps which are usually treated separately in the control literature; - Covers preliminary material on probability theory, independent random variables, conditional expectation and Markov chains; - Proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations; - Leads the reader in a natural way to the original results through a systematic presentation; - Presents new theoretical results with detailed numerical examples. The monograph is geared to researchers and graduate students in advanced control engineering, applied mathematics, mathematical systems theory and finance. It is also accessible to undergraduate students with a fundamental knowledge in the theory of stochastic systems.

The H∞ control has been one of the important robust control approaches since the 1980s. This book extends the area to nonlinear stochastic H2/H∞ control, and studies more complex and practically useful mixed H2/H∞ controller synthesis rather than the pure H∞ control. Different from the commonly used convex optimization method, this book applies the Nash game approach to give necessary and sufficient conditions for the existence and uniqueness of the mixed H2/H∞ control. Researchers will benefit from our detailed exposition of the stochastic mixed H2/H∞ control theory, while practitioners can apply our efficient algorithms to address their practical problems.

The interest in control of nonlinear partial differential equation (PDE) sys tems has been triggered by the need to achieve tight distributed control of transport-reaction processes that exhibit highly nonlinear behavior and strong spatial variations. Drawing from recent advances in dynamics of PDE systems and nonlinear control theory, control of nonlinear PDEs has evolved into a very active research area of systems and control. This book the first of its kind- presents general methods for the synthesis of nonlinear and robust feedback controllers for broad classes of nonlinear PDE sys tems and illustrates their applications to transport-reaction processes of industrial interest. Specifically, our attention focuses on quasi-linear hyperbolic and parabolic PDE systems for which the manipulated inputs and measured and controlled outputs are distributed in space and bounded. We use geometric and Lyapunov-based control techniques to synthesize nonlinear and robust controllers that use a finite number of measurement sensors and control actuators to achieve stabilization of the closed-loop system, output track ing, and attenuation of the effect of model uncertainty. The controllers are successfully applied to numerous convection-reaction and diffusion-reaction processes, including a rapid thermal chemical vapor deposition reactor and a Czochralski crystal growth process. The book includes comparisons of the proposed nonlinear and robust control methods with other approaches and discussions of practical implementation issues.

The book includes articles from eminent international scientists discussing a wide spectrum of topics of current importance in mathematics and statistics and their applications. It presents state-of-the-art material along with a clear and detailed review of the relevant topics and issues concerned. The topics discussed include message transmission, colouring problem, control of stochastic structures and information dynamics, image denoising, life testing and reliability, survival and frailty models, analysis of drought periods, prediction of genomic profiles, competing risks, environmental applications and chronic disease control. It is a valuable resource for researchers and practitioners in the relevant areas of mathematics and statistics.

This book presents state-of-the-art solution methods and applications of stochastic optimal control. It is a collection of extended papers discussed at the traditional Liverpool workshop on controlled stochastic processes with participants from both the east and the west. New problems are formulated, and progresses of ongoing research are reported. Topics covered in this book include theoretical results and numerical methods for Markov and semi-Markov decision processes, optimal stopping of Markov processes, stochastic games, problems with partial information, optimal filtering, robust control, Q-learning, and self-organizing algorithms. Real-life case studies and applications, e.g., queueing systems, forest management, control of water resources, marketing science, and healthcare, are presented. Scientific researchers and postgraduate students interested in stochastic optimal control,- as well as practitioners will find this book appealing and a valuable reference. ​

This book is a collection of thoroughly refereed papers presented at the 27th IFIP TC 7 Conference on System Modeling and Optimization, held in Sophia Antipolis, France, in June/July 2015. The 48 revised papers were carefully reviewed and selected from numerous submissions. They cover the latest progress in their respective areas and encompass broad aspects of system modeling and optimiza-tion, such as modeling and analysis of systems governed by Partial Differential Equations (PDEs) or Ordinary Differential Equations (ODEs), control of PDEs/ODEs, nonlinear optimization, stochastic optimization, multi-objective optimization, combinatorial optimization, industrial applications, and numericsof PDEs.

It has been widely recognized nowadays the importance of introducing mathematical models that take into account possible sudden changes in the dynamical behavior of a high-integrity systems or a safety-critical system. Such systems can be found in aircraft control, nuclear power stations, robotic manipulator systems, integrated communication networks and large-scale flexible structures for space stations, and are inherently vulnerable to abrupt changes in their structures caused by component or interconnection failures. In this regard, a particularly interesting class of models is the so-called Markov jump linear systems (MJLS), which have been used in numerous applications including robotics, economics and wireless communication. Combining probability and operator theory, the present volume provides a unified and rigorous treatment of recent results in control theory of continuous-time MJLS. This unique approach is of great interest to experts working in the field of linear systems with Markovian jump parameters or in stochastic control. The volume focuses on one of the few cases of stochastic control problems with an actual explicit solution and offers material well-suited to coursework, introducing students to an interesting and active research area. The book is addressed to researchers working in control and signal processing engineering. Prerequisites include a solid background in classical linear control theory, basic familiarity with continuous-time Markov chains and probability theory, and some elementary knowledge of operator theory. ​

This book constitutes the proceedings of the 19th Chinese Intelligent Systems Conference, CISC 2023, which was held during October 14–15, 2023, in Ningbo, Zhejiang, China. The book focuses on new theoretical results and techniques in the field of intelligent systems and control. This is achieved by providing in-depth studies of a number of important topics such as multi-agent systems, complex networks, intelligent robots, complex systems theory and swarm behavior, event-driven and data-driven control, robust and adaptive control, big data and brain science, process control, intelligent sensors and detection technology, deep learning and learning control, navigation and control of aerial vehicles, and so on. The book is particularly suitable for readers interested in learning intelligent systems and control and artificial intelligence. The book can benefit researchers, engineers and graduate students.