This book reports on the latest advances in adaptive critic control with robust stabilization for uncertain nonlinear systems. Covering the core theory, novel methods, and a number of typical industrial applications related to the robust adaptive critic control field, it develops a comprehensive framework of robust adaptive strategies, including theoretical analysis, algorithm design, simulation verification, and experimental results. As such, it is of interest to university researchers, graduate students, and engineers in the fields of automation, computer science, and electrical engineering wishing to learn about the fundamental principles, methods, algorithms, and applications in the field of robust adaptive critic control. In addition, it promotes the development of robust adaptive critic control approaches, and the construction of higher-level intelligent systems.

This book presents a class of novel optimal control methods and games schemes based on adaptive dynamic programming techniques. For systems with one control input, the ADP-based optimal control is designed for different objectives, while for systems with multi-players, the optimal control inputs are proposed based on games. In order to verify the effectiveness of the proposed methods, the book analyzes the properties of the adaptive dynamic programming methods, including convergence of the iterative value functions and the stability of the system under the iterative control laws. Further, to substantiate the mathematical analysis, it presents various application examples, which provide reference to real-world practices.

A comprehensive look at state-of-the-art ADP theory and real-world applications This book fills a gap in the literature by providing a theoretical framework for integrating techniques from adaptive dynamic programming (ADP) and modern nonlinear control to address data-driven optimal control design challenges arising from both parametric and dynamic uncertainties. Traditional model-based approaches leave much to be desired when addressing the challenges posed by the ever-increasing complexity of real-world engineering systems. An alternative which has received much interest in recent years are biologically-inspired approaches, primarily RADP. Despite their growing popularity worldwide, until now books on ADP have focused nearly exclusively on analysis and design, with scant consideration given to how it can be applied to address robustness issues, a new challenge arising from dynamic uncertainties encountered in common engineering problems. Robust Adaptive Dynamic Programming zeros in on the practical concerns of engineers. The authors develop RADP theory from linear systems to partially-linear, large-scale, and completely nonlinear systems. They provide in-depth coverage of state-of-the-art applications in power systems, supplemented with numerous real-world examples implemented in MATLAB. They also explore fascinating reverse engineering topics, such how ADP theory can be applied to the study of the human brain and cognition. In addition, the book: Covers the latest developments in RADP theory and applications for solving a range of systems’ complexity problems Explores multiple real-world implementations in power systems with illustrative examples backed up by reusable MATLAB code and Simulink block sets Provides an overview of nonlinear control, machine learning, and dynamic control Features discussions of novel applications for RADP theory, including an entire chapter on how it can be used as a computational mechanism of human movement control Robust Adaptive Dynamic Programming is both a valuable working resource and an intriguing exploration of contemporary ADP theory and applications for practicing engineers and advanced students in systems theory, control engineering, computer science, and applied mathematics.

This book describes new theories and applications of artificial neural networks, with a special focus on answering questions in neuroscience, biology and biophysics and cognitive research. It covers a wide range of methods and technologies, including deep neural networks, large-scale neural models, brain–computer interface, signal processing methods, as well as models of perception, studies on emotion recognition, self-organization and many more. The book includes both selected and invited papers presented at the XXV International Conference on Neuroinformatics, held on October 23-27, 2023, in Moscow, Russia.

Presented in a tutorial style, this comprehensive treatment unifies, simplifies, and explains most of the techniques for designing and analyzing adaptive control systems. Numerous examples clarify procedures and methods. 1995 edition.

This book intends to report new optimal control results with critic intelligence for complex discrete-time systems, which covers the novel control theory, advanced control methods, and typical applications for wastewater treatment systems. Therein, combining with artificial intelligence techniques, such as neural networks and reinforcement learning, the novel intelligent critic control theory as well as a series of advanced optimal regulation and trajectory tracking strategies are established for discrete-time nonlinear systems, followed by application verifications to complex wastewater treatment processes. Consequently, developing such kind of critic intelligence approaches is of great significance for nonlinear optimization and wastewater recycling. The book is likely to be of interest to researchers and practitioners as well as graduate students in automation, computer science, and process industry who wish to learn core principles, methods, algorithms, and applications in the field of intelligent optimal control. It is beneficial to promote the development of intelligent optimal control approaches and the construction of high-level intelligent systems.

Controlling uncertain networked control system (NCS) with limited communication among subcomponents is a challenging task and event-based sampling helps resolve the issue. This book considers event-triggered scheme as a transmission protocol to negotiate information exchange in resilient control for NCS via a robust control algorithm to regulate the closed loop behavior of NCS in the presence of mismatched uncertainty with limited feedback information. It includes robust control algorithm for linear and nonlinear systems with verification. Features: Describes optimal control based robust control law for event-triggered systems. States results in terms of Theorems and Lemmas supported with detailed proofs. Presents the combination of network interconnected systems and robust control strategy. Includes algorithmic steps for precise understanding of the control technique. Covers detailed problem statement and proposed solutions along with numerical examples. This book aims at Senior undergraduate, Graduate students, and Researchers in Control Engineering, Robotics and Signal Processing.

The book reviews developments in the following fields: optimal adaptive control; online differential games; reinforcement learning principles; and dynamic feedback control systems.

The core of this textbook is a systematic and self-contained treatment of the nonlinear stabilization and output regulation problems. Its coverage embraces both fundamental concepts and advanced research outcomes and includes many numerical and practical examples. Several classes of important uncertain nonlinear systems are discussed. The state-of-the art solution presented uses robust and adaptive control design ideas in an integrated approach which demonstrates connections between global stabilization and global output regulation allowing both to be treated as stabilization problems. Stabilization and Regulation of Nonlinear Systems takes advantage of rich new results to give students up-to-date instruction in the central design problems of nonlinear control, problems which are a driving force behind the furtherance of modern control theory and its application. The diversity of systems in which stabilization and output regulation become significant concerns in the mathematical formulation of practical control solutions—whether in disturbance rejection in flying vehicles or synchronization of Lorenz systems with harmonic systems—makes the text relevant to readers from a wide variety of backgrounds. Many exercises are provided to facilitate study and solutions are freely available to instructors via a download from springerextras.com. Striking a balance between rigorous mathematical treatment and engineering practicality, Stabilization and Regulation of Nonlinear Systems is an ideal text for graduate students from many engineering and applied-mathematical disciplines seeking a contemporary course in nonlinear control. Practitioners and academic theorists will also find this book a useful reference on recent thinking in this field.