Recursive Identification and Parameter Estimation describes a recursive approach to solving system identification and parameter estimation problems arising from diverse areas. Supplying a systematic description of recursive estimation methods, it provides rigorous theoretical analysis of recursive solutions to problems of stochastic systems. Presenting the material and proposed algorithms in a manner that makes it easy to understand, the book provides readers with the modeling and identification skills required for successful theoretical research and effective applications.

Recursive Identification and Parameter Estimation describes a recursive approach to solving system identification and parameter estimation problems arising from diverse areas. Supplying rigorous theoretical analysis, it presents the material and proposed algorithms in a manner that makes it easy to understand—providing readers with the modeling and identification skills required for successful theoretical research and effective application. The book begins by introducing the basic concepts of probability theory, including martingales, martingale difference sequences, Markov chains, mixing processes, and stationary processes. Next, it discusses the root-seeking problem for functions, starting with the classic RM algorithm, but with attention mainly paid to the stochastic approximation algorithms with expanding truncations (SAAWET) which serves as the basic tool for recursively solving the problems addressed in the book. The book not only identifies the results of system identification and parameter estimation, but also demonstrates how to apply the proposed approaches for addressing problems in a range of areas, including: Identification of ARMAX systems without imposing restrictive conditions Identification of typical nonlinear systems Optimal adaptive tracking Consensus of multi-agents systems Principal component analysis Distributed randomized PageRank computation This book recursively identifies autoregressive and moving average with exogenous input (ARMAX) and discusses the identification of non-linear systems. It concludes by addressing the problems arising from different areas that are solved by SAAWET. Demonstrating how to apply the proposed approaches to solve problems across a range of areas, the book is suitable for students, researchers, and engineers working in systems and control, signal processing, communication, and mathematical statistics.

This book has grown out of a set of lecture notes prepared originally for a NATO Summer School on "The Theory and Practice of Systems ModelLing and Identification" held between the 17th and 28th July, 1972 at the Ecole Nationale Superieure de L'Aeronautique et de L'Espace. Since this time I have given similar lecture courses in the Control Division of the Engineering Department, University of Cambridge; Department of Mechanical Engineering, University of Western Australia; the University of Ghent, Belgium (during the time I held the IBM Visiting Chair in Simulation for the month of January, 1980), the Australian National University, and the Agricultural University, Wageningen, the Netherlands. As a result, I am grateful to all the reci pients of these lecture courses for their help in refining the book to its present form; it is still far from perfect but I hope that it will help the student to become acquainted with the interesting and practically useful concept of recursive estimation. Furthermore, I hope it will stimulate the reader to further study the theoretical aspects of the subject, which are not dealt with in detail in the present text. The book is primarily intended to provide an introductory set of lecture notes on the subject of recursive estimation to undergraduate/Masters students. However, the book can also be considered as a "theoretical background" handbook for use with the CAPTAIN Computer Package.

This book provides a comprehensive and systematic framework for developing, describing, and analyzing such recursive algorithms.

This is a revised version of the 1984 book of the same name but considerably modified and enlarged to accommodate the developments in recursive estimation and time series analysis that have occurred over the last quarter century. Also over this time, the CAPTAIN Toolbox for recursive estimation and time series analysis has been developed at Lancaster, for use in the MatlabTM software environment (see Appendix G). Consequently, the present version of the book is able to exploit the many computational routines that are contained in this widely available Toolbox, as well as some of the other routines in MatlabTM and its other toolboxes. The book is an introductory one on the topic of recursive estimation and it demonstrates how this approach to estimation, in its various forms, can be an impressive aid to the modelling of stochastic, dynamic systems. It is intended for undergraduate or Masters students who wish to obtain a grounding in this subject; or for practitioners in industry who may have heard of topics dealt with in this book and, while they want to know more about them, may have been deterred by the rather esoteric nature of some books in this challenging area of study.

Models of dynamical systems are required for various purposes in the field of systems and control. The models are handled either in discrete time (DT) or in continuous time (CT). Physical systems give rise to models only in CT because they are based on physical laws which are invariably in CT. In system identification, indirect methods provide DT models which are then converted into CT. Methods of directly identifying CT models are preferred to the indirect methods for various reasons. The direct methods involve a primary stage of signal processing, followed by a secondary stage of parameter estimation. In the primary stage, the measured signals are processed by a general linear dynamic operation—computational or realized through prefilters, to preserve the system parameters in their native CT form—and the literature is rich on this aspect. In this book: Identification of Continuous-Time Systems-Linear and Robust Parameter Estimation, Allamaraju Subrahmanyam and Ganti Prasada Rao consider CT system models that are linear in their unknown parameters and propose robust methods of estimation. This book complements the existing literature on the identification of CT systems by enhancing the secondary stage through linear and robust estimation. In this book, the authors provide an overview of CT system identification, consider Markov-parameter models and time-moment models as simple linear-in-parameters models for CT system identification, bring them into mainstream model parameterization via basis functions, present a methodology to robustify the recursive least squares algorithm for parameter estimation of linear regression models, suggest a simple off-line error quantification scheme to show that it is possible to quantify error even in the absence of informative priors, and indicate some directions for further research. This modest volume is intended to be a useful addition to the literature on identifying CT systems.

System Identification shows the student reader how to approach the system identification problem in a systematic fashion. The process is divided into three basic steps: experimental design and data collection; model structure selection and parameter estimation; and model validation, each of which is the subject of one or more parts of the text. Following an introduction on system theory, particularly in relation to model representation and model properties, the book contains four parts covering: • data-based identification – non-parametric methods for use when prior system knowledge is very limited; • time-invariant identification for systems with constant parameters; • time-varying systems identification, primarily with recursive estimation techniques; and • model validation methods. A fifth part, composed of appendices, covers the various aspects of the underlying mathematics needed to begin using the text. The book uses essentially semi-physical or gray-box modeling methods although data-based, transfer-function system descriptions are also introduced. The approach is problem-based rather than rigorously mathematical. The use of finite input–output data is demonstrated for frequency- and time-domain identification in static, dynamic, linear, nonlinear, time-invariant and time-varying systems. Simple examples are used to show readers how to perform and emulate the identification steps involved in various control design methods with more complex illustrations derived from real physical, chemical and biological applications being used to demonstrate the practical applicability of the methods described. End-of-chapter exercises (for which a downloadable instructors’ Solutions Manual is available from fill in URL here) will both help students to assimilate what they have learned and make the book suitable for self-tuition by practitioners looking to brush up on modern techniques. Graduate and final-year undergraduate students will find this text to be a practical and realistic course in system identification that can be used for assessing the processes of a variety of engineering disciplines. System Identification will help academic instructors teaching control-related to give their students a good understanding of identification methods that can be used in the real world without the encumbrance of undue mathematical detail.