Originally published: New York: Wiley, c1988.

Linear Algebra and Matrix Analysis for Statistics offers a gradual exposition to linear algebra without sacrificing the rigor of the subject. It presents both the vector space approach and the canonical forms in matrix theory. The book is as self-contained as possible, assuming no prior knowledge of linear algebra. The authors first address the rudimentary mechanics of linear systems using Gaussian elimination and the resulting decompositions. They introduce Euclidean vector spaces using less abstract concepts and make connections to systems of linear equations wherever possible. After illustrating the importance of the rank of a matrix, they discuss complementary subspaces, oblique projectors, orthogonality, orthogonal projections and projectors, and orthogonal reduction. The text then shows how the theoretical concepts developed are handy in analyzing solutions for linear systems. The authors also explain how determinants are useful for characterizing and deriving properties concerning matrices and linear systems. They then cover eigenvalues, eigenvectors, singular value decomposition, Jordan decomposition (including a proof), quadratic forms, and Kronecker and Hadamard products. The book concludes with accessible treatments of advanced topics, such as linear iterative systems, convergence of matrices, more general vector spaces, linear transformations, and Hilbert spaces.

Subspace Identification for Linear Systems focuses on the theory, implementation and applications of subspace identification algorithms for linear time-invariant finite- dimensional dynamical systems. These algorithms allow for a fast, straightforward and accurate determination of linear multivariable models from measured input-output data. The theory of subspace identification algorithms is presented in detail. Several chapters are devoted to deterministic, stochastic and combined deterministic-stochastic subspace identification algorithms. For each case, the geometric properties are stated in a main 'subspace' Theorem. Relations to existing algorithms and literature are explored, as are the interconnections between different subspace algorithms. The subspace identification theory is linked to the theory of frequency weighted model reduction, which leads to new interpretations and insights. The implementation of subspace identification algorithms is discussed in terms of the robust and computationally efficient RQ and singular value decompositions, which are well-established algorithms from numerical linear algebra. The algorithms are implemented in combination with a whole set of classical identification algorithms, processing and validation tools in Xmath's ISID, a commercially available graphical user interface toolbox. The basic subspace algorithms in the book are also implemented in a set of Matlab files accompanying the book. An application of ISID to an industrial glass tube manufacturing process is presented in detail, illustrating the power and user-friendliness of the subspace identification algorithms and of their implementation in ISID. The identified model allows for an optimal control of the process, leading to a significant enhancement of the production quality. The applicability of subspace identification algorithms in industry is further illustrated with the application of the Matlab files to ten practical problems. Since all necessary data and Matlab files are included, the reader can easily step through these applications, and thus get more insight in the algorithms. Subspace Identification for Linear Systems is an important reference for all researchers in system theory, control theory, signal processing, automization, mechatronics, chemical, electrical, mechanical and aeronautical engineering.

The essential introduction to the theory and application of linear models—now in a valuable new edition Since most advanced statistical tools are generalizations of the linear model, it is neces-sary to first master the linear model in order to move forward to more advanced concepts. The linear model remains the main tool of the applied statistician and is central to the training of any statistician regardless of whether the focus is applied or theoretical. This completely revised and updated new edition successfully develops the basic theory of linear models for regression, analysis of variance, analysis of covariance, and linear mixed models. Recent advances in the methodology related to linear mixed models, generalized linear models, and the Bayesian linear model are also addressed. Linear Models in Statistics, Second Edition includes full coverage of advanced topics, such as mixed and generalized linear models, Bayesian linear models, two-way models with empty cells, geometry of least squares, vector-matrix calculus, simultaneous inference, and logistic and nonlinear regression. Algebraic, geometrical, frequentist, and Bayesian approaches to both the inference of linear models and the analysis of variance are also illustrated. Through the expansion of relevant material and the inclusion of the latest technological developments in the field, this book provides readers with the theoretical foundation to correctly interpret computer software output as well as effectively use, customize, and understand linear models. This modern Second Edition features: New chapters on Bayesian linear models as well as random and mixed linear models Expanded discussion of two-way models with empty cells Additional sections on the geometry of least squares Updated coverage of simultaneous inference The book is complemented with easy-to-read proofs, real data sets, and an extensive bibliography. A thorough review of the requisite matrix algebra has been addedfor transitional purposes, and numerous theoretical and applied problems have been incorporated with selected answers provided at the end of the book. A related Web site includes additional data sets and SAS® code for all numerical examples. Linear Model in Statistics, Second Edition is a must-have book for courses in statistics, biostatistics, and mathematics at the upper-undergraduate and graduate levels. It is also an invaluable reference for researchers who need to gain a better understanding of regression and analysis of variance.

Each chapter in this book describes relevant background theory followed by specialized results. Hundreds of identities, inequalities, and matrix facts are stated clearly with cross references, citations to the literature, and illuminating remarks.

Discrete-Time Linear Systems: Theory and Design with Applications combines system theory and design in order to show the importance of system theory and its role in system design. The book focuses on system theory (including optimal state feedback and optimal state estimation) and system design (with applications to feedback control systems and wireless transceivers, plus system identification and channel estimation).

Matrix algebra is one of the most important areas of mathematics for data analysis and for statistical theory. This much-needed work presents the relevant aspects of the theory of matrix algebra for applications in statistics. It moves on to consider the various types of matrices encountered in statistics, such as projection matrices and positive definite matrices, and describes the special properties of those matrices. Finally, it covers numerical linear algebra, beginning with a discussion of the basics of numerical computations, and following up with accurate and efficient algorithms for factoring matrices, solving linear systems of equations, and extracting eigenvalues and eigenvectors.

Linear and Non-Linear System Theory focuses on the basics of linear and non-linear systems, optimal control and optimal estimation with an objective to understand the basics of state space approach linear and non-linear systems and its analysis thereof. Divided into eight chapters, materials cover an introduction to the advanced topics in the field of linear and non-linear systems, optimal control and estimation supported by mathematical tools, detailed case studies and numerical and exercise problems. This book is aimed at senior undergraduate and graduate students in electrical, instrumentation, electronics, chemical, control engineering and other allied branches of engineering. Features Covers both linear and non-linear system theory Explores state feedback control and state estimator concepts Discusses non-linear systems and phase plane analysis Includes non-linear system stability and bifurcation behaviour Elaborates optimal control and estimation

Modern control theory and in particular state space or state variable methods can be adapted to the description of many different systems because it depends strongly on physical modeling and physical intuition. The laws of physics are in the form of differential equations and for this reason, this book concentrates on system descriptions in this form. This means coupled systems of linear or nonlinear differential equations. The physical approach is emphasized in this book because it is most natural for complex systems. It also makes what would ordinarily be a difficult mathematical subject into one which can straightforwardly be understood intuitively and which deals with concepts which engineering and science students are already familiar. In this way it is easy to immediately apply the theory to the understanding and control of ordinary systems. Application engineers, working in industry, will also find this book interesting and useful for this reason. In line with the approach set forth above, the book first deals with the modeling of systems in state space form. Both transfer function and differential equation modeling methods are treated with many examples. Linearization is treated and explained first for very simple nonlinear systems and then more complex systems. Because computer control is so fundamental to modern applications, discrete time modeling of systems as difference equations is introduced immediately after the more intuitive differential equation models. The conversion of differential equation models to difference equations is also discussed at length, including transfer function formulations. A vital problem in modern control is how to treat noise in control systems. Nevertheless this question is rarely treated in many control system textbooks because it is considered to be too mathematical and too difficult in a second course on controls. In this textbook a simple physical approach is made to the description of noise and stochastic disturbances which is easy to understand and apply to common systems. This requires only a few fundamental statistical concepts which are given in a simple introduction which lead naturally to the fundamental noise propagation equation for dynamic systems, the Lyapunov equation. This equation is given and exemplified both in its continuous and discrete time versions. With the Lyapunov equation available to describe state noise propagation, it is a very small step to add the effect of measurements and measurement noise. This gives immediately the Riccati equation for optimal state estimators or Kalman filters. These important observers are derived and illustrated using simulations in terms which make them easy to understand and easy to apply to real systems. The use of LQR regulators with Kalman filters give LQG (Linear Quadratic Gaussian) regulators which are introduced at the end of the book. Another important subject which is introduced is the use of Kalman filters as parameter estimations for unknown parameters. The textbook is divided into 7 chapters, 5 appendices, a table of contents, a table of examples, extensive index and extensive list of references. Each chapter is provided with a summary of the main points covered and a set of problems relevant to the material in that chapter. Moreover each of the more advanced chapters (3 - 7) are provided with notes describing the history of the mathematical and technical problems which lead to the control theory presented in that chapter. Continuous time methods are the main focus in the book because these provide the most direct connection to physics. This physical foundation allows a logical presentation and gives a good intuitive feel for control system construction. Nevertheless strong attention is also given to discrete time systems. Very few proofs are included in the book but most of the important results are derived. This method of presentation makes the text very readable and gives a good foundation for reading more rigorous texts. A complete set of solutions is available for all of the problems in the text. In addition a set of longer exercises is available for use as Matlab/Simulink ‘laboratory exercises’ in connection with lectures. There is material of this kind for 12 such exercises and each exercise requires about 3 hours for its solution. Full written solutions of all these exercises are available.