Estimation of Stochastic Processes is intended for researchers in the field of econometrics, financial mathematics, statistics or signal processing. This book gives a deep understanding of spectral theory and estimation techniques for stochastic processes with stationary increments. It focuses on the estimation of functionals of unobserved values for stochastic processes with stationary increments, including ARIMA processes, seasonal time series and a class of cointegrated sequences. Furthermore, this book presents solutions to extrapolation (forecast), interpolation (missed values estimation) and filtering (smoothing) problems based on observations with and without noise, in discrete and continuous time domains. Extending the classical approach applied when the spectral densities of the processes are known, the minimax method of estimation is developed for a case where the spectral information is incomplete and the relations that determine the least favorable spectral densities for the optimal estimations are found.

We propose results of the investigation of the problem of mean square optimal estimation of linear functionals constructed from unobserved values of stationary stochastic processes. Estimates are based on observations of the processes with additive stationary noise process. The aim of the book is to develop methods for finding the optimal estimates of the functionals in the case where some observations are missing. Formulas for computing values of the mean-square errors and the spectral characteristics of the optimal linear estimates of functionals are derived in the case of spectral certainty, where the spectral densities of the processes are exactly known. The minimax robust method of estimation is applied in the case of spectral uncertainty, where the spectral densities of the processes are not known exactly while some classes of admissible spectral densities are given. The formulas that determine the least favourable spectral densities and the minimax spectral characteristics of the optimal estimates of functionals are proposed for some special classes of admissible densities.

The problem of forecasting future values of economic and physical processes, the problem of restoring lost information, cleaning signals or other data observations from noise, is magnified in an information-laden word. Methods of stochastic processes estimation depend on two main factors. The first factor is construction of a model of the process being investigated. The second factor is the available information about the structure of the process under consideration. In this book, we propose results of the investigation of the problem of mean square optimal estimation (extrapolation, interpolation, and filtering) of linear functionals depending on unobserved values of stochastic sequences and processes with periodically stationary and long memory multiplicative seasonal increments. Formulas for calculating the mean square errors and the spectral characteristics of the optimal estimates of the functionals are derived in the case of spectral certainty, where spectral structure of the considered sequences and processes are exactly known. In the case where spectral densities of the sequences and processes are not known exactly while some sets of admissible spectral densities are given, we apply the minimax-robust method of estimation.

The authors provide a comprehensive treatment of stochastic systems from the foundations of probability to stochastic optimal control. The book covers discrete- and continuous-time stochastic dynamic systems leading to the derivation of the Kalman filter, its properties, and its relation to the frequency domain Wiener filter aswell as the dynamic programming derivation of the linear quadratic Gaussian (LQG) and the linear exponential Gaussian (LEG) controllers and their relation to HÝsubscript 2¨ and HÝsubscript Ýinfinity¨¨ controllers and system robustness. This book is suitable for first-year graduate students in electrical, mechanical, chemical, and aerospace engineering specializing in systems and control. Students in computer science, economics, and possibly business will also find it useful.

The subject of modelling and application of stochastic processes is too vast to be exhausted in a single volume. In this book, attention is focused on a small subset of this vast subject. The primary emphasis is on realization and approximation of stochastic systems. Recently there has been considerable interest in the stochastic realization problem, and hence, an attempt has been made here to collect in one place some of the more recent approaches and algorithms for solving the stochastic realiza tion problem. Various different approaches for realizing linear minimum-phase systems, linear nonminimum-phase systems, and bilinear systems are presented. These approaches range from time-domain methods to spectral-domain methods. An overview of the chapter contents briefly describes these approaches. Also, in most of these chapters special attention is given to the problem of developing numerically ef ficient algorithms for obtaining reduced-order (approximate) stochastic realizations. On the application side, chapters on use of Markov random fields for modelling and analyzing image signals, use of complementary models for the smoothing problem with missing data, and nonlinear estimation are included. Chapter 1 by Klein and Dickinson develops the nested orthogonal state space realization for ARMA processes. As suggested by the name, nested orthogonal realizations possess two key properties; (i) the state variables are orthogonal, and (ii) the system matrices for the (n + l)st order realization contain as their "upper" n-th order blocks the system matrices from the n-th order realization (nesting property).

This book was first published in 2004. Many observed phenomena, from the changing health of a patient to values on the stock market, are characterised by quantities that vary over time: stochastic processes are designed to study them. This book introduces practical methods of applying stochastic processes to an audience knowledgeable only in basic statistics. It covers almost all aspects of the subject and presents the theory in an easily accessible form that is highlighted by application to many examples. These examples arise from dozens of areas, from sociology through medicine to engineering. Complementing these are exercise sets making the book suited for introductory courses in stochastic processes. Software (available from www.cambridge.org) is provided for the freely available R system for the reader to apply to all the models presented.

Since its origins in the 1940s, the subject of decision making under uncertainty has grown into a diversified area with application in several branches of engineering and in those areas of the social sciences concerned with policy analysis and prescription. These approaches required a computing capacity too expensive for the time, until the ability to collect and process huge quantities of data engendered an explosion of work in the area. This book provides succinct and rigorous treatment of the foundations of stochastic control; a unified approach to filtering, estimation, prediction, and stochastic and adaptive control; and the conceptual framework necessary to understand current trends in stochastic control, data mining, machine learning, and robotics.

Newly revised by the author, this undergraduate-level text introduces the mathematical theory of probability and stochastic processes. Using both computer simulations and mathematical models of random events, it comprises numerous applications to the physical and biological sciences, engineering, and computer science. Subjects include sample spaces, probabilities distributions and expectations of random variables, conditional expectations, Markov chains, and the Poisson process. Additional topics encompass continuous-time stochastic processes, birth and death processes, steady-state probabilities, general queuing systems, and renewal processes. Each section features worked examples, and exercises appear at the end of each chapter, with numerical solutions at the back of the book. Suggestions for further reading in stochastic processes, simulation, and various applications also appear at the end.

This book provides a mathematically rigorous treatment of the theory of nonparametric estimation and prediction for stochastic processes. It discusses discrete time and continuous time, and the emphasis is on the kernel methods. Several new results are presented concerning optimal and superoptimal convergence rates. How to implement the method is discussed in detail and several numerical results are presented. This book will be of interest to specialists in mathematical statistics and to those who wish to apply these methods to practical problems involving time series analysis.