This book describes the classical smoothing, filtering and prediction techniques together with some more recently developed embellishments for improving performance within applications. It aims to present the subject in an accessible way, so that it can serve as a practical guide for undergraduates and newcomers to the field. The material is organised as a ten-lecture course. The foundations are laid in Chapters 1 and 2, which explain minimum-mean-square-error solution construction and asymptotic behaviour. Chapters 3 and 4 introduce continuous-time and discrete-time minimum-variance filtering. Generalisations for missing data, deterministic inputs, correlated noises, direct feedthrough terms, output estimation and equalisation are described. Chapter 5 simplifies the minimum-variance filtering results for steady-state problems. Observability, Riccati equation solution convergence, asymptotic stability and Wiener filter equivalence are discussed. Chapters 6 and 7 cover the subject of continuous-time and discrete-time smoothing. The main fixed-lag, fixed-point and fixed-interval smoother results are derived. It is shown that the minimum-variance fixed-interval smoother attains the best performance. Chapter 8 attends to parameter estimation. As the above-mentioned approaches all rely on knowledge of the underlying model parameters, maximum-likelihood techniques within expectation-maximisation algorithms for joint state and parameter estimation are described. Chapter 9 is concerned with robust techniques that accommodate uncertainties within problem specifications. An extra term within Riccati equations enables designers to trade-off average error and peak error performance. Chapter 10 rounds off the course by applying the afore-mentioned linear techniques to nonlinear estimation problems. It is demonstrated that step-wise linearisations can be used within predictors, filters and smoothers, albeit by forsaking optimal performance guarantees.

Smoothing is often used to reduce noise within an image or to produce a less pixelated image. Most smoothing methods are based on low pass filters. Smoothing is also usually based on a single value representing the image, such as the average value of the image or the middle (median) value. In image processing, to smooth a data set is to create an approximating function that attempts to capture important patterns in the data, while leaving out noise or other fine-scale structures/rapid phenomena. In smoothing, the data points of a signal are modified so individual points (presumably because of noise) are reduced, and points that are lower than the adjacent points are increased leading to a smoother signal. Smoothing may be used in two important ways that can aid in data analysis; by being able to extract more information from the data as long as the assumption of smoothing is reasonable and; by being able to provide analyses that are both flexible and robust. Filtering and prediction is about observing moving objects when the observations are corrupted by random errors. Smoothing, Filtering and Prediction - Estimating The Past, Present and Future describes the classical smoothing, filtering and prediction techniques together with some more recently developed embellishments for improving performance within applications. It aims to present the subject in an accessible way, so that it can serve as a practical guide for undergraduates and newcomers to the field.

Scientists, engineers and the like are a strange lot. Unperturbed by societal norms, they direct their energies to finding better alternatives to existing theories and concocting solutions to unsolved problems. Driven by an insatiable curiosity, they record their observations and crunch the numbers. This tome is about the science of crunching. It's about digging out something of value from the detritus that others tend to leave behind. The described approaches involve constructing models to process the available data. Smoothing entails revisiting historical records in an endeavour to understand something of the past. Filtering refers to estimating what is happening currently, whereas prediction is concerned with hazarding a guess about what might happen next. This book describes the classical smoothing, filtering and prediction techniques together with some more recently developed embellishments for improving performance within applications. It aims to present the subject in an accessible way, so that it can serve as a practical guide for undergraduates and newcomers to the field. The material is organised as an eleven-lecture course. The foundations are laid in Chapters 1 and 2, which explain minimum-mean-square-error solution construction and asymptotic behaviour. Chapters 3 and 4 introduce continuous-time and discrete-time minimum-variance filtering. Generalisations for missing data, deterministic inputs, correlated noises, direct feedthrough terms, output estimation and equalisation are described. Chapter 5 simplifies the minimum-variance filtering results for steady-state problems. Observability, Riccati equation solution convergence, asymptotic stability and Wiener filter equivalence are discussed. Chapters 6 and 7 cover the subject of continuous-time and discrete-time smoothing. The main fixed-lag, fixed-point and fixed-interval smoother results are derived. It is shown that the minimum-variance fixed-interval smoother attains the best performance. Chapter 8 attends to parameter estimation. As the above-mentioned approaches all rely on knowledge of the underlying model parameters, maximum-likelihood techniques within expectation-maximisation algorithms for joint state and parameter estimation are described. Chapter 9 is concerned with robust techniques that accommodate uncertainties within problem specifications. An extra term within Riccati equations enables designers to trade-off average error and peak error performance. Chapter 10 applies the afore-mentioned linear techniques to nonlinear estimation problems. It is demonstrated that step-wise linearisations can be used within predictors, filters and smoothers, albeit by forsaking optimal performance guarantees. Chapter 11 rounds off the course by exploiting knowledge about transition probabilities. HMM and minimum-variance-HMM filters and smoothers are derived. The improved performance offered by these techniques needs to be reconciled against the significantly higher calculation overheads.

A descriptive account based on the theory as well as principles of smoothing, filtering and prediction techniques has been presented in this book. It aims to provide understanding of classical filtering, prediction techniques and smoothing techniques along with newly developed embellishments for enhancing performance in applications. It describes the domain in a vivid manner for the purpose of serving as a valuable guide for students as well as experts. It extensively discusses minimum-mean-square-error solution construction and asymptotic behavior, continuous-time and discrete-time minimum-variance filtering, minimum-variance filtering results for steady-state problems and continuous-time and discrete-time smoothing. It further elaborates on robust techniques that accommodate uncertainties within problem specifications, parameter estimation, applications of Riccati equations, etc. These afore-mentioned linear techniques have been applied to various nonlinear estimation problems towards the end of the book. Although they have a risk of assurance of optical performance, these mentioned linearizations can be employed in predictors, filters and smoothers. The book serves the objective of imparting practical knowledge amongst students interested in this field.

A unified Bayesian treatment of the state-of-the-art filtering, smoothing, and parameter estimation algorithms for non-linear state space models.

Based on the author’s own research, this book rigorously and systematically develops the theory of Gaussian white noise measures on Hilbert spaces to provide a comprehensive account of nonlinear filtering theory. Covers Markov processes, cylinder and quasi-cylinder probabilities and conditional expectation as well as predictio0n and smoothing and the varied processes used in filtering. Especially useful for electronic engineers and mathematical statisticians for explaining the systematic use of finely additive white noise theory leading to a more simplified and direct presentation.

Graduate-level text extends studies of signal processing, particularly regarding communication systems and digital filtering theory. Topics include filtering, linear systems, and estimation; discrete-time Kalman filter; time-invariant filters; more. 1979 edition.