From the reviews: "This book is an excellent presentation of the application of martingale theory to the theory of Markov processes, especially multidimensional diffusions. [...] This monograph can be recommended to graduate students and research workers but also to all interested in Markov processes from a more theoretical point of view." Mathematische Operationsforschung und Statistik

Diffusion processes are a promising instrument for realistically modelling the time-continuous evolution of phenomena not only in the natural sciences but also in finance and economics. Their mathematical theory, however, is challenging, and hence diffusion modelling is often carried out incorrectly, and the according statistical inference is considered almost exclusively by theoreticians. This book explains both topics in an illustrative way which also addresses practitioners. It provides a complete overview of the current state of research and presents important, novel insights. The theory is demonstrated using real data applications.

This book presents various results and techniques from the theory of stochastic processes that are useful in the study of stochastic problems in the natural sciences. The main focus is analytical methods, although numerical methods and statistical inference methodologies for studying diffusion processes are also presented. The goal is the development of techniques that are applicable to a wide variety of stochastic models that appear in physics, chemistry and other natural sciences. Applications such as stochastic resonance, Brownian motion in periodic potentials and Brownian motors are studied and the connection between diffusion processes and time-dependent statistical mechanics is elucidated. The book contains a large number of illustrations, examples, and exercises. It will be useful for graduate-level courses on stochastic processes for students in applied mathematics, physics and engineering. Many of the topics covered in this book (reversible diffusions, convergence to equilibrium for diffusion processes, inference methods for stochastic differential equations, derivation of the generalized Langevin equation, exit time problems) cannot be easily found in textbook form and will be useful to both researchers and students interested in the applications of stochastic processes.

The aim of this book is to promote interaction between engineering, finance and insurance, as these three domains have many models and methods of solution in common for solving real-life problems. The authors point out the strict inter-relations that exist among the diffusion models used in engineering, finance and insurance. In each of the three fields, the basic diffusion models are presented and their strong similarities are discussed. Analytical, numerical and Monte Carlo simulation methods are explained with a view to applying them to obtain the solutions to the different problems presented in the book. Advanced topics such as nonlinear problems, Lévy processes and semi-Markov models in interactions with the diffusion models are discussed, as well as possible future interactions among engineering, finance and insurance. Contents 1. Diffusion Phenomena and Models. 2. Probabilistic Models of Diffusion Processes. 3. Solving Partial Differential Equations of Second Order. 4. Problems in Finance. 5. Basic PDE in Finance. 6. Exotic and American Options Pricing Theory. 7. Hitting Times for Diffusion Processes and Stochastic Models in Insurance. 8. Numerical Methods. 9. Advanced Topics in Engineering: Nonlinear Models. 10. Lévy Processes. 11. Advanced Topics in Insurance: Copula Models and VaR Techniques. 12. Advanced Topics in Finance: Semi-Markov Models. 13. Monte Carlo Semi-Markov Simulation Methods.

The main purpose of the book is to present, at a graduate level and in a self-contained way, the most important aspects of the theory of continuous stochastic processes in continuous time and to introduce some of its ramifications such as the theory of semigroups, the Malliavin calculus, and the Lyons' rough paths. This book is intended for students, or even researchers, who wish to learn the basics in a concise but complete and rigorous manner. Several exercises are distributed throughout the text to test the understanding of the reader and each chapter ends with bibliographic comments aimed at those interested in exploring the materials further. Stochastic calculus was developed in the 1950s and the range of its applications is huge and still growing today. Besides being a fundamental component of modern probability theory, domains of applications include but are not limited to: mathematical finance, biology, physics, and engineering sciences. The first part of the text is devoted to the general theory of stochastic processes. The author focuses on the existence and regularity results for processes and on the theory of martingales. This allows him to introduce the Brownian motion quickly and study its most fundamental properties. The second part deals with the study of Markov processes, in particular, diffusions. The author's goal is to stress the connections between these processes and the theory of evolution semigroups. The third part deals with stochastic integrals, stochastic differential equations and Malliavin calculus. In the fourth and final part, the author presents an introduction to the very new theory of rough paths by Terry Lyons.

This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.

This book is an easy-to-read reference providing a link between functional analysis and diffusion processes. More precisely, the book takes readers to a mathematical crossroads of functional analysis (macroscopic approach), partial differential equations (mesoscopic approach), and probability (microscopic approach) via the mathematics needed for the hard parts of diffusion processes. This work brings these three fields of analysis together and provides a profound stochastic insight (microscopic approach) into the study of elliptic boundary value problems. The author does a massive study of diffusion processes from a broad perspective and explains mathematical matters in a more easily readable way than one usually would find. The book is amply illustrated; 14 tables and 141 figures are provided with appropriate captions in such a fashion that readers can easily understand powerful techniques of functional analysis for the study of diffusion processes in probability. The scope of the author’s work has been and continues to be powerful methods of functional analysis for future research of elliptic boundary value problems and Markov processes via semigroups. A broad spectrum of readers can appreciate easily and effectively the stochastic intuition that this book conveys. Furthermore, the book will serve as a sound basis both for researchers and for graduate students in pure and applied mathematics who are interested in a modern version of the classical potential theory and Markov processes. For advanced undergraduates working in functional analysis, partial differential equations, and probability, it provides an effective opening to these three interrelated fields of analysis. Beginning graduate students and mathematicians in the field looking for a coherent overview will find the book to be a helpful beginning. This work will be a major influence in a very broad field of study for a long time.

In this book, Professor Pinsky gives a self-contained account of the theory of positive harmonic functions for second order elliptic operators, using an integrated probabilistic and analytic approach. The book begins with a treatment of the construction and basic properties of diffusion processes. This theory then serves as a vehicle for studying positive harmonic funtions. Starting with a rigorous treatment of the spectral theory of elliptic operators with nice coefficients on smooth, bounded domains, the author then develops the theory of the generalized principal eigenvalue, and the related criticality theory for elliptic operators on arbitrary domains. Martin boundary theory is considered, and the Martin boundary is explicitly calculated for several classes of operators. The book provides an array of criteria for determining whether a diffusion process is transient or recurrent. Also introduced are the theory of bounded harmonic functions, and Brownian motion on manifolds of negative curvature. Many results that form the folklore of the subject are here given a rigorous exposition, making this book a useful reference for the specialist, and an excellent guide for the graduate student.

The first comprehensive account of controlled diffusions with a focus on ergodic or 'long run average' control.