This is a textbook for advanced undergraduate students and beginning graduate students in applied mathematics. It presents the basic mathematical foundations of stochastic analysis (probability theory and stochastic processes) as well as some important practical tools and applications (e.g., the connection with differential equations, numerical methods, path integrals, random fields, statistical physics, chemical kinetics, and rare events). The book strikes a nice balance between mathematical formalism and intuitive arguments, a style that is most suited for applied mathematicians. Readers can learn both the rigorous treatment of stochastic analysis as well as practical applications in modeling and simulation. Numerous exercises nicely supplement the main exposition.

This is an introduction to stochastic integration and stochastic differential equations written in an understandable way for a wide audience, from students of mathematics to practitioners in biology, chemistry, physics, and finances. The presentation is based on the naïve stochastic integration, rather than on abstract theories of measure and stochastic processes. The proofs are rather simple for practitioners and, at the same time, rather rigorous for mathematicians. Detailed application examples in natural sciences and finance are presented. Much attention is paid to simulation diffusion processes. The topics covered include Brownian motion; motivation of stochastic models with Brownian motion; Itô and Stratonovich stochastic integrals, Itô’s formula; stochastic differential equations (SDEs); solutions of SDEs as Markov processes; application examples in physical sciences and finance; simulation of solutions of SDEs (strong and weak approximations). Exercises with hints and/or solutions are also provided.

With this hands-on introduction readers will learn what SDEs are all about and how they should use them in practice.

This self-contained, practical, entry-level text integrates the basic principles of applied mathematics, applied probability, and computational science for a clear presentation of stochastic processes and control for jump diffusions in continuous time. The author covers the important problem of controlling these systems and, through the use of a jump calculus construction, discusses the strong role of discontinuous and nonsmooth properties versus random properties in stochastic systems.

Stochastic processes are mathematical models of random phenomena that evolve according to prescribed dynamics. Processes commonly used in applications are Markov chains in discrete and continuous time, renewal and regenerative processes, Poisson processes, and Brownian motion. This volume gives an in-depth description of the structure and basic properties of these stochastic processes. A main focus is on equilibrium distributions, strong laws of large numbers, and ordinary and functional central limit theorems for cost and performance parameters. Although these results differ for various processes, they have a common trait of being limit theorems for processes with regenerative increments. Extensive examples and exercises show how to formulate stochastic models of systems as functions of a system’s data and dynamics, and how to represent and analyze cost and performance measures. Topics include stochastic networks, spatial and space-time Poisson processes, queueing, reversible processes, simulation, Brownian approximations, and varied Markovian models. The technical level of the volume is between that of introductory texts that focus on highlights of applied stochastic processes, and advanced texts that focus on theoretical aspects of processes.

This textbook introduces the major ideas of stochastic analysis with a view to modeling or simulating systems involving randomness. Suitable for students and researchers in applied mathematics and related disciplines, this book prepares readers to solve concrete problems arising in physically motivated models. The author?s practical approach avoids measure theory while retaining rigor for cases where it helps build techniques or intuition. Topics covered include Markov chains (discrete and continuous), Gaussian processes, It“ calculus, and stochastic differential equations and their associated PDEs. We ask questions such as: How does probability evolve? How do statistics evolve? How can we solve for time-dependent quantities such as first-passage times? How can we set up a model that includes fundamental principles such as time-reversibility (detailed balance)? How can we simulate a stochastic process numerically? Applied Stochastic Analysis invites readers to develop tools and insights for tackling physical systems involving randomness. Exercises accompany the text throughout, with frequent opportunities to implement simulation algorithms. A strong undergraduate background in linear algebra, probability, ODEs, and PDEs is assumed, along with the mathematical sophistication characteristic of a graduate student.

Stochastic Analysis and Diffusion Processes presents a simple, mathematical introduction to Stochastic Calculus and its applications. The book builds the basic theory and offers a careful account of important research directions in Stochastic Analysis. The breadth and power of Stochastic Analysis, and probabilistic behavior of diffusion processes are told without compromising on the mathematical details. Starting with the construction of stochastic processes, the book introduces Brownian motion and martingales. The book proceeds to construct stochastic integrals, establish the Itô formula, and discuss its applications. Next, attention is focused on stochastic differential equations (SDEs) which arise in modeling physical phenomena, perturbed by random forces. Diffusion processes are solutions of SDEs and form the main theme of this book. The Stroock-Varadhan martingale problem, the connection between diffusion processes and partial differential equations, Gaussian solutions of SDEs, and Markov processes with jumps are presented in successive chapters. The book culminates with a careful treatment of important research topics such as invariant measures, ergodic behavior, and large deviation principle for diffusions. Examples are given throughout the book to illustrate concepts and results. In addition, exercises are given at the end of each chapter that will help the reader to understand the concepts better. The book is written for graduate students, young researchers and applied scientists who are interested in stochastic processes and their applications. The reader is assumed to be familiar with probability theory at graduate level. The book can be used as a text for a graduate course on Stochastic Analysis.

This book presents various results and techniques from the theory of stochastic processes that are useful in the study of stochastic problems in the natural sciences. The main focus is analytical methods, although numerical methods and statistical inference methodologies for studying diffusion processes are also presented. The goal is the development of techniques that are applicable to a wide variety of stochastic models that appear in physics, chemistry and other natural sciences. Applications such as stochastic resonance, Brownian motion in periodic potentials and Brownian motors are studied and the connection between diffusion processes and time-dependent statistical mechanics is elucidated. The book contains a large number of illustrations, examples, and exercises. It will be useful for graduate-level courses on stochastic processes for students in applied mathematics, physics and engineering. Many of the topics covered in this book (reversible diffusions, convergence to equilibrium for diffusion processes, inference methods for stochastic differential equations, derivation of the generalized Langevin equation, exit time problems) cannot be easily found in textbook form and will be useful to both researchers and students interested in the applications of stochastic processes.

Here is a rigorous introduction to the most important and useful solution methods of various types of stochastic control problems for jump diffusions and its applications. Discussion includes the dynamic programming method and the maximum principle method, and their relationship. The text emphasises real-world applications, primarily in finance. Results are illustrated by examples, with end-of-chapter exercises including complete solutions. The 2nd edition adds a chapter on optimal control of stochastic partial differential equations driven by Lévy processes, and a new section on optimal stopping with delayed information. Basic knowledge of stochastic analysis, measure theory and partial differential equations is assumed.