This book is a substantially revised and expanded edition reflecting major developments in stochastic numerics since the first edition was published in 2004. The new topics, in particular, include mean-square and weak approximations in the case of nonglobally Lipschitz coefficients of Stochastic Differential Equations (SDEs) including the concept of rejecting trajectories; conditional probabilistic representations and their application to practical variance reduction using regression methods; multi-level Monte Carlo method; computing ergodic limits and additional classes of geometric integrators used in molecular dynamics; numerical methods for FBSDEs; approximation of parabolic SPDEs and nonlinear filtering problem based on the method of characteristics. SDEs have many applications in the natural sciences and in finance. Besides, the employment of probabilistic representations together with the Monte Carlo technique allows us to reduce the solution of multi-dimensional problems for partial differential equations to the integration of stochastic equations. This approach leads to powerful computational mathematics that is presented in the treatise. Many special schemes for SDEs are presented. In the second part of the book numerical methods for solving complicated problems for partial differential equations occurring in practical applications, both linear and nonlinear, are constructed. All the methods are presented with proofs and hence founded on rigorous reasoning, thus giving the book textbook potential. An overwhelming majority of the methods are accompanied by the corresponding numerical algorithms which are ready for implementation in practice. The book addresses researchers and graduate students in numerical analysis, applied probability, physics, chemistry, and engineering as well as mathematical biology and financial mathematics.

Stochastic numerical methods play an important role in large scale computations in the applied sciences. The first goal of this book is to give a mathematical description of classical direct simulation Monte Carlo (DSMC) procedures for rarefied gases, using the theory of Markov processes as a unifying framework. The second goal is a systematic treatment of an extension of DSMC, called stochastic weighted particle method. This method includes several new features, which are introduced for the purpose of variance reduction (rare event simulation). Rigorous convergence results as well as detailed numerical studies are presented.

The numerical analysis of stochastic differential equations (SDEs) differs significantly from that of ordinary differential equations. This book provides an easily accessible introduction to SDEs, their applications and the numerical methods to solve such equations. From the reviews: "The authors draw upon their own research and experiences in obviously many disciplines... considerable time has obviously been spent writing this in the simplest language possible." --ZAMP

Stochastic Numerical Methods introduces at Master level the numerical methods that use probability or stochastic concepts to analyze random processes. The book aims at being rather general and is addressed at students of natural sciences (Physics, Chemistry, Mathematics, Biology, etc.) and Engineering, but also social sciences (Economy, Sociology, etc.) where some of the techniques have been used recently to numerically simulate different agent-based models. Examples included in the book range from phase-transitions and critical phenomena, including details of data analysis (extraction of critical exponents, finite-size effects, etc.), to population dynamics, interfacial growth, chemical reactions, etc. Program listings are integrated in the discussion of numerical algorithms to facilitate their understanding. From the contents: Review of Probability Concepts Monte Carlo Integration Generation of Uniform and Non-uniform Random Numbers: Non-correlated Values Dynamical Methods Applications to Statistical Mechanics Introduction to Stochastic Processes Numerical Simulation of Ordinary and Partial Stochastic Differential Equations Introduction to Master Equations Numerical Simulations of Master Equations Hybrid Monte Carlo Generation of n-Dimensional Correlated Gaussian Variables Collective Algorithms for Spin Systems Histogram Extrapolation Multicanonical Simulations

The@ first graduate-level textbook to focus on fundamental aspects of numerical methods for stochastic computations, this book describes the class of numerical methods based on generalized polynomial chaos (gPC). These fast, efficient, and accurate methods are an extension of the classical spectral methods of high-dimensional random spaces. Designed to simulate complex systems subject to random inputs, these methods are widely used in many areas of computer science and engineering. The book introduces polynomial approximation theory and probability theory; describes the basic theory of gPC methods through numerical examples and rigorous development; details the procedure for converting stochastic equations into deterministic ones; using both the Galerkin and collocation approaches; and discusses the distinct differences and challenges arising from high-dimensional problems. The last section is devoted to the application of gPC methods to critical areas such as inverse problems and data assimilation. Ideal for use by graduate students and researchers both in the classroom and for self-study, Numerical Methods for Stochastic Computations provides the required tools for in-depth research related to stochastic computations. The first graduate-level textbook to focus on the fundamentals of numerical methods for stochastic computations Ideal introduction for graduate courses or self-study Fast, efficient, and accurate numerical methods Polynomial approximation theory and probability theory included Basic gPC methods illustrated through examples

This book covers numerical methods for stochastic partial differential equations with white noise using the framework of Wong-Zakai approximation. The book begins with some motivational and background material in the introductory chapters and is divided into three parts. Part I covers numerical stochastic ordinary differential equations. Here the authors start with numerical methods for SDEs with delay using the Wong-Zakai approximation and finite difference in time. Part II covers temporal white noise. Here the authors consider SPDEs as PDEs driven by white noise, where discretization of white noise (Brownian motion) leads to PDEs with smooth noise, which can then be treated by numerical methods for PDEs. In this part, recursive algorithms based on Wiener chaos expansion and stochastic collocation methods are presented for linear stochastic advection-diffusion-reaction equations. In addition, stochastic Euler equations are exploited as an application of stochastic collocation methods, where a numerical comparison with other integration methods in random space is made. Part III covers spatial white noise. Here the authors discuss numerical methods for nonlinear elliptic equations as well as other equations with additive noise. Numerical methods for SPDEs with multiplicative noise are also discussed using the Wiener chaos expansion method. In addition, some SPDEs driven by non-Gaussian white noise are discussed and some model reduction methods (based on Wick-Malliavin calculus) are presented for generalized polynomial chaos expansion methods. Powerful techniques are provided for solving stochastic partial differential equations. This book can be considered as self-contained. Necessary background knowledge is presented in the appendices. Basic knowledge of probability theory and stochastic calculus is presented in Appendix A. In Appendix B some semi-analytical methods for SPDEs are presented. In Appendix C an introduction to Gauss quadrature is provided. In Appendix D, all the conclusions which are needed for proofs are presented, and in Appendix E a method to compute the convergence rate empirically is included. In addition, the authors provide a thorough review of the topics, both theoretical and computational exercises in the book with practical discussion of the effectiveness of the methods. Supporting Matlab files are made available to help illustrate some of the concepts further. Bibliographic notes are included at the end of each chapter. This book serves as a reference for graduate students and researchers in the mathematical sciences who would like to understand state-of-the-art numerical methods for stochastic partial differential equations with white noise.

This book is intended to make recent results on the derivation of higher order numerical schemes for random ordinary differential equations (RODEs) available to a broader readership, and to familiarize readers with RODEs themselves as well as the closely associated theory of random dynamical systems. In addition, it demonstrates how RODEs are being used in the biological sciences, where non-Gaussian and bounded noise are often more realistic than the Gaussian white noise in stochastic differential equations (SODEs). RODEs are used in many important applications and play a fundamental role in the theory of random dynamical systems. They can be analyzed pathwise with deterministic calculus, but require further treatment beyond that of classical ODE theory due to the lack of smoothness in their time variable. Although classical numerical schemes for ODEs can be used pathwise for RODEs, they rarely attain their traditional order since the solutions of RODEs do not have sufficient smoothness to have Taylor expansions in the usual sense. However, Taylor-like expansions can be derived for RODEs using an iterated application of the appropriate chain rule in integral form, and represent the starting point for the systematic derivation of consistent higher order numerical schemes for RODEs. The book is directed at a wide range of readers in applied and computational mathematics and related areas as well as readers who are interested in the applications of mathematical models involving random effects, in particular in the biological sciences.The level of this book is suitable for graduate students in applied mathematics and related areas, computational sciences and systems biology. A basic knowledge of ordinary differential equations and numerical analysis is required.

The new edition is significantly updated and expanded. This unique collection of review articles, ranging from fundamental concepts up to latest applications, contains individual contributions written by renowned experts in the relevant fields. Much attention is paid to ensuring fast access to the information, with each carefully reviewed article featuring cross-referencing, references to the most relevant publications in the field, and suggestions for further reading, both introductory as well as more specialized. While the chapters on group theory, integral transforms, Monte Carlo methods, numerical analysis, perturbation theory, and special functions are thoroughly rewritten, completely new content includes sections on commutative algebra, computational algebraic topology, differential geometry, dynamical systems, functional analysis, graph and network theory, PDEs of mathematical physics, probability theory, stochastic differential equations, and variational methods.