The@ first graduate-level textbook to focus on fundamental aspects of numerical methods for stochastic computations, this book describes the class of numerical methods based on generalized polynomial chaos (gPC). These fast, efficient, and accurate methods are an extension of the classical spectral methods of high-dimensional random spaces. Designed to simulate complex systems subject to random inputs, these methods are widely used in many areas of computer science and engineering. The book introduces polynomial approximation theory and probability theory; describes the basic theory of gPC methods through numerical examples and rigorous development; details the procedure for converting stochastic equations into deterministic ones; using both the Galerkin and collocation approaches; and discusses the distinct differences and challenges arising from high-dimensional problems. The last section is devoted to the application of gPC methods to critical areas such as inverse problems and data assimilation. Ideal for use by graduate students and researchers both in the classroom and for self-study, Numerical Methods for Stochastic Computations provides the required tools for in-depth research related to stochastic computations. The first graduate-level textbook to focus on the fundamentals of numerical methods for stochastic computations Ideal introduction for graduate courses or self-study Fast, efficient, and accurate numerical methods Polynomial approximation theory and probability theory included Basic gPC methods illustrated through examples

Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest developments. It covers effective numerical methods for stochastic control problems in continuous time on two levels, that of practice and that of mathematical development. It is broadly accessible for graduate students and researchers.

This book offers a practical presentation of stochastic partial differential equations arising in physical applications and their numerical approximation.

Stochastic numerical methods play an important role in large scale computations in the applied sciences. The first goal of this book is to give a mathematical description of classical direct simulation Monte Carlo (DSMC) procedures for rarefied gases, using the theory of Markov processes as a unifying framework. The second goal is a systematic treatment of an extension of DSMC, called stochastic weighted particle method. This method includes several new features, which are introduced for the purpose of variance reduction (rare event simulation). Rigorous convergence results as well as detailed numerical studies are presented.

In various scientific and industrial fields, stochastic simulations are taking on a new importance. This is due to the increasing power of computers and practitioners’ aim to simulate more and more complex systems, and thus use random parameters as well as random noises to model the parametric uncertainties and the lack of knowledge on the physics of these systems. The error analysis of these computations is a highly complex mathematical undertaking. Approaching these issues, the authors present stochastic numerical methods and prove accurate convergence rate estimates in terms of their numerical parameters (number of simulations, time discretization steps). As a result, the book is a self-contained and rigorous study of the numerical methods within a theoretical framework. After briefly reviewing the basics, the authors first introduce fundamental notions in stochastic calculus and continuous-time martingale theory, then develop the analysis of pure-jump Markov processes, Poisson processes, and stochastic differential equations. In particular, they review the essential properties of Itô integrals and prove fundamental results on the probabilistic analysis of parabolic partial differential equations. These results in turn provide the basis for developing stochastic numerical methods, both from an algorithmic and theoretical point of view. The book combines advanced mathematical tools, theoretical analysis of stochastic numerical methods, and practical issues at a high level, so as to provide optimal results on the accuracy of Monte Carlo simulations of stochastic processes. It is intended for master and Ph.D. students in the field of stochastic processes and their numerical applications, as well as for physicists, biologists, economists and other professionals working with stochastic simulations, who will benefit from the ability to reliably estimate and control the accuracy of their simulations.

This book deals with the application of spectral methods to problems of uncertainty propagation and quanti?cation in model-based computations. It speci?cally focuses on computational and algorithmic features of these methods which are most useful in dealing with models based on partial differential equations, with special att- tion to models arising in simulations of ?uid ?ows. Implementations are illustrated through applications to elementary problems, as well as more elaborate examples selected from the authors’ interests in incompressible vortex-dominated ?ows and compressible ?ows at low Mach numbers. Spectral stochastic methods are probabilistic in nature, and are consequently rooted in the rich mathematical foundation associated with probability and measure spaces. Despite the authors’ fascination with this foundation, the discussion only - ludes to those theoretical aspects needed to set the stage for subsequent applications. The book is authored by practitioners, and is primarily intended for researchers or graduate students in computational mathematics, physics, or ?uid dynamics. The book assumes familiarity with elementary methods for the numerical solution of time-dependent, partial differential equations; prior experience with spectral me- ods is naturally helpful though not essential. Full appreciation of elaborate examples in computational ?uid dynamics (CFD) would require familiarity with key, and in some cases delicate, features of the associated numerical methods. Besides these shortcomings, our aim is to treat algorithmic and computational aspects of spectral stochastic methods with details suf?cient to address and reconstruct all but those highly elaborate examples.

This new edition incorporates new developments in numerical methods for singularly perturbed differential equations, focusing on linear convection-diffusion equations and on nonlinear flow problems that appear in computational fluid dynamics.

This book covers numerical methods for stochastic partial differential equations with white noise using the framework of Wong-Zakai approximation. The book begins with some motivational and background material in the introductory chapters and is divided into three parts. Part I covers numerical stochastic ordinary differential equations. Here the authors start with numerical methods for SDEs with delay using the Wong-Zakai approximation and finite difference in time. Part II covers temporal white noise. Here the authors consider SPDEs as PDEs driven by white noise, where discretization of white noise (Brownian motion) leads to PDEs with smooth noise, which can then be treated by numerical methods for PDEs. In this part, recursive algorithms based on Wiener chaos expansion and stochastic collocation methods are presented for linear stochastic advection-diffusion-reaction equations. In addition, stochastic Euler equations are exploited as an application of stochastic collocation methods, where a numerical comparison with other integration methods in random space is made. Part III covers spatial white noise. Here the authors discuss numerical methods for nonlinear elliptic equations as well as other equations with additive noise. Numerical methods for SPDEs with multiplicative noise are also discussed using the Wiener chaos expansion method. In addition, some SPDEs driven by non-Gaussian white noise are discussed and some model reduction methods (based on Wick-Malliavin calculus) are presented for generalized polynomial chaos expansion methods. Powerful techniques are provided for solving stochastic partial differential equations. This book can be considered as self-contained. Necessary background knowledge is presented in the appendices. Basic knowledge of probability theory and stochastic calculus is presented in Appendix A. In Appendix B some semi-analytical methods for SPDEs are presented. In Appendix C an introduction to Gauss quadrature is provided. In Appendix D, all the conclusions which are needed for proofs are presented, and in Appendix E a method to compute the convergence rate empirically is included. In addition, the authors provide a thorough review of the topics, both theoretical and computational exercises in the book with practical discussion of the effectiveness of the methods. Supporting Matlab files are made available to help illustrate some of the concepts further. Bibliographic notes are included at the end of each chapter. This book serves as a reference for graduate students and researchers in the mathematical sciences who would like to understand state-of-the-art numerical methods for stochastic partial differential equations with white noise.

With this hands-on introduction readers will learn what SDEs are all about and how they should use them in practice.

This highly acclaimed work, first published by Prentice Hall in 1989, is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the fundamental convergence, rate of convergence, communication, and synchronization issues associated with such algorithms. This is an extensive book, which aside from its focus on parallel and distributed algorithms, contains a wealth of material on a broad variety of computation and optimization topics. It is an excellent supplement to several of our other books, including Convex Optimization Algorithms (Athena Scientific, 2015), Nonlinear Programming (Athena Scientific, 1999), Dynamic Programming and Optimal Control (Athena Scientific, 2012), Neuro-Dynamic Programming (Athena Scientific, 1996), and Network Optimization (Athena Scientific, 1998). The on-line edition of the book contains a 95-page solutions manual.