This concisely written book is a rigorous and self-contained introduction to the theory of continuous-time stochastic processes. Balancing theory and applications, the authors use stochastic methods and concrete examples to model real-world problems from engineering, biomathematics, biotechnology, and finance. Suitable as a textbook for graduate or advanced undergraduate courses, the work may also be used for self-study or as a reference. The book will be of interest to students, pure and applied mathematicians, and researchers or practitioners in mathematical finance, biomathematics, physics, and engineering.

Expanding on the first edition of An Introduction to Continuous-Time Stochastic Processes, this concisely written book is a rigorous and self-contained introduction to the theory of continuous-time stochastic processes. A balance of theory and applications, the work features concrete examples of modeling real-world problems from biology, medicine, industrial applications, finance, and insurance using stochastic methods. No previous knowledge of stochastic processes is required.

Markov processes are among the most important stochastic processes for both theory and applications. This book develops the general theory of these processes, and applies this theory to various special examples.

This textbook, now in its third edition, offers a rigorous and self-contained introduction to the theory of continuous-time stochastic processes, stochastic integrals, and stochastic differential equations. Expertly balancing theory and applications, the work features concrete examples of modeling real-world problems from biology, medicine, industrial applications, finance, and insurance using stochastic methods. No previous knowledge of stochastic processes is required.

Stochastic optimization problems arise in decision-making problems under uncertainty, and find various applications in economics and finance. On the other hand, problems in finance have recently led to new developments in the theory of stochastic control. This volume provides a systematic treatment of stochastic optimization problems applied to finance by presenting the different existing methods: dynamic programming, viscosity solutions, backward stochastic differential equations, and martingale duality methods. The theory is discussed in the context of recent developments in this field, with complete and detailed proofs, and is illustrated by means of concrete examples from the world of finance: portfolio allocation, option hedging, real options, optimal investment, etc. This book is directed towards graduate students and researchers in mathematical finance, and will also benefit applied mathematicians interested in financial applications and practitioners wishing to know more about the use of stochastic optimization methods in finance.

Based on a well-established and popular course taught by the authors over many years, Stochastic Processes: An Introduction, Third Edition, discusses the modelling and analysis of random experiments, where processes evolve over time. The text begins with a review of relevant fundamental probability. It then covers gambling problems, random walks, and Markov chains. The authors go on to discuss random processes continuous in time, including Poisson, birth and death processes, and general population models, and present an extended discussion on the analysis of associated stationary processes in queues. The book also explores reliability and other random processes, such as branching, martingales, and simple epidemics. A new chapter describing Brownian motion, where the outcomes are continuously observed over continuous time, is included. Further applications, worked examples and problems, and biographical details have been added to this edition. Much of the text has been reworked. The appendix contains key results in probability for reference. This concise, updated book makes the material accessible, highlighting simple applications and examples. A solutions manual with fully worked answers of all end-of-chapter problems, and Mathematica® and R programs illustrating many processes discussed in the book, can be downloaded from crcpress.com.

An introduction to stochastic processes through the use of R Introduction to Stochastic Processes with R is an accessible and well-balanced presentation of the theory of stochastic processes, with an emphasis on real-world applications of probability theory in the natural and social sciences. The use of simulation, by means of the popular statistical software R, makes theoretical results come alive with practical, hands-on demonstrations. Written by a highly-qualified expert in the field, the author presents numerous examples from a wide array of disciplines, which are used to illustrate concepts and highlight computational and theoretical results. Developing readers’ problem-solving skills and mathematical maturity, Introduction to Stochastic Processes with R features: More than 200 examples and 600 end-of-chapter exercises A tutorial for getting started with R, and appendices that contain review material in probability and matrix algebra Discussions of many timely and stimulating topics including Markov chain Monte Carlo, random walk on graphs, card shuffling, Black–Scholes options pricing, applications in biology and genetics, cryptography, martingales, and stochastic calculus Introductions to mathematics as needed in order to suit readers at many mathematical levels A companion web site that includes relevant data files as well as all R code and scripts used throughout the book Introduction to Stochastic Processes with R is an ideal textbook for an introductory course in stochastic processes. The book is aimed at undergraduate and beginning graduate-level students in the science, technology, engineering, and mathematics disciplines. The book is also an excellent reference for applied mathematicians and statisticians who are interested in a review of the topic.

Clear presentation employs methods that recognize computer-related aspects of theory. Topics include expectations and independence, Bernoulli processes and sums of independent random variables, Markov chains, renewal theory, more. 1975 edition.

This book contains an introduction to three topics in stochastic control: discrete time stochastic control, i. e. , stochastic dynamic programming (Chapter 1), piecewise - terministic control problems (Chapter 3), and control of Ito diffusions (Chapter 4). The chapters include treatments of optimal stopping problems. An Appendix - calls material from elementary probability theory and gives heuristic explanations of certain more advanced tools in probability theory. The book will hopefully be of interest to students in several ?elds: economics, engineering, operations research, ?nance, business, mathematics. In economics and business administration, graduate students should readily be able to read it, and the mathematical level can be suitable for advanced undergraduates in mathem- ics and science. The prerequisites for reading the book are only a calculus course and a course in elementary probability. (Certain technical comments may demand a slightly better background. ) As this book perhaps (and hopefully) will be read by readers with widely diff- ing backgrounds, some general advice may be useful: Don’t be put off if paragraphs, comments, or remarks contain material of a seemingly more technical nature that you don’t understand. Just skip such material and continue reading, it will surely not be needed in order to understand the main ideas and results. The presentation avoids the use of measure theory.