Stochastic processes are tools used widely by statisticians and researchers working in the mathematics of finance. This book for self-study provides a detailed treatment of conditional expectation and probability, a topic that in principle belongs to probability theory, but is essential as a tool for stochastic processes. The book centers on exercises as the main means of explanation.

Stochastic processes are mathematical models of random phenomena that evolve according to prescribed dynamics. Processes commonly used in applications are Markov chains in discrete and continuous time, renewal and regenerative processes, Poisson processes, and Brownian motion. This volume gives an in-depth description of the structure and basic properties of these stochastic processes. A main focus is on equilibrium distributions, strong laws of large numbers, and ordinary and functional central limit theorems for cost and performance parameters. Although these results differ for various processes, they have a common trait of being limit theorems for processes with regenerative increments. Extensive examples and exercises show how to formulate stochastic models of systems as functions of a system’s data and dynamics, and how to represent and analyze cost and performance measures. Topics include stochastic networks, spatial and space-time Poisson processes, queueing, reversible processes, simulation, Brownian approximations, and varied Markovian models. The technical level of the volume is between that of introductory texts that focus on highlights of applied stochastic processes, and advanced texts that focus on theoretical aspects of processes.

This book presents basic stochastic processes, stochastic calculus including Lévy processes on one hand, and Markov and Semi Markov models on the other. From the financial point of view, essential concepts such as the Black and Scholes model, VaR indicators, actuarial evaluation, market values, fair pricing play a central role and will be presented. The authors also present basic concepts so that this series is relatively self-contained for the main audience formed by actuaries and particularly with ERM (enterprise risk management) certificates, insurance risk managers, students in Master in mathematics or economics and people involved in Solvency II for insurance companies and in Basel II and III for banks.

Building upon the previous editions, this textbook is a first course in stochastic processes taken by undergraduate and graduate students (MS and PhD students from math, statistics, economics, computer science, engineering, and finance departments) who have had a course in probability theory. It covers Markov chains in discrete and continuous time, Poisson processes, renewal processes, martingales, and option pricing. One can only learn a subject by seeing it in action, so there are a large number of examples and more than 300 carefully chosen exercises to deepen the reader’s understanding. Drawing from teaching experience and student feedback, there are many new examples and problems with solutions that use TI-83 to eliminate the tedious details of solving linear equations by hand, and the collection of exercises is much improved, with many more biological examples. Originally included in previous editions, material too advanced for this first course in stochastic processes has been eliminated while treatment of other topics useful for applications has been expanded. In addition, the ordering of topics has been improved; for example, the difficult subject of martingales is delayed until its usefulness can be applied in the treatment of mathematical finance.

This textbook explores probability and stochastic processes at a level that does not require any prior knowledge except basic calculus. It presents the fundamental concepts in a step-by-step manner, and offers remarks and warnings for deeper insights. The chapters include basic examples, which are revisited as the new concepts are introduced. To aid learning, figures and diagrams are used to help readers grasp the concepts, and the solutions to the exercises and problems. Further, a table format is also used where relevant for better comparison of the ideas and formulae. The first part of the book introduces readers to the essentials of probability, including combinatorial analysis, conditional probability, and discrete and continuous random variable. The second part then covers fundamental stochastic processes, including point, counting, renewal and regenerative processes, the Poisson process, Markov chains, queuing models and reliability theory. Primarily intended for undergraduate engineering students, it is also useful for graduate-level students wanting to refresh their knowledge of the basics of probability and stochastic processes.

Detailed coverage of probability theory, random variables and their functions, stochastic processes, linear system response to stochastic processes, Gaussian and Markov processes, and stochastic differential equations. 1973 edition.

This textbook introduces the theory of stochastic processes, that is, randomness which proceeds in time. Using concrete examples like repeated gambling and jumping frogs, it presents fundamental mathematical results through simple, clear, logical theorems and examples. It covers in detail such essential material as Markov chain recurrence criteria, the Markov chain convergence theorem, and optional stopping theorems for martingales. The final chapter provides a brief introduction to Brownian motion, Markov processes in continuous time and space, Poisson processes, and renewal theory.Interspersed throughout are applications to such topics as gambler's ruin probabilities, random walks on graphs, sequence waiting times, branching processes, stock option pricing, and Markov Chain Monte Carlo (MCMC) algorithms.The focus is always on making the theory as well-motivated and accessible as possible, to allow students and readers to learn this fascinating subject as easily and painlessly as possible.

An introduction to stochastic processes through the use of R Introduction to Stochastic Processes with R is an accessible and well-balanced presentation of the theory of stochastic processes, with an emphasis on real-world applications of probability theory in the natural and social sciences. The use of simulation, by means of the popular statistical software R, makes theoretical results come alive with practical, hands-on demonstrations. Written by a highly-qualified expert in the field, the author presents numerous examples from a wide array of disciplines, which are used to illustrate concepts and highlight computational and theoretical results. Developing readers’ problem-solving skills and mathematical maturity, Introduction to Stochastic Processes with R features: More than 200 examples and 600 end-of-chapter exercises A tutorial for getting started with R, and appendices that contain review material in probability and matrix algebra Discussions of many timely and stimulating topics including Markov chain Monte Carlo, random walk on graphs, card shuffling, Black–Scholes options pricing, applications in biology and genetics, cryptography, martingales, and stochastic calculus Introductions to mathematics as needed in order to suit readers at many mathematical levels A companion web site that includes relevant data files as well as all R code and scripts used throughout the book Introduction to Stochastic Processes with R is an ideal textbook for an introductory course in stochastic processes. The book is aimed at undergraduate and beginning graduate-level students in the science, technology, engineering, and mathematics disciplines. The book is also an excellent reference for applied mathematicians and statisticians who are interested in a review of the topic.

This book presents a concise treatment of stochastic calculus and its applications. It gives a simple but rigorous treatment of the subject including a range of advanced topics, it is useful for practitioners who use advanced theoretical results. It covers advanced applications, such as models in mathematical finance, biology and engineering.Self-contained and unified in presentation, the book contains many solved examples and exercises. It may be used as a textbook by advanced undergraduates and graduate students in stochastic calculus and financial mathematics. It is also suitable for practitioners who wish to gain an understanding or working knowledge of the subject. For mathematicians, this book could be a first text on stochastic calculus; it is good companion to more advanced texts by a way of examples and exercises. For people from other fields, it provides a way to gain a working knowledge of stochastic calculus. It shows all readers the applications of stochastic calculus methods and takes readers to the technical level required in research and sophisticated modelling.This second edition contains a new chapter on bonds, interest rates and their options. New materials include more worked out examples in all chapters, best estimators, more results on change of time, change of measure, random measures, new results on exotic options, FX options, stochastic and implied volatility, models of the age-dependent branching process and the stochastic Lotka-Volterra model in biology, non-linear filtering in engineering and five new figures.Instructors can obtain slides of the text from the author.

Most introductory textbooks on stochastic processes which cover standard topics such as Poisson process, Brownian motion, renewal theory and random walks deal inadequately with their applications. Written in a simple and accessible manner, this book addresses that inadequacy and provides guidelines and tools to study the applications. The coverage includes research developments in Markov property, martingales, regenerative phenomena and Tauberian theorems, and covers measure theory at an elementary level.