This book provides a self-contained review of all the relevant topics in probability theory. A software package called MAXIM, which runs on MATLAB, is made available for downloading. Vidyadhar G. Kulkarni is Professor of Operations Research at the University of North Carolina at Chapel Hill.

Coherent introduction to techniques also offers a guide to the mathematical, numerical, and simulation tools of systems analysis. Includes formulation of models, analysis, and interpretation of results. 1995 edition.

An Introduction to Stochastic Modeling provides information pertinent to the standard concepts and methods of stochastic modeling. This book presents the rich diversity of applications of stochastic processes in the sciences. Organized into nine chapters, this book begins with an overview of diverse types of stochastic models, which predicts a set of possible outcomes weighed by their likelihoods or probabilities. This text then provides exercises in the applications of simple stochastic analysis to appropriate problems. Other chapters consider the study of general functions of independent, identically distributed, nonnegative random variables representing the successive intervals between renewals. This book discusses as well the numerous examples of Markov branching processes that arise naturally in various scientific disciplines. The final chapter deals with queueing models, which aid the design process by predicting system performance. This book is a valuable resource for students of engineering and management science. Engineers will also find this book useful.

Building on the author’s more than 35 years of teaching experience, Modeling and Analysis of Stochastic Systems, Third Edition, covers the most important classes of stochastic processes used in the modeling of diverse systems. For each class of stochastic process, the text includes its definition, characterization, applications, transient and limiting behavior, first passage times, and cost/reward models. The third edition has been updated with several new applications, including the Google search algorithm in discrete time Markov chains, several examples from health care and finance in continuous time Markov chains, and square root staffing rule in Queuing models. More than 50 new exercises have been added to enhance its use as a course text or for self-study. The sequence of chapters and exercises has been maintained between editions, to enable those now teaching from the second edition to use the third edition. Rather than offer special tricks that work in specific problems, this book provides thorough coverage of general tools that enable the solution and analysis of stochastic models. After mastering the material in the text, readers will be well-equipped to build and analyze useful stochastic models for real-life situations.

This practical and accessible text enables readers from engineering, business, operations research, public policy and computer science to analyze stochastic systems. Emphasizing the modeling of real-life situations with stochastic elements and analyzing the resulting stochastic model, it presents the major cases of useful stochastic processes-discrete and continuous time Markov chains, renewal processes, regenerative processes, and Markov regenerative processes. The author provides reader-friendly yet rigorous coverage. He follows a set pattern of development for each class of stochastic processes and introduces Markov chains before renewal processes, so that readers can begin modeling systems early. He demonstrates both numerical and analytical solution methods in detail and dedicates a separate chapter to queueing applications. Modeling and Analysis of Stochastic Systems includes numerous worked examples and exercises, conveniently categorized as modeling, computational, or conceptual and making difficult concepts easy to grasp. Taking a practical approach to working with stochastic models, this book helps readers to model and analyze the increasingly complex and interdependent systems made possible by recent advances.

Building on the author’s more than 35 years of teaching experience, Modeling and Analysis of Stochastic Systems, Third Edition, covers the most important classes of stochastic processes used in the modeling of diverse systems. For each class of stochastic process, the text includes its definition, characterization, applications, transient and limiting behavior, first passage times, and cost/reward models. The third edition has been updated with several new applications, including the Google search algorithm in discrete time Markov chains, several examples from health care and finance in continuous time Markov chains, and square root staffing rule in Queuing models. More than 50 new exercises have been added to enhance its use as a course text or for self-study. The sequence of chapters and exercises has been maintained between editions, to enable those now teaching from the second edition to use the third edition. Rather than offer special tricks that work in specific problems, this book provides thorough coverage of general tools that enable the solution and analysis of stochastic models. After mastering the material in the text, readers will be well-equipped to build and analyze useful stochastic models for real-life situations.

Pt. I. Stochastic analysis and systems. 1. Multidimensional Wick-Ito formula for Gaussian processes / D. Nualart and S. Ortiz-Latorre. 2. Fractional white noise multiplication / A.H. Tsoi. 3. Invariance principle of regime-switching diffusions / C. Zhu and G. Yin -- pt. II. Finance and stochastics. 4. Real options and competition / A. Bensoussan, J.D. Diltz and S.R. Hoe. 5. Finding expectations of monotone functions of binary random variables by simulation, with applications to reliability, finance, and round robin tournaments / M. Brown, E.A. Pekoz and S.M. Ross. 6. Filtering with counting process observations and other factors : applications to bond price tick data / X. Hu, D.R. Kuipers and Y. Zeng. 7. Jump bond markets some steps towards general models in applications to hedging and utility problems / M. Kohlmann and D. Xiong. 8. Recombining tree for regime-switching model : algorithm and weak convergence / R.H. Liu. 9. Optimal reinsurance under a jump diffusion model / S. Luo. 10. Applications of counting processes and martingales in survival analysis / J. Sun. 11. Stochastic algorithms and numerics for mean-reverting asset trading / Q. Zhang, C. Zhuang and G. Yin

Stochastic discrete-event systems (SDES) capture the randomness in choices due to activity delays and the probabilities of decisions. This book delivers a comprehensive overview on modeling with a quantitative evaluation of SDES. It presents an abstract model class for SDES as a pivotal unifying result and details important model classes. The book also includes nontrivial examples to explain real-world applications of SDES.

This practical introduction to stochastic reaction-diffusion modelling is based on courses taught at the University of Oxford. The authors discuss the essence of mathematical methods which appear (under different names) in a number of interdisciplinary scientific fields bridging mathematics and computations with biology and chemistry. The book can be used both for self-study and as a supporting text for advanced undergraduate or beginning graduate-level courses in applied mathematics. New mathematical approaches are explained using simple examples of biological models, which range in size from simulations of small biomolecules to groups of animals. The book starts with stochastic modelling of chemical reactions, introducing stochastic simulation algorithms and mathematical methods for analysis of stochastic models. Different stochastic spatio-temporal models are then studied, including models of diffusion and stochastic reaction-diffusion modelling. The methods covered include molecular dynamics, Brownian dynamics, velocity jump processes and compartment-based (lattice-based) models.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.