Bayesian nonparametrics comes of age with this landmark text synthesizing theory, methodology and computation.

This book is the first systematic treatment of Bayesian nonparametric methods and the theory behind them. It will also appeal to statisticians in general. The book is primarily aimed at graduate students and can be used as the text for a graduate course in Bayesian non-parametrics.

Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.

Explosive growth in computing power has made Bayesian methods for infinite-dimensional models - Bayesian nonparametrics - a nearly universal framework for inference, finding practical use in numerous subject areas. Written by leading researchers, this authoritative text draws on theoretical advances of the past twenty years to synthesize all aspects of Bayesian nonparametrics, from prior construction to computation and large sample behavior of posteriors. Because understanding the behavior of posteriors is critical to selecting priors that work, the large sample theory is developed systematically, illustrated by various examples of model and prior combinations. Precise sufficient conditions are given, with complete proofs, that ensure desirable posterior properties and behavior. Each chapter ends with historical notes and numerous exercises to deepen and consolidate the reader's understanding, making the book valuable for both graduate students and researchers in statistics and machine learning, as well as in application areas such as econometrics and biostatistics.

This book reviews nonparametric Bayesian methods and models that have proven useful in the context of data analysis. Rather than providing an encyclopedic review of probability models, the book’s structure follows a data analysis perspective. As such, the chapters are organized by traditional data analysis problems. In selecting specific nonparametric models, simpler and more traditional models are favored over specialized ones. The discussed methods are illustrated with a wealth of examples, including applications ranging from stylized examples to case studies from recent literature. The book also includes an extensive discussion of computational methods and details on their implementation. R code for many examples is included in online software pages.

Explosive growth in computing power has made Bayesian methods for infinite-dimensional models - Bayesian nonparametrics - a nearly universal framework for inference, finding practical use in numerous subject areas. Written by leading researchers, this authoritative text draws on theoretical advances of the past twenty years to synthesize all aspects of Bayesian nonparametrics, from prior construction to computation and large sample behavior of posteriors. Because understanding the behavior of posteriors is critical to selecting priors that work, the large sample theory is developed systematically, illustrated by various examples of model and prior combinations. Precise sufficient conditions are given, with complete proofs, that ensure desirable posterior properties and behavior. Each chapter ends with historical notes and numerous exercises to deepen and consolidate the reader's understanding, making the book valuable for both graduate students and researchers in statistics and machine learning, as well as in application areas such as econometrics and biostatistics.

These lecture notes provide a rapid, accessible introduction to Bayesian statistical methods. The course covers the fundamental philosophy and principles of Bayesian inference, including the reasoning behind the prior/likelihood model construction synonymous with Bayesian methods, through to advanced topics such as nonparametrics, Gaussian processes and latent factor models. These advanced modelling techniques can easily be applied using computer code samples written in Python and Stan which are integrated into the main text. Importantly, the reader will learn methods for assessing model fit, and to choose between rival modelling approaches.

In nonparametric and high-dimensional statistical models, the classical Gauss–Fisher–Le Cam theory of the optimality of maximum likelihood estimators and Bayesian posterior inference does not apply, and new foundations and ideas have been developed in the past several decades. This book gives a coherent account of the statistical theory in infinite-dimensional parameter spaces. The mathematical foundations include self-contained 'mini-courses' on the theory of Gaussian and empirical processes, approximation and wavelet theory, and the basic theory of function spaces. The theory of statistical inference in such models - hypothesis testing, estimation and confidence sets - is presented within the minimax paradigm of decision theory. This includes the basic theory of convolution kernel and projection estimation, but also Bayesian nonparametrics and nonparametric maximum likelihood estimation. In a final chapter the theory of adaptive inference in nonparametric models is developed, including Lepski's method, wavelet thresholding, and adaptive inference for self-similar functions. Winner of the 2017 PROSE Award for Mathematics.

Praise for Bayesian Thinking in Biostatistics: "This thoroughly modern Bayesian book ...is a 'must have' as a textbook or a reference volume. Rosner, Laud and Johnson make the case for Bayesian approaches by melding clear exposition on methodology with serious attention to a broad array of illuminating applications. These are activated by excellent coverage of computing methods and provision of code. Their content on model assessment, robustness, data-analytic approaches and predictive assessments...are essential to valid practice. The numerous exercises and professional advice make the book ideal as a text for an intermediate-level course..." -Thomas Louis, Johns Hopkins University "The book introduces all the important topics that one would usually cover in a beginning graduate level class on Bayesian biostatistics. The careful introduction of the Bayesian viewpoint and the mechanics of implementing Bayesian inference in the early chapters makes it a complete self- contained introduction to Bayesian inference for biomedical problems....Another great feature for using this book as a textbook is the inclusion of extensive problem sets, going well beyond construed and simple problems. Many exercises consider real data and studies, providing very useful examples in addition to serving as problems." - Peter Mueller, University of Texas With a focus on incorporating sensible prior distributions and discussions on many recent developments in Bayesian methodologies, Bayesian Thinking in Biostatistics considers statistical issues in biomedical research. The book emphasizes greater collaboration between biostatisticians and biomedical researchers. The text includes an overview of Bayesian statistics, a discussion of many of the methods biostatisticians frequently use, such as rates and proportions, regression models, clinical trial design, and methods for evaluating diagnostic tests. Key Features Applies a Bayesian perspective to applications in biomedical science Highlights advances in clinical trial design Goes beyond standard statistical models in the book by introducing Bayesian nonparametric methods and illustrating their uses in data analysis Emphasizes estimation of biomedically relevant quantities and assessment of the uncertainty in this estimation Provides programs in the BUGS language, with variants for JAGS and Stan, that one can use or adapt for one's own research The intended audience includes graduate students in biostatistics, epidemiology, and biomedical researchers, in general Authors Gary L. Rosner is the Eli Kennerly Marshall, Jr., Professor of Oncology at the Johns Hopkins School of Medicine and Professor of Biostatistics at the Johns Hopkins Bloomberg School of Public Health. Purushottam (Prakash) W. Laud is Professor in the Division of Biostatistics, and Director of the Biostatistics Shared Resource for the Cancer Center, at the Medical College of Wisconsin. Wesley O. Johnson is professor Emeritus in the Department of Statistics as the University of California, Irvine.

Ideal for statisticians, this book will also interest probabilists, mathematicians, computer scientists, and morphometricians with mathematical training. It presents a systematic introduction to a general nonparametric theory of statistics on manifolds, with emphasis on manifolds of shapes. The theory has important applications in medical diagnostics, image analysis and machine vision.