This book reconsiders statistical methods from the point of view of entropy, and introduces entropy-based approaches for data analysis. Further, it interprets basic statistical methods, such as the chi-square statistic, t-statistic, F-statistic and the maximum likelihood estimation in the context of entropy. In terms of categorical data analysis, the book discusses the entropy correlation coefficient (ECC) and the entropy coefficient of determination (ECD) for measuring association and/or predictive powers in association models, and generalized linear models (GLMs). Through association and GLM frameworks, it also describes ECC and ECD in correlation and regression analyses for continuous random variables. In multivariate statistical analysis, canonical correlation analysis, T2-statistic, and discriminant analysis are discussed in terms of entropy. Moreover, the book explores the efficiency of test procedures in statistical tests of hypotheses using entropy. Lastly, it presents an entropy-based path analysis for structural GLMs, which is applied in factor analysis and latent structure models. Entropy is an important concept for dealing with the uncertainty of systems of random variables and can be applied in statistical methodologies. This book motivates readers, especially young researchers, to address the challenge of new approaches to statistical data analysis and behavior-metric studies.

Cambridge, England, 1988

This volume deals with two complementary topics. On one hand the book deals with the problem of determining the the probability distribution of a positive compound random variable, a problem which appears in the banking and insurance industries, in many areas of operational research and in reliability problems in the engineering sciences. On the other hand, the methodology proposed to solve such problems, which is based on an application of the maximum entropy method to invert the Laplace transform of the distributions, can be applied to many other problems. The book contains applications to a large variety of problems, including the problem of dependence of the sample data used to estimate empirically the Laplace transform of the random variable. Contents Introduction Frequency models Individual severity models Some detailed examples Some traditional approaches to the aggregation problem Laplace transforms and fractional moment problems The standard maximum entropy method Extensions of the method of maximum entropy Superresolution in maxentropic Laplace transform inversion Sample data dependence Disentangling frequencies and decompounding losses Computations using the maxentropic density Review of statistical procedures

This book has two main topics: large deviations and equilibrium statistical mechanics. I hope to convince the reader that these topics have many points of contact and that in being treated together, they enrich each other. Entropy, in its various guises, is their common core. The large deviation theory which is developed in this book focuses upon convergence properties of certain stochastic systems. An elementary example is the weak law of large numbers. For each positive e, P{ISn/nl 2: e} con verges to zero as n --+ 00, where Sn is the nth partial sum of indepen dent identically distributed random variables with zero mean. Large deviation theory shows that if the random variables are exponentially bounded, then the probabilities converge to zero exponentially fast as n --+ 00. The exponen tial decay allows one to prove the stronger property of almost sure conver gence (Sn/n --+ 0 a.s.). This example will be generalized extensively in the book. We will treat a large class of stochastic systems which involve both indepen dent and dependent random variables and which have the following features: probabilities converge to zero exponentially fast as the size of the system increases; the exponential decay leads to strong convergence properties of the system. The most fascinating aspect of the theory is that the exponential decay rates are computable in terms of entropy functions. This identification between entropy and decay rates of large deviation probabilities enhances the theory significantly.

Image analysis is a fundamental task for extracting information from images acquired across a range of different devices. Since reliable quantitative results are requested, image analysis requires highly sophisticated numerical and analytical methods—particularly for applications in medicine, security, and remote sensing, where the results of the processing may consist of vitally important data. The contributions to this book provide a good overview of the most important demands and solutions concerning this research area. In particular, the reader will find image analysis applied for feature extraction, encryption and decryption of data, color segmentation, and in the support new technologies. In all the contributions, entropy plays a pivotal role.

Highly useful text studies logarithmic measures of information and their application to testing statistical hypotheses. Includes numerous worked examples and problems. References. Glossary. Appendix. 1968 2nd, revised edition.

This book is a guide to the practical application of statistics in data analysis as typically encountered in the physical sciences. It is primarily addressed at students and professionals who need to draw quantitative conclusions from experimental data. Although most of the examples are takenfrom particle physics, the material is presented in a sufficiently general way as to be useful to people from most branches of the physical sciences. The first part of the book describes the basic tools of data analysis: concepts of probability and random variables, Monte Carlo techniques,statistical tests, and methods of parameter estimation. The last three chapters are somewhat more specialized than those preceding, covering interval estimation, characteristic functions, and the problem of correcting distributions for the effects of measurement errors (unfolding).

Statistical mechanics: the bane of many a physics student, and traditionally viewed as a long parade of ensembles, partition functions, and partial derivatives. But the subject needn't be arcane. When pared back to its underlying concepts and built from the ground up, statistical mechanics takes on a charm of its own, and sheds light on all manner of physical phenomena. This book presents a straightforward introduction to the key concepts in statistical mechanics, following the popular style of the author's highly successful textbook "Explorations in Mathematical Physics". Offering a clear, conceptual approach to the subject matter, the book presents a treatment that is mathematically complete, while remaining very accessible to undergraduates. It commences by asking: why does an ink drop spread out in a bathtub of water? This showcases the importance of counting configurations, which leads naturally to ideas of microstates, energy, entropy, thermodynamics, and physical chemistry. With this foundation, the Boltzmann distribution writes itself in its fullest form, and this opens the door to the Maxwell distribution and related areas of thermal conductivity and viscosity. Quantum ideas then appear: bosons via Einstein's and Debye's theories of heat capacity, and fermions via electrical conduction and low-temperature heat capacity of metals. The text ends with a detailed derivation of blackbody radiation, and uses this to discuss the greenhouse effect, lasers, and cosmology. Suitable for use with core undergraduate courses in statistical mechanics and thermodynamics, this book concentrates on using solid mathematics, while avoiding cumbersome notation. All the necessary mathematical steps are included in the body of the text and in the worked examples. Reviews of Explorations in Mathematical Physics by Don Koks, 2006 "With enjoyable and sometimes surprising excursions along the way, the journey provides a fresh look at many familiar topics, as it takes us from basic linear mathematics to general relativity... look forward to having your geometric intuition nourished and expanded by the author's intelligent commentaries." (Eugen Merzbacher, University of North Carolina) "... an interesting supplement to standard texts for teaching mathematical methods in physics, as it will add alternative views that could serve as additional material." (S. Marcelja, Australian Journal of Physics) "... a tour through the main ideas forming the language of modern mathematical physics ...it is a difficult task for the author to decide what is a good balance between the topics and their presentation, but in this case it has been achieved. ...for those physicists who would like to be exposed to clear motivation and careful explanation of the basics of the present-day apparatus of mathematical physics." (Ivailo Mladenov, Mathematical Reviews).

This series of books collects a diverse array of work that provides the reader with theoretical and applied information on data analysis methods, models and techniques, along with appropriate applications. Volume 2 begins with an introductory chapter by Gilbert Saporta, a leading expert in the field, who summarizes the developments in data analysis over the last 50 years. The book is then divided into four parts: Part 1 examines (in)dependence relationships, innovation in the Nordic countries, dentistry journals, dependence among growth rates of GDP of V4 countries, emissions mitigation, and five-star ratings; Part 2 investigates access to credit for SMEs, gender-based impacts given Southern Europe’s economic crisis, and labor market transition probabilities; Part 3 looks at recruitment at university job-placement offices and the Program for International Student Assessment; and Part 4 examines discriminants, PageRank, and the political spectrum of Germany.

Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.