This book provides a systematic development of tensor methods in statistics, beginning with the study of multivariate moments and cumulants. The effect on moment arrays and on cumulant arrays of making linear or affine transformations of the variables is studied. Because of their importance in statistical theory, invariant functions of the cumulants are studied in some detail. This is followed by an examination of the effect of making a polynomial transformation of the original variables. The fundamental operation of summing over complementary set partitions is introduced at this stage. This operation shapes the notation and pervades much of the remainder of the book. The necessary lattice-theory is discussed and suitable tables of complementary set partitions are provided. Subsequent chapters deal with asymptotic approximations based on Edgeworth expansion and saddlepoint expansion. The saddlepoint expansion is introduced via the Legendre transformation of the cumulant generating function, also known as the conjugate function of the cumulant generating function. A recurring them is that, with suitably chosen notation, multivariate calculations are often simpler and more transparent than the corresponding univariate calculations. The final two chapters deal with likelihood ratio statistics, maximum likelihood estimation and the effect on inferences of conditioning on ancillary or approximately ancillary statistics. The Bartlett adjustment factor is derived in the general case and simplified for certain types of generalized linear models. Finally, Barndorff-Nielsen's formula for the conditional distribution of the maximum liklelihood estimator is derived and discussed. More than 200 Exercises are provided to illustrate the uses of tensor methodology.

A pioneering monograph on tensor methods applied to distributional problems arising in statistics, this work begins with the study of multivariate moments and cumulants. An invaluable reference for graduate students and professional statisticians. 1987 edition.

A pioneering monograph on tensor methods applied to distributional problems arising in statistics, this work begins with the study of multivariate moments and cumulants. An invaluable reference for graduate students and professional statisticians. 1987 edition.

This book provides an introduction to various aspects of Algebraic Statistics with the principal aim of supporting Master’s and PhD students who wish to explore the algebraic point of view regarding recent developments in Statistics. The focus is on the background needed to explore the connections among discrete random variables. The main objects that encode these relations are multilinear matrices, i.e., tensors. The book aims to settle the basis of the correspondence between properties of tensors and their translation in Algebraic Geometry. It is divided into three parts, on Algebraic Statistics, Multilinear Algebra, and Algebraic Geometry. The primary purpose is to describe a bridge between the three theories, so that results and problems in one theory find a natural translation to the others. This task requires, from the statistical point of view, a rather unusual, but algebraically natural, presentation of random variables and their main classical features. The third part of the book can be considered as a short, almost self-contained, introduction to the basic concepts of algebraic varieties, which are part of the fundamental background for all who work in Algebraic Statistics.

Special numerical techniques are already needed to deal with n × n matrices for large n. Tensor data are of size n × n ×...× n=nd, where nd exceeds the computer memory by far. They appear for problems of high spatial dimensions. Since standard methods fail, a particular tensor calculus is needed to treat such problems. This monograph describes the methods by which tensors can be practically treated and shows how numerical operations can be performed. Applications include problems from quantum chemistry, approximation of multivariate functions, solution of partial differential equations, for example with stochastic coefficients, and more. In addition to containing corrections of the unavoidable misprints, this revised second edition includes new parts ranging from single additional statements to new subchapters. The book is mainly addressed to numerical mathematicians and researchers working with high-dimensional data. It also touches problems related to Geometric Algebra.

Tensor Regression is the first thorough overview of the fundamentals, motivations, popular algorithms, strategies for efficient implementation, related applications, available datasets, and software resources for tensor-based regression analysis.

This book provides a systematic development of tensor methods in statistics, beginning with the study of multivariate moments and cumulants. The effect on moment arrays and on cumulant arrays of making linear or affine transformations of the variables is studied. Because of their importance in statistical theory, invariant functions of the cumulants are studied in some detail. This is followed by an examination of the effect of making a polynomial transformation of the original variables. The fundamental operation of summing over complementary set partitions is introduced at this stage. This operation shapes the notation and pervades much of the remainder of the book. The necessary lattice-theory is discussed and suitable tables of complementary set partitions are provided. Subsequent chapters deal with asymptotic approximations based on Edgeworth expansion and saddlepoint expansion. The saddlepoint expansion is introduced via the Legendre transformation of the cumulant generating function, also known as the conjugate function of the cumulant generating function. A recurring them is that, with suitably chosen notation, multivariate calculations are often simpler and more transparent than the corresponding univariate calculations. The final two chapters deal with likelihood ratio statistics, maximum likelihood estimation and the effect on inferences of conditioning on ancillary or approximately ancillary statistics. The Bartlett adjustment factor is derived in the general case and simplified for certain types of generalized linear models. Finally, Barndorff-Nielsen's formula for the conditional distribution of the maximum liklelihood estimator is derived and discussed. More than 200 Exercises are provided to illustrate the uses of tensor methodology.

Matrix-valued data sets – so-called second order tensor fields – have gained significant importance in scientific visualization and image processing due to recent developments such as diffusion tensor imaging. This book is the first edited volume that presents the state of the art in the visualization and processing of tensor fields. It contains some longer chapters dedicated to surveys and tutorials of specific topics, as well as a great deal of original work by leading experts that has not been published before. It serves as an overview for the inquiring scientist, as a basic foundation for developers and practitioners, and as as a textbook for specialized classes and seminars for graduate and doctoral students.

This book provides a broad survey of models and efficient algorithms for Nonnegative Matrix Factorization (NMF). This includes NMF’s various extensions and modifications, especially Nonnegative Tensor Factorizations (NTF) and Nonnegative Tucker Decompositions (NTD). NMF/NTF and their extensions are increasingly used as tools in signal and image processing, and data analysis, having garnered interest due to their capability to provide new insights and relevant information about the complex latent relationships in experimental data sets. It is suggested that NMF can provide meaningful components with physical interpretations; for example, in bioinformatics, NMF and its extensions have been successfully applied to gene expression, sequence analysis, the functional characterization of genes, clustering and text mining. As such, the authors focus on the algorithms that are most useful in practice, looking at the fastest, most robust, and suitable for large-scale models. Key features: Acts as a single source reference guide to NMF, collating information that is widely dispersed in current literature, including the authors’ own recently developed techniques in the subject area. Uses generalized cost functions such as Bregman, Alpha and Beta divergences, to present practical implementations of several types of robust algorithms, in particular Multiplicative, Alternating Least Squares, Projected Gradient and Quasi Newton algorithms. Provides a comparative analysis of the different methods in order to identify approximation error and complexity. Includes pseudo codes and optimized MATLAB source codes for almost all algorithms presented in the book. The increasing interest in nonnegative matrix and tensor factorizations, as well as decompositions and sparse representation of data, will ensure that this book is essential reading for engineers, scientists, researchers, industry practitioners and graduate students across signal and image processing; neuroscience; data mining and data analysis; computer science; bioinformatics; speech processing; biomedical engineering; and multimedia.

Tensors are ubiquitous in the sciences. The geometry of tensors is both a powerful tool for extracting information from data sets, and a beautiful subject in its own right. This book has three intended uses: a classroom textbook, a reference work for researchers in the sciences, and an account of classical and modern results in (aspects of) the theory that will be of interest to researchers in geometry. For classroom use, there is a modern introduction to multilinear algebra and to the geometry and representation theory needed to study tensors, including a large number of exercises. For researchers in the sciences, there is information on tensors in table format for easy reference and a summary of the state of the art in elementary language. This is the first book containing many classical results regarding tensors. Particular applications treated in the book include the complexity of matrix multiplication, P versus NP, signal processing, phylogenetics, and algebraic statistics. For geometers, there is material on secant varieties, G-varieties, spaces with finitely many orbits and how these objects arise in applications, discussions of numerous open questions in geometry arising in applications, and expositions of advanced topics such as the proof of the Alexander-Hirschowitz theorem and of the Weyman-Kempf method for computing syzygies.