This book provides an integrated treatment of the theory of nonnegative matrices (matrices with only positive numbers or zero as entries) and some related classes of positive matrices, concentrating on connections with game theory, combinatorics, inequalities, optimisation and mathematical economics. The wide variety of applications, which include price fixing, scheduling and the fair division problem, have been carefully chosen both for their elegant mathematical content and for their accessibility to students with minimal preparation. Many results in matrix theory are also presented. The treatment is rigorous and almost all results are proved completely. These results and applications will be of great interest to researchers in linear programming, statistics and operations research. The minimal prerequisites also make the book accessible to first-year graduate students.

Nonnegative Matrices in the Mathematical Sciences provides information pertinent to the fundamental aspects of the theory of nonnegative matrices. This book describes selected applications of the theory to numerical analysis, probability, economics, and operations research. Organized into 10 chapters, this book begins with an overview of the properties of nonnegative matrices. This text then examines the inverse-positive matrices. Other chapters consider the basic approaches to the study of nonnegative matrices, namely, geometrical and combinatorial. This book discusses as well some useful ideas from the algebraic theory of semigroups and considers a canonical form for nonnegative idempotent matrices and special types of idempotent matrices. The final chapter deals with the linear complementary problem (LCP). This book is a valuable resource for mathematical economists, mathematical programmers, statisticians, mathematicians, and computer scientists.

Since its inception by Perron and Frobenius, the theory of non-negative matrices has developed enormously and is now being used and extended in applied fields of study as diverse as probability theory, numerical analysis, demography, mathematical economics, and dynamic programming, while its development is still proceeding rapidly as a branch of pure mathematics in its own right. While there are books which cover this or that aspect of the theory, it is nevertheless not uncommon for workers in one or another branch of its development to be unaware of what is known in other branches, even though there is often formal overlap. One of the purposes of this book is to relate several aspects of the theory, insofar as this is possible. The author hopes that the book will be useful to mathematicians; but in particular to the workers in applied fields, so the mathematics has been kept as simple as could be managed. The mathematical requisites for reading it are: some knowledge of real-variable theory, and matrix theory; and a little knowledge of complex-variable; the emphasis is on real-variable methods. (There is only one part of the book, the second part of 55.5, which is of rather specialist interest, and requires deeper knowledge.) Appendices provide brief expositions of those areas of mathematics needed which may be less g- erally known to the average reader.

Totally nonnegative matrices arise in a remarkable variety of mathematical applications. This book is a comprehensive and self-contained study of the essential theory of totally nonnegative matrices, defined by the nonnegativity of all subdeterminants. It explores methodological background, historical highlights of key ideas, and specialized topics. The book uses classical and ad hoc tools, but a unifying theme is the elementary bidiagonal factorization, which has emerged as the single most important tool for this particular class of matrices. Recent work has shown that bidiagonal factorizations may be viewed in a succinct combinatorial way, leading to many deep insights. Despite slow development, bidiagonal factorizations, along with determinants, now provide the dominant methodology for understanding total nonnegativity. The remainder of the book treats important topics, such as recognition of totally nonnegative or totally positive matrices, variation diminution, spectral properties, determinantal inequalities, Hadamard products, and completion problems associated with totally nonnegative or totally positive matrices. The book also contains sample applications, an up-to-date bibliography, a glossary of all symbols used, an index, and related references.

Nonnegative matrices and positive operators are widely applied in science, engineering, and technology. This book provides the basic theory and several typical modern science and engineering applications of nonnegative matrices and positive operators, including the fundamental theory, methods, numerical analysis, and applications in the Google search engine, computational molecular dynamics, and wireless communications.Unique features of this book include the combination of the theories of nonnegative matrices and positive operators as well as the emphasis on applications of nonnegative matrices in the numerical analysis of positive operators, such as Markov operators and Frobenius-Perron operators both of which play key roles in the statistical and stochastic studies of dynamical systems.It can be used as a textbook for an upper level undergraduate or beginning graduate course in advanced matrix theory and/or positive operators as well as for an advanced topics course in operator theory or ergodic theory. In addition, it serves as a good reference for researchers in mathematical sciences, physical sciences, and engineering.

A real matrix is positive semidefinite if it can be decomposed as A = BBOC . In some applications the matrix B has to be elementwise nonnegative. If such a matrix exists, A is called completely positive. The smallest number of columns of a nonnegative matrix B such that A = BBOC is known as the cp- rank of A . This invaluable book focuses on necessary conditions and sufficient conditions for complete positivity, as well as bounds for the cp- rank. The methods are combinatorial, geometric and algebraic. The required background on nonnegative matrices, cones, graphs and Schur complements is outlined. Contents: Preliminaries: Matrix Theoretic Background; Positive Semidefinite Matrices; Nonnegative Matrices and M -Matrices; Schur Complements; Graphs; Convex Cones; The PSD Completion Problem; Complete Positivity: Definition and Basic Properties; Cones of Completely Positive Matrices; Small Matrices; Complete Positivity and the Comparison Matrix; Completely Positive Graphs; Completely Positive Matrices Whose Graphs are Not Completely Positive; Square Factorizations; Functions of Completely Positive Matrices; The CP Completion Problem; CP Rank: Definition and Basic Results; Completely Positive Matrices of a Given Rank; Completely Positive Matrices of a Given Order; When is the CP-Rank Equal to the Rank?. Readership: Upper level undergraduates, graduate students, academics and researchers interested in matrix theory."

The overwhelming data produced everyday and the increasing performance and cost requirements of applications are transversal to a wide range of activities in society, from science to industry. In particular, the magnitude and complexity of the tasks that Machine Learning (ML) algorithms have to solve are driving the need to devise adaptive many-core machines that scale well with the volume of data, or in other words, can handle Big Data. This book gives a concise view on how to extend the applicability of well-known ML algorithms in Graphics Processing Unit (GPU) with data scalability in mind. It presents a series of new techniques to enhance, scale and distribute data in a Big Learning framework. It is not intended to be a comprehensive survey of the state of the art of the whole field of machine learning for Big Data. Its purpose is less ambitious and more practical: to explain and illustrate existing and novel GPU-based ML algorithms, not viewed as a universal solution for the Big Data challenges but rather as part of the answer, which may require the use of different strategies coupled together.

Nonnegative matrix factorization (NMF) in its modern form has become a standard tool in the analysis of high-dimensional data sets. This book provides a comprehensive and up-to-date account of the most important aspects of the NMF problem and is the first to detail its theoretical aspects, including geometric interpretation, nonnegative rank, complexity, and uniqueness. It explains why understanding these theoretical insights is key to using this computational tool effectively and meaningfully. Nonnegative Matrix Factorization is accessible to a wide audience and is ideal for anyone interested in the workings of NMF. It discusses some new results on the nonnegative rank and the identifiability of NMF and makes available MATLAB codes for readers to run the numerical examples presented in the book. Graduate students starting to work on NMF and researchers interested in better understanding the NMF problem and how they can use it will find this book useful. It can be used in advanced undergraduate and graduate-level courses on numerical linear algebra and on advanced topics in numerical linear algebra and requires only a basic knowledge of linear algebra and optimization.

This book provides a broad survey of models and efficient algorithms for Nonnegative Matrix Factorization (NMF). This includes NMF’s various extensions and modifications, especially Nonnegative Tensor Factorizations (NTF) and Nonnegative Tucker Decompositions (NTD). NMF/NTF and their extensions are increasingly used as tools in signal and image processing, and data analysis, having garnered interest due to their capability to provide new insights and relevant information about the complex latent relationships in experimental data sets. It is suggested that NMF can provide meaningful components with physical interpretations; for example, in bioinformatics, NMF and its extensions have been successfully applied to gene expression, sequence analysis, the functional characterization of genes, clustering and text mining. As such, the authors focus on the algorithms that are most useful in practice, looking at the fastest, most robust, and suitable for large-scale models. Key features: Acts as a single source reference guide to NMF, collating information that is widely dispersed in current literature, including the authors’ own recently developed techniques in the subject area. Uses generalized cost functions such as Bregman, Alpha and Beta divergences, to present practical implementations of several types of robust algorithms, in particular Multiplicative, Alternating Least Squares, Projected Gradient and Quasi Newton algorithms. Provides a comparative analysis of the different methods in order to identify approximation error and complexity. Includes pseudo codes and optimized MATLAB source codes for almost all algorithms presented in the book. The increasing interest in nonnegative matrix and tensor factorizations, as well as decompositions and sparse representation of data, will ensure that this book is essential reading for engineers, scientists, researchers, industry practitioners and graduate students across signal and image processing; neuroscience; data mining and data analysis; computer science; bioinformatics; speech processing; biomedical engineering; and multimedia.