Machine learning and artificial intelligence increasingly use methodological tools rooted in statistical physics. Conversely, limitations and pitfalls encountered in AI question the very foundations of statistical physics. This interplay between AI and statistical physics has been attested since the birth of AI, and principles underpinning statistical physics can shed new light on the conceptual basis of AI. During the last fifty years, statistical physics has been investigated through new geometric structures allowing covariant formalization of the thermodynamics. Inference methods in machine learning have begun to adapt these new geometric structures to process data in more abstract representation spaces. This volume collects selected contributions on the interplay of statistical physics and artificial intelligence. The aim is to provide a constructive dialogue around a common foundation to allow the establishment of new principles and laws governing these two disciplines in a unified manner. The contributions were presented at the workshop on the Joint Structures and Common Foundation of Statistical Physics, Information Geometry and Inference for Learning which was held in Les Houches in July 2020. The various theoretical approaches are discussed in the context of potential applications in cognitive systems, machine learning, signal processing.

This book constitutes the proceedings of the 5th International Conference on Geometric Science of Information, GSI 2021, held in Paris, France, in July 2021. The 98 papers presented in this volume were carefully reviewed and selected from 125 submissions. They cover all the main topics and highlights in the domain of geometric science of information, including information geometry manifolds of structured data/information and their advanced applications. The papers are organized in the following topics: Probability and statistics on Riemannian Manifolds; sub-Riemannian geometry and neuromathematics; shapes spaces; geometry of quantum states; geometric and structure preserving discretizations; information geometry in physics; Lie group machine learning; geometric and symplectic methods for hydrodynamical models; harmonic analysis on Lie groups; statistical manifold and Hessian information geometry; geometric mechanics; deformed entropy, cross-entropy, and relative entropy; transformation information geometry; statistics, information and topology; geometric deep learning; topological and geometrical structures in neurosciences; computational information geometry; manifold and optimization; divergence statistics; optimal transport and learning; and geometric structures in thermodynamics and statistical physics.

This book focuses on information geometry manifolds of structured data/information and their advanced applications featuring new and fruitful interactions between several branches of science: information science, mathematics and physics. It addresses interrelations between different mathematical domains like shape spaces, probability/optimization & algorithms on manifolds, relational and discrete metric spaces, computational and Hessian information geometry, algebraic/infinite dimensional/Banach information manifolds, divergence geometry, tensor-valued morphology, optimal transport theory, manifold & topology learning, and applications like geometries of audio-processing, inverse problems and signal processing. The book collects the most important contributions to the conference GSI’2017 – Geometric Science of Information.

This is the first comprehensive book on information geometry, written by the founder of the field. It begins with an elementary introduction to dualistic geometry and proceeds to a wide range of applications, covering information science, engineering, and neuroscience. It consists of four parts, which on the whole can be read independently. A manifold with a divergence function is first introduced, leading directly to dualistic structure, the heart of information geometry. This part (Part I) can be apprehended without any knowledge of differential geometry. An intuitive explanation of modern differential geometry then follows in Part II, although the book is for the most part understandable without modern differential geometry. Information geometry of statistical inference, including time series analysis and semiparametric estimation (the Neyman–Scott problem), is demonstrated concisely in Part III. Applications addressed in Part IV include hot current topics in machine learning, signal processing, optimization, and neural networks. The book is interdisciplinary, connecting mathematics, information sciences, physics, and neurosciences, inviting readers to a new world of information and geometry. This book is highly recommended to graduate students and researchers who seek new mathematical methods and tools useful in their own fields.

This book covers topics of Informational Geometry, a field which deals with the differential geometric study of the manifold probability density functions. This is a field that is increasingly attracting the interest of researchers from many different areas of science, including mathematics, statistics, geometry, computer science, signal processing, physics and neuroscience. It is the authors’ hope that the present book will be a valuable reference for researchers and graduate students in one of the aforementioned fields. This textbook is a unified presentation of differential geometry and probability theory, and constitutes a text for a course directed at graduate or advanced undergraduate students interested in applications of differential geometry in probability and statistics. The book contains over 100 proposed exercises meant to help students deepen their understanding, and it is accompanied by software that is able to provide numerical computations of several information geometric objects. The reader will understand a flourishing field of mathematics in which very few books have been written so far.

This book explains deep learning concepts and derives semi-supervised learning and nuclear learning frameworks based on cognition mechanism and Lie group theory. Lie group machine learning is a theoretical basis for brain intelligence, Neuromorphic learning (NL), advanced machine learning, and advanced artifi cial intelligence. The book further discusses algorithms and applications in tensor learning, spectrum estimation learning, Finsler geometry learning, Homology boundary learning, and prototype theory. With abundant case studies, this book can be used as a reference book for senior college students and graduate students as well as college teachers and scientific and technical personnel involved in computer science, artifi cial intelligence, machine learning, automation, mathematics, management science, cognitive science, financial management, and data analysis. In addition, this text can be used as the basis for teaching the principles of machine learning. Li Fanzhang is professor at the Soochow University, China. He is director of network security engineering laboratory in Jiangsu Province and is also the director of the Soochow Institute of industrial large data. He published more than 200 papers, 7 academic monographs, and 4 textbooks. Zhang Li is professor at the School of Computer Science and Technology of the Soochow University. She published more than 100 papers in journals and conferences, and holds 23 patents. Zhang Zhao is currently an associate professor at the School of Computer Science and Technology of the Soochow University. He has authored and co-authored more than 60 technical papers.

The book provides a comprehensive introduction and a novel mathematical foundation of the field of information geometry with complete proofs and detailed background material on measure theory, Riemannian geometry and Banach space theory. Parametrised measure models are defined as fundamental geometric objects, which can be both finite or infinite dimensional. Based on these models, canonical tensor fields are introduced and further studied, including the Fisher metric and the Amari-Chentsov tensor, and embeddings of statistical manifolds are investigated. This novel foundation then leads to application highlights, such as generalizations and extensions of the classical uniqueness result of Chentsov or the Cramér-Rao inequality. Additionally, several new application fields of information geometry are highlighted, for instance hierarchical and graphical models, complexity theory, population genetics, or Markov Chain Monte Carlo. The book will be of interest to mathematicians who are interested in geometry, information theory, or the foundations of statistics, to statisticians as well as to scientists interested in the mathematical foundations of complex systems.

This book constitutes the proceedings of the 4th International Conference on Geometric Science of Information, GSI 2019, held in Toulouse, France, in August 2019. The 79 full papers presented in this volume were carefully reviewed and selected from 105 submissions. They cover all the main topics and highlights in the domain of geometric science of information, including information geometry manifolds of structured data/information and their advanced applications.

A very active field of research is emerging at the frontier of statistical physics, theoretical computer science/discrete mathematics, and coding/information theory. This book sets up a common language and pool of concepts, accessible to students and researchers from each of these fields.

This 2001 book gives a self-contained exposition of the theory of gravitational solitons and provides a comprehensive review of exact soliton solutions to Einstein's equations. The text begins with a detailed discussion of the extension of the Inverse Scattering Method to the theory of gravitation, starting with pure gravity and then extending it to the coupling of gravity with the electromagnetic field. There follows a systematic review of the gravitational soliton solutions based on their symmetries. These solutions include some of the most interesting in gravitational physics such as those describing inhomogeneous cosmological models, cylindrical waves, the collision of exact gravity waves, and the Schwarzschild and Kerr black holes. A valuable reference for researchers and graduate students in the fields of general relativity, string theory and cosmology, this book will also be of interest to mathematical physicists in general.