An important problem that arises in different disciplines of science and engineering is that of computing limits of sequences of vectors of very large dimension. Such sequences arise, for example, in the numerical solution of systems of linear and nonlinear equations by fixed-point iterative methods, and their limits are simply the required solutions to these systems. The convergence of these sequences, which is very slow in many cases, can be accelerated successfully by using suitable vector extrapolation methods. Vector Extrapolation Methods with Applications?is the first book fully dedicated to the subject of vector extrapolation methods. It is a self-contained, up-to-date, and state-of-the-art reference on the theory and practice of the most useful methods. It covers all aspects of the subject, including development of the methods, their convergence study, numerically stable algorithms for their implementation, and their various applications. It also provides complete proofs in most places. As an interesting application, the author shows how these methods give rise to rational approximation procedures for vector-valued functions in the complex plane, a subject of importance in model reduction problems among others. This book is intended for numerical analysts, applied mathematicians, and computational scientists and engineers in fields such as computational fluid dynamics, structures, and mechanical and electrical engineering, to name a few. Since it provides complete proofs in most places, it can also serve as a textbook in courses on acceleration of convergence of iterative vector processes, for example.

An important problem that arises in different disciplines of science and engineering is that of computing limits of sequences of vectors of very large dimension. Such sequences arise, for example, in the numerical solution of systems of linear and nonlinear equations by fixed-point iterative methods, and their limits are simply the required solutions to these systems. The convergence of these sequences, which is very slow in many cases, can be accelerated successfully by using suitable vector extrapolation methods. Vector Extrapolation Methods with Applications is the first book fully dedicated to the subject of vector extrapolation methods. It is a self-contained, up-to-date, and state-of-the-art reference on the theory and practice of the most useful methods. It covers all aspects of the subject, including development of the methods, their convergence study, numerically stable algorithms for their implementation, and their various applications. It also provides complete proofs in most places. As an interesting application, the author shows how these methods give rise to rational approximation procedures for vector-valued functions in the complex plane, a subject of importance in model reduction problems among others. This book is intended for numerical analysts, applied mathematicians, and computational scientists and engineers in fields such as computational fluid dynamics, structures, and mechanical and electrical engineering, to name a few. Since it provides complete proofs in most places, it can also serve as a textbook in courses on acceleration of convergence of iterative vector processes, for example.

Table of contents

This book paints a fresco of the field of extrapolation and rational approximation over the last several centuries to the present through the works of their primary contributors. It can serve as an introduction to the topics covered, including extrapolation methods, Padé approximation, orthogonal polynomials, continued fractions, Lanczos-type methods etc.; it also provides in depth discussion of the many links between these subjects. A highlight of this book is the presentation of the human side of the fields discussed via personal testimonies from contemporary researchers, their anecdotes, and their exclusive remembrances of some of the “actors.” This book shows how research in this domain started and evolved. Biographies of other scholars encountered have also been included. An important branch of mathematics is described in its historical context, opening the way to new developments. After a mathematical introduction, the book contains a precise description of the mathematical landscape of these fields spanning from the 19th century to the first part of the 20th. After an analysis of the works produced after that period (in particular those of Richardson, Aitken, Shanks, Wynn, and others), the most recent developments and applications are reviewed.

Computational methods are an integral part of most scientific disciplines, and a rudimentary understanding of their potential and limitations is essential for any scientist or engineer. This textbook introduces computational science through a set of methods and algorithms, with the aim of familiarizing the reader with the field’s theoretical foundations and providing the practical skills to use and develop computational methods. Centered around a set of fundamental algorithms presented in the form of pseudocode, this self-contained textbook extends the classical syllabus with new material, including high performance computing, adjoint methods, machine learning, randomized algorithms, and quantum computing. It presents theoretical material alongside several examples and exercises and provides Python implementations of many key algorithms. Methods in Computational Science is for advanced undergraduate and graduate-level students studying computer science and data science. It can also be used to support continuous learning for practicing mathematicians, data scientists, computer scientists, and engineers in the field of computational science. It is appropriate for courses in advanced numerical analysis, data science, numerical optimization, and approximation theory.

Dynamical systems are a principal tool in the modeling, prediction, and control of a wide range of complex phenomena. As the need for improved accuracy leads to larger and more complex dynamical systems, direct simulation often becomes the only available strategy for accurate prediction or control, inevitably creating a considerable burden on computational resources. This is the main context where one considers model reduction, seeking to replace large systems of coupled differential and algebraic equations that constitute high fidelity system models with substantially fewer equations that are crafted to control the loss of fidelity that order reduction may induce in the system response. Interpolatory methods are among the most widely used model reduction techniques, and Interpolatory Methods for Model Reduction is the first comprehensive analysis of this approach available in a single, extensive resource. It introduces state-of-the-art methods reflecting significant developments over the past two decades, covering both classical projection frameworks for model reduction and data-driven, nonintrusive frameworks. This textbook is appropriate for a wide audience of engineers and other scientists working in the general areas of large-scale dynamical systems and data-driven modeling of dynamics.

Offers students a practical knowledge of modern techniques in scientific computing.

This volume is a self-contained, exhaustive exposition of the extrapolation methods theory, and of the various algorithms and procedures for accelerating the convergence of scalar and vector sequences. Many subroutines (written in FORTRAN 77) with instructions for their use are provided on a floppy disk in order to demonstrate to those working with sequences the advantages of the use of extrapolation methods. Many numerical examples showing the effectiveness of the procedures and a consequent chapter on applications are also provided – including some never before published results and applications. Although intended for researchers in the field, and for those using extrapolation methods for solving particular problems, this volume also provides a valuable resource for graduate courses on the subject.

Deformable objects are ubiquitous in the world surrounding us, on all levels from micro to macro. The need to study such shapes and model their behavior arises in a wide spectrum of applications, ranging from medicine to security. In recent years, non-rigid shapes have attracted growing interest, which has led to rapid development of the field, where state-of-the-art results from very different sciences - theoretical and numerical geometry, optimization, linear algebra, graph theory, machine learning and computer graphics, to mention several - are applied to find solutions. This book gives an overview of the current state of science in analysis and synthesis of non-rigid shapes. Everyday examples are used to explain concepts and to illustrate different techniques. The presentation unfolds systematically and numerous figures enrich the engaging exposition. Practice problems follow at the end of each chapter, with detailed solutions to selected problems in the appendix. A gallery of colored images enhances the text. This book will be of interest to graduate students, researchers and professionals in different fields of mathematics, computer science and engineering. It may be used for courses in computer vision, numerical geometry and geometric modeling and computer graphics or for self-study.

The book presents the state of the art of nonlocal modeling and discretization and provides a practical introduction to nonlocal modeling for readers who are not familiar with such models. These models have recently become a viable alternative to classical partial differential equations when the latter are unable to capture effects such as discontinuities and multiscale behavior in a system of interest. Because of their integral nature, nonlocal operators allow for the relaxation of regularity requirements on the solution and thus allow for the capture of multiscale effects, the result of which is their successful use in many scientific and engineering applications. The book also provides a thorough analysis and numerical treatment of nonstandard nonlocal models, focusing on both well-known and nonstandard interaction neighborhoods. In addition, the book delivers an extensive practical treatment of the implementation of discretization strategies via finite element methods. Numerous figures are provided as concrete examples to illustrate both the analytic and computational results. Nonlocal Integral Equation Continuum Models: Nonstandard Interaction Neighborhoods and Finite Element Discretizations is intended for mathematical and application researchers interested in alternatives to using partial differential equation models that better describe the phenomena they are interested in. The book will also be of use to computational scientists and engineers who need to make sense of how to use available software, improve existing software, or develop new software tailored to their application interests.