This book presents comprehensive state-of-the-art theoretical analysis of the fundamental Newtonian and Newtonian-related approaches to solving optimization and variational problems. A central focus is the relationship between the basic Newton scheme for a given problem and algorithms that also enjoy fast local convergence. The authors develop general perturbed Newtonian frameworks that preserve fast convergence and consider specific algorithms as particular cases within those frameworks, i.e., as perturbations of the associated basic Newton iterations. This approach yields a set of tools for the unified treatment of various algorithms, including some not of the Newton type per se. Among the new subjects addressed is the class of degenerate problems. In particular, the phenomenon of attraction of Newton iterates to critical Lagrange multipliers and its consequences as well as stabilized Newton methods for variational problems and stabilized sequential quadratic programming for optimization. This volume will be useful to researchers and graduate students in the fields of optimization and variational analysis.

Semismooth Newton methods are a modern class of remarkably powerful and versatile algorithms for solving constrained optimization problems with partial differential equations (PDEs), variational inequalities, and related problems. This book provides a comprehensive presentation of these methods in function spaces, striking a balance between thoroughly developed theory and numerical applications. Although largely self-contained, the book also covers recent developments in the field, such as state-constrained problems, and offers new material on topics such as improved mesh independence results. The theory and methods are applied to a range of practically important problems, including: optimal control of nonlinear elliptic differential equations, obstacle problems, and flow control of instationary Navier-Stokes fluids. In addition, the author covers adjoint-based derivative computation and the efficient solution of Newton systems by multigrid and preconditioned iterative methods.

This book contains different developments of infinite dimensional convex programming in the context of convex analysis, including duality, minmax and Lagrangians, and convexification of nonconvex optimization problems in the calculus of variations (infinite dimension). It also includes the theory of convex duality applied to partial differential equations; no other reference presents this in a systematic way. The minmax theorems contained in this book have many useful applications, in particular the robust control of partial differential equations in finite time horizon. First published in English in 1976, this SIAM Classics in Applied Mathematics edition contains the original text along with a new preface and some additional references.

This monograph is devoted to a comprehensive treatment of iterative methods for solving nonlinear equations with particular emphasis on semi-local convergence analysis. Theoretical results are applied to engineering, dynamic economic systems, input-output systems, nonlinear and linear differential equations, and optimization problems. Accompanied by many exercises, some with solutions, the book may be used as a supplementary text in the classroom for an advanced course on numerical functional analysis.

This book studies the approximate solutions of optimization problems in the presence of computational errors. A number of results are presented on the convergence behavior of algorithms in a Hilbert space; these algorithms are examined taking into account computational errors. The author illustrates that algorithms generate a good approximate solution, if computational errors are bounded from above by a small positive constant. Known computational errors are examined with the aim of determining an approximate solution. Researchers and students interested in the optimization theory and its applications will find this book instructive and informative. This monograph contains 16 chapters; including a chapters devoted to the subgradient projection algorithm, the mirror descent algorithm, gradient projection algorithm, the Weiszfelds method, constrained convex minimization problems, the convergence of a proximal point method in a Hilbert space, the continuous subgradient method, penalty methods and Newton’s method.

This book presents an introduction to variational analysis, a field which unifies theories and techniques developed in calculus of variations, optimization, and control, and covers convex analysis, nonsmooth analysis, and set-valued analysis. It focuses on problems with constraints, the analysis of which involves set-valued mappings and functions that are not differentiable. Applications of variational analysis are interdisciplinary, ranging from financial planning to steering a flying object. The book is addressed to graduate students, researchers, and practitioners in mathematical sciences, engineering, economics, and finance. A typical reader of the book should be familiar with multivariable calculus and linear algebra. Some basic knowledge in optimization, control, and elementary functional analysis is desirable, but all necessary background material is included in the book.

After more than three decades of research, the subject of complementarity problems and its numerous extensions has become a well-established and fruitful discipline within mathematical programming and applied mathematics. Sources of these problems are diverse and span numerous areas in engineering, economics, and the sciences. Includes refereed articles.