This book contains different developments of infinite dimensional convex programming in the context of convex analysis, including duality, minmax and Lagrangians, and convexification of nonconvex optimization problems in the calculus of variations (infinite dimension). It also includes the theory of convex duality applied to partial differential equations; no other reference presents this in a systematic way. The minmax theorems contained in this book have many useful applications, in particular the robust control of partial differential equations in finite time horizon. First published in English in 1976, this SIAM Classics in Applied Mathematics edition contains the original text along with a new preface and some additional references.

From its origins in the minimization of integral functionals, the notion of variations has evolved greatly in connection with applications in optimization, equilibrium, and control. This book develops a unified framework and provides a detailed exposition of variational geometry and subdifferential calculus in their current forms beyond classical and convex analysis. Also covered are set-convergence, set-valued mappings, epi-convergence, duality, and normal integrands.

This reference text, now in its second edition, offers a modern unifying presentation of three basic areas of nonlinear analysis: convex analysis, monotone operator theory, and the fixed point theory of nonexpansive operators. Taking a unique comprehensive approach, the theory is developed from the ground up, with the rich connections and interactions between the areas as the central focus, and it is illustrated by a large number of examples. The Hilbert space setting of the material offers a wide range of applications while avoiding the technical difficulties of general Banach spaces. The authors have also drawn upon recent advances and modern tools to simplify the proofs of key results making the book more accessible to a broader range of scholars and users. Combining a strong emphasis on applications with exceptionally lucid writing and an abundance of exercises, this text is of great value to a large audience including pure and applied mathematicians as well as researchers in engineering, data science, machine learning, physics, decision sciences, economics, and inverse problems. The second edition of Convex Analysis and Monotone Operator Theory in Hilbert Spaces greatly expands on the first edition, containing over 140 pages of new material, over 270 new results, and more than 100 new exercises. It features a new chapter on proximity operators including two sections on proximity operators of matrix functions, in addition to several new sections distributed throughout the original chapters. Many existing results have been improved, and the list of references has been updated. Heinz H. Bauschke is a Full Professor of Mathematics at the Kelowna campus of the University of British Columbia, Canada. Patrick L. Combettes, IEEE Fellow, was on the faculty of the City University of New York and of Université Pierre et Marie Curie – Paris 6 before joining North Carolina State University as a Distinguished Professor of Mathematics in 2016.

This book presents comprehensive state-of-the-art theoretical analysis of the fundamental Newtonian and Newtonian-related approaches to solving optimization and variational problems. A central focus is the relationship between the basic Newton scheme for a given problem and algorithms that also enjoy fast local convergence. The authors develop general perturbed Newtonian frameworks that preserve fast convergence and consider specific algorithms as particular cases within those frameworks, i.e., as perturbations of the associated basic Newton iterations. This approach yields a set of tools for the unified treatment of various algorithms, including some not of the Newton type per se. Among the new subjects addressed is the class of degenerate problems. In particular, the phenomenon of attraction of Newton iterates to critical Lagrange multipliers and its consequences as well as stabilized Newton methods for variational problems and stabilized sequential quadratic programming for optimization. This volume will be useful to researchers and graduate students in the fields of optimization and variational analysis.

Analyses Lagrange multiplier theory and demonstrates its impact on the development of numerical algorithms for variational problems in function spaces.

This book examines the most fundamental parts of convex analysis and its applications to optimization and location problems. Accessible techniques of variational analysis are employed to clarify and simplify some basic proofs in convex analysis and to build a theory of generalized differentiation for convex functions and sets in finite dimensions. The book serves as a bridge for the readers who have just started using convex analysis to reach deeper topics in the field. Detailed proofs are presented for most of the results in the book and also included are many figures and exercises for better understanding the material. Applications provided include both the classical topics of convex optimization and important problems of modern convex optimization, convex geometry, and facility location.

Investigations in modem nonlinear analysis rely on ideas, methods and prob lems from various fields of mathematics, mechanics, physics and other applied sciences. In the second half of the twentieth century many prominent, ex emplary problems in nonlinear analysis were subject to intensive study and examination. The united ideas and methods of differential geometry, topology, differential equations and functional analysis as well as other areas of research in mathematics were successfully applied towards the complete solution of com plex problems in nonlinear analysis. It is not possible to encompass in the scope of one book all concepts, ideas, methods and results related to nonlinear analysis. Therefore, we shall restrict ourselves in this monograph to nonlinear elliptic boundary value problems as well as global geometric problems. In order that we may examine these prob lems, we are provided with a fundamental vehicle: The theory of convex bodies and hypersurfaces. In this book we systematically present a series of centrally significant results obtained in the second half of the twentieth century up to the present time. Particular attention is given to profound interconnections between various divisions in nonlinear analysis. The theory of convex functions and bodies plays a crucial role because the ellipticity of differential equations is closely connected with the local and global convexity properties of their solutions. Therefore it is necessary to have a sufficiently large amount of material devoted to the theory of convex bodies and functions and their connections with partial differential equations.

This systematic and comprehensive account of asymptotic sets and functions develops a broad and useful theory in the areas of optimization and variational inequalities. The central focus is on problems of handling unbounded situations, using solutions of a given problem in these classes, when for example standard compacity hypothesis is not present. This book will interest advanced graduate students, researchers, and practitioners of optimization theory, nonlinear programming, and applied mathematics.

Due to the general complementary convex structure underlying most nonconvex optimization problems encountered in applications, convex analysis plays an essential role in the development of global optimization methods. This book develops a coherent and rigorous theory of deterministic global optimization from this point of view. Part I constitutes an introduction to convex analysis, with an emphasis on concepts, properties and results particularly needed for global optimization, including those pertaining to the complementary convex structure. Part II presents the foundation and application of global search principles such as partitioning and cutting, outer and inner approximation, and decomposition to general global optimization problems and to problems with a low-rank nonconvex structure as well as quadratic problems. Much new material is offered, aside from a rigorous mathematical development. Audience: The book is written as a text for graduate students in engineering, mathematics, operations research, computer science and other disciplines dealing with optimization theory. It is also addressed to all scientists in various fields who are interested in mathematical optimization.