This is an essentially self-contained book on the theory of convex functions and convex optimization in Banach spaces, with a special interest in Orlicz spaces. Approximate algorithms based on the stability principles and the solution of the corresponding nonlinear equations are developed in this text. A synopsis of the geometry of Banach spaces, aspects of stability and the duality of different levels of differentiability and convexity is developed. A particular emphasis is placed on the geometrical aspects of strong solvability of a convex optimization problem: it turns out that this property is equivalent to local uniform convexity of the corresponding convex function. This treatise also provides a novel approach to the fundamental theorems of Variational Calculus based on the principle of pointwise minimization of the Lagrangian on the one hand and convexification by quadratic supplements using the classical Legendre-Ricatti equation on the other. The reader should be familiar with the concepts of mathematical analysis and linear algebra. Some awareness of the principles of measure theory will turn out to be helpful. The book is suitable for students of the second half of undergraduate studies, and it provides a rich set of material for a master course on linear and nonlinear functional analysis. Additionally it offers novel aspects at the advanced level. From the contents: Approximation and Polya Algorithms in Orlicz Spaces Convex Sets and Convex Functions Numerical Treatment of Non-linear Equations and Optimization Problems Stability and Two-stage Optimization Problems Orlicz Spaces, Orlicz Norm and Duality Differentiability and Convexity in Orlicz Spaces Variational Calculus

Classroom-tested at the London School of Economics, this original, highly readable text offers numerous examples and exercises as well as detailed solutions. Prerequisites are multivariable calculus and basic linear algebra. 2015 edition.

​This book introduces the basic concepts of real and functional analysis. It presents the fundamentals of the calculus of variations, convex analysis, duality, and optimization that are necessary to develop applications to physics and engineering problems. The book includes introductory and advanced concepts in measure and integration, as well as an introduction to Sobolev spaces. The problems presented are nonlinear, with non-convex variational formulation. Notably, the primal global minima may not be attained in some situations, in which cases the solution of the dual problem corresponds to an appropriate weak cluster point of minimizing sequences for the primal one. Indeed, the dual approach more readily facilitates numerical computations for some of the selected models. While intended primarily for applied mathematicians, the text will also be of interest to engineers, physicists, and other researchers in related fields.

Engineers must make decisions regarding the distribution of expensive resources in a manner that will be economically beneficial. This problem can be realistically formulated and logically analyzed with optimization theory. This book shows engineers how to use optimization theory to solve complex problems. Unifies the large field of optimization with a few geometric principles. Covers functional analysis with a minimum of mathematics. Contains problems that relate to the applications in the book.

A comprehensive treatment of semismooth Newton methods in function spaces: from their foundations to recent progress in the field. This book is appropriate for researchers and practitioners in PDE-constrained optimization, nonlinear optimization and numerical analysis, as well as engineers interested in the current theory and methods for solving variational inequalities.

An updated and revised edition of the 1986 title Convexity and Optimization in Banach Spaces, this book provides a self-contained presentation of basic results of the theory of convex sets and functions in infinite-dimensional spaces. The main emphasis is on applications to convex optimization and convex optimal control problems in Banach spaces. A distinctive feature is a strong emphasis on the connection between theory and application. This edition has been updated to include new results pertaining to advanced concepts of subdifferential for convex functions and new duality results in convex programming. The last chapter, concerned with convex control problems, has been rewritten and completed with new research concerning boundary control systems, the dynamic programming equations in optimal control theory and periodic optimal control problems. Finally, the structure of the book has been modified to highlight the most recent progression in the field including fundamental results on the theory of infinite-dimensional convex analysis and includes helpful bibliographical notes at the end of each chapter.

This work is intended to serve as a guide for graduate students and researchers who wish to get acquainted with the main theoretical and practical tools for the numerical minimization of convex functions on Hilbert spaces. Therefore, it contains the main tools that are necessary to conduct independent research on the topic. It is also a concise, easy-to-follow and self-contained textbook, which may be useful for any researcher working on related fields, as well as teachers giving graduate-level courses on the topic. It will contain a thorough revision of the extant literature including both classical and state-of-the-art references.

In the past two decades, convex analysis and optimization have been developed in Hadamard spaces. This book represents a first attempt to give a systematic account on the subject. Hadamard spaces are complete geodesic spaces of nonpositive curvature. They include Hilbert spaces, Hadamard manifolds, Euclidean buildings and many other important spaces. While the role of Hadamard spaces in geometry and geometric group theory has been studied for a long time, first analytical results appeared as late as in the 1990s. Remarkably, it turns out that Hadamard spaces are appropriate for the theory of convex sets and convex functions outside of linear spaces. Since convexity underpins a large number of results in the geometry of Hadamard spaces, we believe that its systematic study is of substantial interest. Optimization methods then address various computational issues and provide us with approximation algorithms which may be useful in sciences and engineering. We present a detailed description of such an application to computational phylogenetics. The book is primarily aimed at both graduate students and researchers in analysis and optimization, but it is accessible to advanced undergraduate students as well.

Solving optimization problems subject to constraints given in terms of partial d- ferential equations (PDEs) with additional constraints on the controls and/or states is one of the most challenging problems in the context of industrial, medical and economical applications, where the transition from model-based numerical si- lations to model-based design and optimal control is crucial. For the treatment of such optimization problems the interaction of optimization techniques and num- ical simulation plays a central role. After proper discretization, the number of op- 3 10 timization variables varies between 10 and 10 . It is only very recently that the enormous advances in computing power have made it possible to attack problems of this size. However, in order to accomplish this task it is crucial to utilize and f- ther explore the speci?c mathematical structure of optimization problems with PDE constraints, and to develop new mathematical approaches concerning mathematical analysis, structure exploiting algorithms, and discretization, with a special focus on prototype applications. The present book provides a modern introduction to the rapidly developing ma- ematical ?eld of optimization with PDE constraints. The ?rst chapter introduces to the analytical background and optimality theory for optimization problems with PDEs. Optimization problems with PDE-constraints are posed in in?nite dim- sional spaces. Therefore, functional analytic techniques, function space theory, as well as existence- and uniqueness results for the underlying PDE are essential to study the existence of optimal solutions and to derive optimality conditions.

Many books on optimization consider only finite dimensional spaces. This volume is unique in its emphasis: the first three chapters develop optimization in spaces without linear structure, and the analog of convex analysis is constructed for this case. Many new results have been proved specially for this publication. In the following chapters optimization in infinite topological and normed vector spaces is considered. The novelty consists in using the drop property for weak well-posedness of linear problems in Banach spaces and in a unified approach (by means of the Dolecki approximation) to necessary conditions of optimality. The method of reduction of constraints for sufficient conditions of optimality is presented. The book contains an introduction to non-differentiable and vector optimization. Audience: This volume will be of interest to mathematicians, engineers, and economists working in mathematical optimization.