This book presents comprehensive state-of-the-art theoretical analysis of the fundamental Newtonian and Newtonian-related approaches to solving optimization and variational problems. A central focus is the relationship between the basic Newton scheme for a given problem and algorithms that also enjoy fast local convergence. The authors develop general perturbed Newtonian frameworks that preserve fast convergence and consider specific algorithms as particular cases within those frameworks, i.e., as perturbations of the associated basic Newton iterations. This approach yields a set of tools for the unified treatment of various algorithms, including some not of the Newton type per se. Among the new subjects addressed is the class of degenerate problems. In particular, the phenomenon of attraction of Newton iterates to critical Lagrange multipliers and its consequences as well as stabilized Newton methods for variational problems and stabilized sequential quadratic programming for optimization. This volume will be useful to researchers and graduate students in the fields of optimization and variational analysis.

A comprehensive treatment of semismooth Newton methods in function spaces: from their foundations to recent progress in the field. This book is appropriate for researchers and practitioners in PDE-constrained optimization, nonlinear optimization and numerical analysis, as well as engineers interested in the current theory and methods for solving variational inequalities.

This book contains different developments of infinite dimensional convex programming in the context of convex analysis, including duality, minmax and Lagrangians, and convexification of nonconvex optimization problems in the calculus of variations (infinite dimension). It also includes the theory of convex duality applied to partial differential equations; no other reference presents this in a systematic way. The minmax theorems contained in this book have many useful applications, in particular the robust control of partial differential equations in finite time horizon. First published in English in 1976, this SIAM Classics in Applied Mathematics edition contains the original text along with a new preface and some additional references.

This monograph is devoted to a comprehensive treatment of iterative methods for solving nonlinear equations with particular emphasis on semi-local convergence analysis. Theoretical results are applied to engineering, dynamic economic systems, input-output systems, nonlinear and linear differential equations, and optimization problems. Accompanied by many exercises, some with solutions, the book may be used as a supplementary text in the classroom for an advanced course on numerical functional analysis.

After more than three decades of research, the subject of complementarity problems and its numerous extensions has become a well-established and fruitful discipline within mathematical programming and applied mathematics. Sources of these problems are diverse and span numerous areas in engineering, economics, and the sciences. Includes refereed articles.

Analyses Lagrange multiplier theory and demonstrates its impact on the development of numerical algorithms for variational problems in function spaces.

The chapters in this volume, written by international experts from different fields of mathematics, are devoted to honoring George Isac, a renowned mathematician. These contributions focus on recent developments in complementarity theory, variational principles, stability theory of functional equations, nonsmooth optimization, and several other important topics at the forefront of nonlinear analysis and optimization.

Although the monograph Progress in Optimization I: Contributions from Aus tralasia grew from the idea of publishing a proceedings of the Fourth Optimiza tion Day, held in July 1997 at the Royal Melbourne Institute of Technology, the focus soon changed to a refereed volume in optimization. The intention is to publish a similar book annually, following each Optimization Day. The idea of having an annual Optimization Day was conceived by Barney Glover; the first of these Optimization Days was held in 1994 at the University of Ballarat. Barney hoped that such a yearly event would bring together the many, but widely dispersed, researchers in Australia who were publishing in optimization and related areas such as control. The first Optimization Day event was followed by similar conferences at The University of New South Wales (1995), The University of Melbourne (1996), the Royal Melbourne Institute of Technology (1997), and The University of Western Australia (1998). The 1999 conference will return to Ballarat University, being organized by Barney's long-time collaborator Alex Rubinov. In recent years the Optimization Day has been held in conjunction with other locally-held national or international conferences. This has widened the scope of the monograph with contributions not only coming from researchers in Australia and neighboring regions but also from their collaborators in Europe and North America.

This book presents an introduction to variational analysis, a field which unifies theories and techniques developed in calculus of variations, optimization, and control, and covers convex analysis, nonsmooth analysis, and set-valued analysis. It focuses on problems with constraints, the analysis of which involves set-valued mappings and functions that are not differentiable. Applications of variational analysis are interdisciplinary, ranging from financial planning to steering a flying object. The book is addressed to graduate students, researchers, and practitioners in mathematical sciences, engineering, economics, and finance. A typical reader of the book should be familiar with multivariable calculus and linear algebra. Some basic knowledge in optimization, control, and elementary functional analysis is desirable, but all necessary background material is included in the book.

Since I started working in the area of nonlinear programming and, later on, variational inequality problems, I have frequently been surprised to find that many algorithms, however scattered in numerous journals, monographs and books, and described rather differently, are closely related to each other. This book is meant to help the reader understand and relate algorithms to each other in some intuitive fashion, and represents, in this respect, a consolidation of the field. The framework of algorithms presented in this book is called Cost Approxi mation. (The preface of the Ph.D. thesis [Pat93d] explains the background to the work that lead to the thesis, and ultimately to this book.) It describes, for a given formulation of a variational inequality or nonlinear programming problem, an algorithm by means of approximating mappings and problems, a principle for the update of the iteration points, and a merit function which guides and monitors the convergence of the algorithm. One purpose of this book is to offer this framework as an intuitively appeal ing tool for describing an algorithm. One of the advantages of the framework, or any reasonable framework for that matter, is that two algorithms may be easily related and compared through its use. This framework is particular in that it covers a vast number of methods, while still being fairly detailed; the level of abstraction is in fact the same as that of the original problem statement.