This book aims to provide a collection of state-of-the-art scientific and technical research papers related to machine learning-based algorithms in the field of optimization and engineering design. The theoretical and practical development for numerous engineering applications such as smart homes, ICT-based irrigation systems, academic success prediction, future agro-industry for crop production, disease classification in plants, dental problems and solutions, loan eligibility processing, etc., and their implementation with several case studies and literature reviews are included as self-contained chapters. Additionally, the book intends to highlight the importance of study and effectiveness in addressing the time and space complexity of problems and enhancing accuracy, analysis, and validations for different practical applications by acknowledging the state-of-the-art literature survey. The book targets a larger audience by exploring multidisciplinary research directions such as computer vision, machine learning, artificial intelligence, modified/newly developed machine learning algorithms, etc., to enhance engineering design applications for society. State-of-the-art research work with illustrations and exercises along with pseudo-code has been provided here.

Based on course-tested material, this rigorous yet accessible graduate textbook covers both fundamental and advanced optimization theory and algorithms. It covers a wide range of numerical methods and topics, including both gradient-based and gradient-free algorithms, multidisciplinary design optimization, and uncertainty, with instruction on how to determine which algorithm should be used for a given application. It also provides an overview of models and how to prepare them for use with numerical optimization, including derivative computation. Over 400 high-quality visualizations and numerous examples facilitate understanding of the theory, and practical tips address common issues encountered in practical engineering design optimization and how to address them. Numerous end-of-chapter homework problems, progressing in difficulty, help put knowledge into practice. Accompanied online by a solutions manual for instructors and source code for problems, this is ideal for a one- or two-semester graduate course on optimization in aerospace, civil, mechanical, electrical, and chemical engineering departments.

An up-to-date account of the interplay between optimization and machine learning, accessible to students and researchers in both communities. The interplay between optimization and machine learning is one of the most important developments in modern computational science. Optimization formulations and methods are proving to be vital in designing algorithms to extract essential knowledge from huge volumes of data. Machine learning, however, is not simply a consumer of optimization technology but a rapidly evolving field that is itself generating new optimization ideas. This book captures the state of the art of the interaction between optimization and machine learning in a way that is accessible to researchers in both fields. Optimization approaches have enjoyed prominence in machine learning because of their wide applicability and attractive theoretical properties. The increasing complexity, size, and variety of today's machine learning models call for the reassessment of existing assumptions. This book starts the process of reassessment. It describes the resurgence in novel contexts of established frameworks such as first-order methods, stochastic approximations, convex relaxations, interior-point methods, and proximal methods. It also devotes attention to newer themes such as regularized optimization, robust optimization, gradient and subgradient methods, splitting techniques, and second-order methods. Many of these techniques draw inspiration from other fields, including operations research, theoretical computer science, and subfields of optimization. The book will enrich the ongoing cross-fertilization between the machine learning community and these other fields, and within the broader optimization community.

Mechanical design includes an optimization process in which designers always consider objectives such as strength, deflection, weight, wear, corrosion, etc. depending on the requirements. However, design optimization for a complete mechanical assembly leads to a complicated objective function with a large number of design variables. It is a good practice to apply optimization techniques for individual components or intermediate assemblies than a complete assembly. Analytical or numerical methods for calculating the extreme values of a function may perform well in many practical cases, but may fail in more complex design situations. In real design problems, the number of design parameters can be very large and their influence on the value to be optimized (the goal function) can be very complicated, having nonlinear character. In these complex cases, advanced optimization algorithms offer solutions to the problems, because they find a solution near to the global optimum within reasonable time and computational costs. Mechanical Design Optimization Using Advanced Optimization Techniques presents a comprehensive review on latest research and development trends for design optimization of mechanical elements and devices. Using examples of various mechanical elements and devices, the possibilities for design optimization with advanced optimization techniques are demonstrated. Basic and advanced concepts of traditional and advanced optimization techniques are presented, along with real case studies, results of applications of the proposed techniques, and the best optimization strategies to achieve best performance are highlighted. Furthermore, a novel advanced optimization method named teaching-learning-based optimization (TLBO) is presented in this book and this method shows better performance with less computational effort for the large scale problems. Mechanical Design Optimization Using Advanced Optimization Techniques is intended for designers, practitioners, managers, institutes involved in design related projects, applied research workers, academics, and graduate students in mechanical and industrial engineering and will be useful to the industrial product designers for realizing a product as it presents new models and optimization techniques to make tasks easier, logical, efficient and effective. .

Machine learning and optimization techniques are revolutionizing our world. Other types of information technology have not progressed as rapidly in recent years, in terms of real impact. The aim of this book is to present some of the innovative techniques in the field of optimization and machine learning, and to demonstrate how to apply them in the fields of engineering. Optimization and Machine Learning presents modern advances in the selection, configuration and engineering of algorithms that rely on machine learning and optimization. The first part of the book is dedicated to applications where optimization plays a major role, and the second part describes and implements several applications that are mainly based on machine learning techniques. The methods addressed in these chapters are compared against their competitors, and their effectiveness in their chosen field of application is illustrated.

"This book describes the process of analyzing data. The authors have extensive experience both managing data analysts and conducting their own data analyses, and this book is a distillation of their experience in a format that is applicable to both practitioners and managers in data science."--Leanpub.com.

A comprehensive introduction to optimization with a focus on practical algorithms for the design of engineering systems. This book offers a comprehensive introduction to optimization with a focus on practical algorithms. The book approaches optimization from an engineering perspective, where the objective is to design a system that optimizes a set of metrics subject to constraints. Readers will learn about computational approaches for a range of challenges, including searching high-dimensional spaces, handling problems where there are multiple competing objectives, and accommodating uncertainty in the metrics. Figures, examples, and exercises convey the intuition behind the mathematical approaches. The text provides concrete implementations in the Julia programming language. Topics covered include derivatives and their generalization to multiple dimensions; local descent and first- and second-order methods that inform local descent; stochastic methods, which introduce randomness into the optimization process; linear constrained optimization, when both the objective function and the constraints are linear; surrogate models, probabilistic surrogate models, and using probabilistic surrogate models to guide optimization; optimization under uncertainty; uncertainty propagation; expression optimization; and multidisciplinary design optimization. Appendixes offer an introduction to the Julia language, test functions for evaluating algorithm performance, and mathematical concepts used in the derivation and analysis of the optimization methods discussed in the text. The book can be used by advanced undergraduates and graduate students in mathematics, statistics, computer science, any engineering field, (including electrical engineering and aerospace engineering), and operations research, and as a reference for professionals.

Achieving a better solution or improving the performance of existing system design is an ongoing a process for which scientists, engineers, mathematicians and researchers have been striving for many years. Ever increasingly practical and robust methods have been developed, and every new generation of computers with their increased power and speed allows for the development and wider application of new types of solutions. This book defines the fundamentals, background and theoretical concepts of optimization principles in a comprehensive manner along with their potential applications and implementation strategies. It encompasses linear programming, multivariable methods for risk assessment, nonlinear methods, ant colony optimization, particle swarm optimization, multi-criterion and topology optimization, learning classifier, case studies on six sigma, performance measures and evaluation, multi-objective optimization problems, machine learning approaches, genetic algorithms and quality of service optimizations. The book will be very useful for wide spectrum of target readers including students and researchers in academia and industry.

This well-received book, now in its second edition, continues to provide a number of optimization algorithms which are commonly used in computer-aided engineering design. The book begins with simple single-variable optimization techniques, and then goes on to give unconstrained and constrained optimization techniques in a step-by-step format so that they can be coded in any user-specific computer language. In addition to classical optimization methods, the book also discusses Genetic Algorithms and Simulated Annealing, which are widely used in engineering design problems because of their ability to find global optimum solutions. The second edition adds several new topics of optimization such as design and manufacturing, data fitting and regression, inverse problems, scheduling and routing, data mining, intelligent system design, Lagrangian duality theory, and quadratic programming and its extension to sequential quadratic programming. It also extensively revises the linear programming algorithms section in the Appendix. This edition also includes more number of exercise problems. The book is suitable for senior undergraduate/postgraduate students of mechanical, production and chemical engineering. Students in other branches of engineering offering optimization courses as well as designers and decision-makers will also find the book useful. Key Features Algorithms are presented in a step-by-step format to facilitate coding in a computer language. Sample computer programs in FORTRAN are appended for better comprehension. Worked-out examples are illustrated for easy understanding. The same example problems are solved with most algorithms for a comparative evaluation of the algorithms.

Convex optimization problems arise frequently in many different fields. This book provides a comprehensive introduction to the subject, and shows in detail how such problems can be solved numerically with great efficiency. The book begins with the basic elements of convex sets and functions, and then describes various classes of convex optimization problems. Duality and approximation techniques are then covered, as are statistical estimation techniques. Various geometrical problems are then presented, and there is detailed discussion of unconstrained and constrained minimization problems, and interior-point methods. The focus of the book is on recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples and homework exercises and will appeal to students, researchers and practitioners in fields such as engineering, computer science, mathematics, statistics, finance and economics.