People are facing more and more NP-complete or NP-hard problems of a combinatorial nature and of a continuous nature in economic, military and management practice. There are two ways in which one can enhance the efficiency of searching for the solutions of these problems. The first is to improve the speed and memory capacity of hardware. We all have witnessed the computer industry's amazing achievements with hardware and software developments over the last twenty years. On one hand many computers, bought only a few years ago, are being sent to elementary schools for children to learn the ABC's of computing. On the other hand, with economic, scientific and military developments, it seems that the increase of intricacy and the size of newly arising problems have no end. We all realize then that the second way, to design good algorithms, will definitely compensate for the hardware limitations in the case of complicated problems. It is the collective and parallel computation property of artificial neural net works that has activated the enthusiasm of researchers in the field of computer science and applied mathematics. It is hard to say that artificial neural networks are solvers of the above-mentioned dilemma, but at least they throw some new light on the difficulties we face. We not only anticipate that there will be neural computers with intelligence but we also believe that the research results of artificial neural networks might lead to new algorithms on von Neumann's computers.

A topical introduction on the ability of artificial neural networks to not only solve on-line a wide range of optimization problems but also to create new techniques and architectures. Provides in-depth coverage of mathematical modeling along with illustrative computer simulation results.

An up-to-date account of the interplay between optimization and machine learning, accessible to students and researchers in both communities. The interplay between optimization and machine learning is one of the most important developments in modern computational science. Optimization formulations and methods are proving to be vital in designing algorithms to extract essential knowledge from huge volumes of data. Machine learning, however, is not simply a consumer of optimization technology but a rapidly evolving field that is itself generating new optimization ideas. This book captures the state of the art of the interaction between optimization and machine learning in a way that is accessible to researchers in both fields. Optimization approaches have enjoyed prominence in machine learning because of their wide applicability and attractive theoretical properties. The increasing complexity, size, and variety of today's machine learning models call for the reassessment of existing assumptions. This book starts the process of reassessment. It describes the resurgence in novel contexts of established frameworks such as first-order methods, stochastic approximations, convex relaxations, interior-point methods, and proximal methods. It also devotes attention to newer themes such as regularized optimization, robust optimization, gradient and subgradient methods, splitting techniques, and second-order methods. Many of these techniques draw inspiration from other fields, including operations research, theoretical computer science, and subfields of optimization. The book will enrich the ongoing cross-fertilization between the machine learning community and these other fields, and within the broader optimization community.

A systematic account of artificial neural network paradigms that identifies fundamental concepts and major methodologies. Important results are integrated into the text in order to explain a wide range of existing empirical observations and commonly used heuristics.

Network models are critical tools in business, management, science and industry. “Network Models and Optimization” presents an insightful, comprehensive, and up-to-date treatment of multiple objective genetic algorithms to network optimization problems in many disciplines, such as engineering, computer science, operations research, transportation, telecommunication, and manufacturing. The book extensively covers algorithms and applications, including shortest path problems, minimum cost flow problems, maximum flow problems, minimum spanning tree problems, traveling salesman and postman problems, location-allocation problems, project scheduling problems, multistage-based scheduling problems, logistics network problems, communication network problem, and network models in assembly line balancing problems, and airline fleet assignment problems. The book can be used both as a student textbook and as a professional reference for practitioners who use network optimization methods to model and solve problems.

This book introduces readers to the fundamentals of artificial neural networks, with a special emphasis on evolutionary algorithms. At first, the book offers a literature review of several well-regarded evolutionary algorithms, including particle swarm and ant colony optimization, genetic algorithms and biogeography-based optimization. It then proposes evolutionary version of several types of neural networks such as feed forward neural networks, radial basis function networks, as well as recurrent neural networks and multi-later perceptron. Most of the challenges that have to be addressed when training artificial neural networks using evolutionary algorithms are discussed in detail. The book also demonstrates the application of the proposed algorithms for several purposes such as classification, clustering, approximation, and prediction problems. It provides a tutorial on how to design, adapt, and evaluate artificial neural networks as well, and includes source codes for most of the proposed techniques as supplementary materials.

This book provides a new forum for the dissemination of knowledge in both theoretical and applied research on swarm intelligence (SI) and artificial neural network (ANN). It accelerates interaction between the two bodies of knowledge and fosters a unified development in the next generation of computational model for machine learning. To the best of our knowledge, the integration of SI and ANN is the first attempt to integrate various aspects of both the independent research area into a single volume.

Many approaches have sprouted from artificial intelligence (AI) and produced major breakthroughs in the computer science and engineering industries. Deep learning is a method that is transforming the world of data and analytics. Optimization of this new approach is still unclear, however, and there’s a need for research on the various applications and techniques of deep learning in the field of computing. Deep Learning Techniques and Optimization Strategies in Big Data Analytics is a collection of innovative research on the methods and applications of deep learning strategies in the fields of computer science and information systems. While highlighting topics including data integration, computational modeling, and scheduling systems, this book is ideally designed for engineers, IT specialists, data analysts, data scientists, engineers, researchers, academicians, and students seeking current research on deep learning methods and its application in the digital industry.

This volume presents the set of final accepted papers for the tenth edition of the IWANN conference “International Work-Conference on Artificial neural Networks” held in Salamanca (Spain) during June 10–12, 2009. IWANN is a biennial conference focusing on the foundations, theory, models and applications of systems inspired by nature (mainly, neural networks, evolutionary and soft-computing systems). Since the first edition in Granada (LNCS 540, 1991), the conference has evolved and matured. The list of topics in the successive Call for - pers has also evolved, resulting in the following list for the present edition: 1. Mathematical and theoretical methods in computational intelligence. C- plex and social systems. Evolutionary and genetic algorithms. Fuzzy logic. Mathematics for neural networks. RBF structures. Self-organizing networks and methods. Support vector machines. 2. Neurocomputational formulations. Single-neuron modelling. Perceptual m- elling. System-level neural modelling. Spiking neurons. Models of biological learning. 3. Learning and adaptation. Adaptive systems. Imitation learning. Reconfig- able systems. Supervised, non-supervised, reinforcement and statistical al- rithms. 4. Emulation of cognitive functions. Decision making. Multi-agent systems. S- sor mesh. Natural language. Pattern recognition. Perceptual and motor functions (visual, auditory, tactile, virtual reality, etc.). Robotics. Planning motor control. 5. Bio-inspired systems and neuro-engineering. Embedded intelligent systems. Evolvable computing. Evolving hardware. Microelectronics for neural, fuzzy and bio-inspired systems. Neural prostheses. Retinomorphic systems. Bra- computer interfaces (BCI). Nanosystems. Nanocognitive systems.

Optimization happens everywhere. Machine learning is one example of such and gradient descent is probably the most famous algorithm for performing optimization. Optimization means to find the best value of some function or model. That can be the maximum or the minimum according to some metric. Using clear explanations, standard Python libraries, and step-by-step tutorial lessons, you will learn how to find the optimum point to numerical functions confidently using modern optimization algorithms.