A review of radial basis founction (RBF) neural networks. A novel sequential learning algorithm for minimal resource allocation neural networks (MRAN). MRAN for function approximation & pattern classification problems; MRAN for nonlinear dynamic systems; MRAN for communication channel equalization; Concluding remarks; A outline source code for MRAN in MATLAB; Bibliography; Index.

This book presents in detail the newly developed sequential learning algorithm for radial basis function neural networks, which realizes a minimal network. This algorithm, created by the authors, is referred to as Minimal Resource Allocation Networks (MRAN). The book describes the application of MRAN in different areas, including pattern recognition, time series prediction, system identification, control, communication and signal processing. Benchmark problems from these areas have been studied, and MRAN is compared with other algorithms. In order to make the book self-contained, a review of the existing theory of RBF networks and applications is given at the beginning.

This volume presents new trends and developments in soft computing techniques. Topics include: neural networks, fuzzy systems, evolutionary computation, knowledge discovery, rough sets, and hybrid methods. It also covers various applications of soft computing techniques in economics, mechanics, medicine, automatics and image processing. The book contains contributions from internationally recognized scientists, such as Zadeh, Bubnicki, Pawlak, Amari, Batyrshin, Hirota, Koczy, Kosinski, Novák, S.-Y. Lee, Pedrycz, Raudys, Setiono, Sincak, Strumillo, Takagi, Usui, Wilamowski and Zurada. An excellent overview of soft computing methods and their applications.

Presents some of the most promising current research in the design and training of artificial neural networks (ANNs) with applications in speech and vision, as reported by the investigators themselves. The volume is divided into three sections. The first gives an overview of the general field of ANN.

The three volume set LNCS 5551/5552/5553 constitutes the refereed proceedings of the 6th International Symposium on Neural Networks, ISNN 2009, held in Wuhan, China in May 2009. The 409 revised papers presented were carefully reviewed and selected from a total of 1.235 submissions. The papers are organized in 20 topical sections on theoretical analysis, stability, time-delay neural networks, machine learning, neural modeling, decision making systems, fuzzy systems and fuzzy neural networks, support vector machines and kernel methods, genetic algorithms, clustering and classification, pattern recognition, intelligent control, optimization, robotics, image processing, signal processing, biomedical applications, fault diagnosis, telecommunication, sensor network and transportation systems, as well as applications.

This book provides engineers and scientists in academia and industry with a thorough understanding of the underlying principles of nonlinear system identification. It equips them to apply the models and methods discussed to real problems with confidence, while also making them aware of potential difficulties that may arise in practice. Moreover, the book is self-contained, requiring only a basic grasp of matrix algebra, signals and systems, and statistics. Accordingly, it can also serve as an introduction to linear system identification, and provides a practical overview of the major optimization methods used in engineering. The focus is on gaining an intuitive understanding of the subject and the practical application of the techniques discussed. The book is not written in a theorem/proof style; instead, the mathematics is kept to a minimum, and the ideas covered are illustrated with numerous figures, examples, and real-world applications. In the past, nonlinear system identification was a field characterized by a variety of ad-hoc approaches, each applicable only to a very limited class of systems. With the advent of neural networks, fuzzy models, Gaussian process models, and modern structure optimization techniques, a much broader class of systems can now be handled. Although one major aspect of nonlinear systems is that virtually every one is unique, tools have since been developed that allow each approach to be applied to a wide variety of systems.

The Radial Basis Function (RBF) neural network has gained in popularity over recent years because of its rapid training and its desirable properties in classification and functional approximation applications. RBF network research has focused on enhanced training algorithms and variations on the basic architecture to improve the performance of the network. In addition, the RBF network is proving to be a valuable tool in a diverse range of application areas, for example, robotics, biomedical engineering, and the financial sector. The two volumes provide a comprehensive survey of the latest developments in this area. Volume 1 covers advances in training algorithms, variations on the architecture and function of the basis neurons, and hybrid paradigms, for example RBF learning using genetic algorithms. Both volumes will prove extremely useful to practitioners in the field, engineers, researchers and technically accomplished managers.

This book covers both classical and modern models in deep learning. The primary focus is on the theory and algorithms of deep learning. The theory and algorithms of neural networks are particularly important for understanding important concepts, so that one can understand the important design concepts of neural architectures in different applications. Why do neural networks work? When do they work better than off-the-shelf machine-learning models? When is depth useful? Why is training neural networks so hard? What are the pitfalls? The book is also rich in discussing different applications in order to give the practitioner a flavor of how neural architectures are designed for different types of problems. Applications associated with many different areas like recommender systems, machine translation, image captioning, image classification, reinforcement-learning based gaming, and text analytics are covered. The chapters of this book span three categories: The basics of neural networks: Many traditional machine learning models can be understood as special cases of neural networks. An emphasis is placed in the first two chapters on understanding the relationship between traditional machine learning and neural networks. Support vector machines, linear/logistic regression, singular value decomposition, matrix factorization, and recommender systems are shown to be special cases of neural networks. These methods are studied together with recent feature engineering methods like word2vec. Fundamentals of neural networks: A detailed discussion of training and regularization is provided in Chapters 3 and 4. Chapters 5 and 6 present radial-basis function (RBF) networks and restricted Boltzmann machines. Advanced topics in neural networks: Chapters 7 and 8 discuss recurrent neural networks and convolutional neural networks. Several advanced topics like deep reinforcement learning, neural Turing machines, Kohonen self-organizing maps, and generative adversarial networks are introduced in Chapters 9 and 10. The book is written for graduate students, researchers, and practitioners. Numerous exercises are available along with a solution manual to aid in classroom teaching. Where possible, an application-centric view is highlighted in order to provide an understanding of the practical uses of each class of techniques.

Statistical pattern recognition; Probability density estimation; Single-layer networks; The multi-layer perceptron; Radial basis functions; Error functions; Parameter optimization algorithms; Pre-processing and feature extraction; Learning and generalization; Bayesian techniques; Appendix; References; Index.

Fully Tuned Radial Basis Function Neural Networks for Flight Control presents the use of the Radial Basis Function (RBF) neural networks for adaptive control of nonlinear systems with emphasis on flight control applications. A Lyapunov synthesis approach is used to derive the tuning rules for the RBF controller parameters in order to guarantee the stability of the closed loop system. Unlike previous methods that tune only the weights of the RBF network, this book presents the derivation of the tuning law for tuning the centers, widths, and weights of the RBF network, and compares the results with existing algorithms. It also includes a detailed review of system identification, including indirect and direct adaptive control of nonlinear systems using neural networks. Fully Tuned Radial Basis Function Neural Networks for Flight Control is an excellent resource for professionals using neural adaptive controllers for flight control applications.