Artificial intelligence has already enabled pivotal advances in diverse fields, yet its impact on computer architecture has only just begun. In particular, recent work has explored broader application to the design, optimization, and simulation of computer architecture. Notably, machine-learning-based strategies often surpass prior state-of-the-art analytical, heuristic, and human-expert approaches. This book reviews the application of machine learning in system-wide simulation and run-time optimization, and in many individual components such as caches/memories, branch predictors, networks-on-chip, and GPUs. The book further analyzes current practice to highlight useful design strategies and identify areas for future work, based on optimized implementation strategies, opportune extensions to existing work, and ambitious long term possibilities. Taken together, these strategies and techniques present a promising future for increasingly automated computer architecture designs.

Ascend AI Processor Architecture and Programming: Principles and Applications of CANN offers in-depth AI applications using Huawei's Ascend chip, presenting and analyzing the unique performance and attributes of this processor. The title introduces the fundamental theory of AI, the software and hardware architecture of the Ascend AI processor, related tools and programming technology, and typical application cases. It demonstrates internal software and hardware design principles, system tools and programming techniques for the processor, laying out the elements of AI programming technology needed by researchers developing AI applications. Chapters cover the theoretical fundamentals of AI and deep learning, the state of the industry, including the current state of Neural Network Processors, deep learning frameworks, and a deep learning compilation framework, the hardware architecture of the Ascend AI processor, programming methods and practices for developing the processor, and finally, detailed case studies on data and algorithms for AI. - Presents the performance and attributes of the Huawei Ascend AI processor - Describes the software and hardware architecture of the Ascend processor - Lays out the elements of AI theory, processor architecture, and AI applications - Provides detailed case studies on data and algorithms for AI - Offers insights into processor architecture and programming to spark new AI applications

Theoretical results suggest that in order to learn the kind of complicated functions that can represent high-level abstractions (e.g. in vision, language, and other AI-level tasks), one may need deep architectures. Deep architectures are composed of multiple levels of non-linear operations, such as in neural nets with many hidden layers or in complicated propositional formulae re-using many sub-formulae. Searching the parameter space of deep architectures is a difficult task, but learning algorithms such as those for Deep Belief Networks have recently been proposed to tackle this problem with notable success, beating the state-of-the-art in certain areas. This paper discusses the motivations and principles regarding learning algorithms for deep architectures, in particular those exploiting as building blocks unsupervised learning of single-layer models such as Restricted Boltzmann Machines, used to construct deeper models such as Deep Belief Networks.

The present book supports the increasing complexity and the growing need for computational power of artificial intelligence (AI) by providing comprehensive treatments of new hardware and software engineering met in AI language design and applications. The book is a collection of 16 substantial papers (chapters), the contributors being 51 well-known researchers in the AI fields. The papers are grouped into the following five sections: Section 1 represents a well documented survey on symbolic processing computers. Section 2 (Language-based AI Architectures) supports the design and implementation of AI language-oriented computers. Three (2-4) chapters are devoted to (computer architecture concerning) sequential Lisp processing: architectural features of Lisp computers, Symbolics’ Lisp computer architecture, memory management and performance evaluation of a Lisp machine system. Other three (5-7) chapters discuss multiprocessing and parallel processing of Lisp (and general functional) programs. The last two chapters of section 2 are presenting architectures supporting object-oriented programming (Smalltalk) and production systems. Section 3 (Multiprocessor AI Architecture) contains two (10-11) chapters, dealing with Connection Machine architecture and its applications, and with the design of data/knowledge base machines for AI processing. Section 4 (Connectionist Architectures and Applications) include two (12-13) chapters, illustrating the connectionist model architecture design and learning. Section 5 (Software Architectures for AI Applications) is made up of three (14-16) chapters, analysing the relationship between AI and software engineering, the development tools for AI programs, and the problem of AI hardware and software reliability. This book addresses a wide range of AI readers, from beginners to professionals. It carries forth doubtless qualities: compact and well-dimensioned chapters, comprehensively written by AI remarkable professionals, covering up-to-date AI topics and trends.

Künstliche Intelligenz (KI) hat Eingang in unzählige Branchen gefunden. In der Architektur steckt der Einsatz von KI noch in den Kinderschuhen, doch die Entwicklung der letzten Jahre hat vielversprechende Ergebnisse gebracht. Das Buch ist eine gut verständliche Einführung. Sie bietet einen Überblick über die Geschichte der KI und ihre ersten Anwendungen in der Architektur. Im zweiten Teil präsentiert der Autor konkrete Beispiele für den kreativen Einsatz von KI in der Praxis. Führende Experten, von der Havard-University bis zur Bauhaus Universität, eröffnen schließlich in Essays vielfältige Perspektiven auf das Potenzial von KI. Als Einführung zeigt das Buch ein Panorama dieser neuen technologischen Möglichkeiten und verdeutlicht so das Versprechen, das sie für die Architektur darstellen.

Machine learning, and specifically deep learning, has been hugely disruptive in many fields of computer science. The success of deep learning techniques in solving notoriously difficult classification and regression problems has resulted in their rapid adoption in solving real-world problems. The emergence of deep learning is widely attributed to a virtuous cycle whereby fundamental advancements in training deeper models were enabled by the availability of massive datasets and high-performance computer hardware. This text serves as a primer for computer architects in a new and rapidly evolving field. We review how machine learning has evolved since its inception in the 1960s and track the key developments leading up to the emergence of the powerful deep learning techniques that emerged in the last decade. Next we review representative workloads, including the most commonly used datasets and seminal networks across a variety of domains. In addition to discussing the workloads themselves, we also detail the most popular deep learning tools and show how aspiring practitioners can use the tools with the workloads to characterize and optimize DNNs. The remainder of the book is dedicated to the design and optimization of hardware and architectures for machine learning. As high-performance hardware was so instrumental in the success of machine learning becoming a practical solution, this chapter recounts a variety of optimizations proposed recently to further improve future designs. Finally, we present a review of recent research published in the area as well as a taxonomy to help readers understand how various contributions fall in context.

This book provides a comprehensive introduction to processing-in-memory (PIM) technology, from its architectures to circuits implementations on multiple memory types and describes how it can be a viable computer architecture in the era of AI and big data. The authors summarize the challenges of AI hardware systems, processing-in-memory (PIM) constraints and approaches to derive system-level requirements for a practical and feasible PIM solution. The presentation focuses on feasible PIM solutions that can be implemented and used in real systems, including architectures, circuits, and implementation cases for each major memory type (SRAM, DRAM, and ReRAM).

‘The advent of machine learning-based AI systems demands that our industry does not just share toys, but builds a new sandbox in which to play with them.’ - Phil Bernstein The profession is changing. A new era is rapidly approaching when computers will not merely be instruments for data creation, manipulation and management, but, empowered by artificial intelligence, they will become agents of design themselves. Architects need a strategy for facing the opportunities and threats of these emergent capabilities or risk being left behind. Architecture’s best-known technologist, Phil Bernstein, provides that strategy. Divided into three key sections – Process, Relationships and Results – Machine Learning lays out an approach for anticipating, understanding and managing a world in which computers often augment, but may well also supplant, knowledge workers like architects. Armed with this insight, practices can take full advantage of the new technologies to future-proof their business. Features chapters on: Professionalism Tools and technologies Laws, policy and risk Delivery, means and methods Creating, consuming and curating data Value propositions and business models.

The dramatic increase in computer performance has been extraordinary, but not for all computations: it has key limits and structure. Software architects, developers, and even data scientists need to understand how exploit the fundamental structure of computer performance to harness it for future applications. Ideal for upper level undergraduates, Computer Architecture for Scientists covers four key pillars of computer performance and imparts a high-level basis for reasoning with and understanding these concepts: Small is fast – how size scaling drives performance; Implicit parallelism – how a sequential program can be executed faster with parallelism; Dynamic locality – skirting physical limits, by arranging data in a smaller space; Parallelism – increasing performance with teams of workers. These principles and models provide approachable high-level insights and quantitative modelling without distracting low-level detail. Finally, the text covers the GPU and machine-learning accelerators that have become increasingly important for mainstream applications.

Artificial intelligence is everywhere – from the apps on our phones to the algorithms of search engines. Without us noticing, the AI revolution has arrived. But what does this mean for the world of design? The first volume in a two-book series, Architecture in the Age of Artificial Intelligence introduces AI for designers and considers its positive potential for the future of architecture and design. Explaining what AI is and how it works, the book examines how different manifestations of AI will impact the discipline and profession of architecture. Highlighting current case-studies as well as near-future applications, it shows how AI is already being used as a powerful design tool, and how AI-driven information systems will soon transform the design of buildings and cities. Far-sighted, provocative and challenging, yet rooted in careful research and cautious speculation, this book, written by architect and theorist Neil Leach, is a must-read for all architects and designers – including students of architecture and all design professionals interested in keeping their practice at the cutting edge of technology.