A practical guide to learning visual perception for self-driving cars for computer vision and autonomous system engineers Key FeaturesExplore the building blocks of the visual perception system in self-driving carsIdentify objects and lanes to define the boundary of driving surfaces using open-source tools like OpenCV and PythonImprove the object detection and classification capabilities of systems with the help of neural networksBook Description The visual perception capabilities of a self-driving car are powered by computer vision. The work relating to self-driving cars can be broadly classified into three components - robotics, computer vision, and machine learning. This book provides existing computer vision engineers and developers with the unique opportunity to be associated with this booming field. You will learn about computer vision, deep learning, and depth perception applied to driverless cars. The book provides a structured and thorough introduction, as making a real self-driving car is a huge cross-functional effort. As you progress, you will cover relevant cases with working code, before going on to understand how to use OpenCV, TensorFlow and Keras to analyze video streaming from car cameras. Later, you will learn how to interpret and make the most of lidars (light detection and ranging) to identify obstacles and localize your position. You’ll even be able to tackle core challenges in self-driving cars such as finding lanes, detecting pedestrian and crossing lights, performing semantic segmentation, and writing a PID controller. By the end of this book, you’ll be equipped with the skills you need to write code for a self-driving car running in a driverless car simulator, and be able to tackle various challenges faced by autonomous car engineers. What you will learnUnderstand how to perform camera calibrationBecome well-versed with how lane detection works in self-driving cars using OpenCVExplore behavioral cloning by self-driving in a video-game simulatorGet to grips with using lidarsDiscover how to configure the controls for autonomous vehiclesUse object detection and semantic segmentation to locate lanes, cars, and pedestriansWrite a PID controller to control a self-driving car running in a simulatorWho this book is for This book is for software engineers who are interested in learning about technologies that drive the autonomous car revolution. Although basic knowledge of computer vision and Python programming is required, prior knowledge of advanced deep learning and how to use sensors (lidar) is not needed.

Explore self-driving car technology using deep learning and artificial intelligence techniques and libraries such as TensorFlow, Keras, and OpenCV Key FeaturesBuild and train powerful neural network models to build an autonomous carImplement computer vision, deep learning, and AI techniques to create automotive algorithmsOvercome the challenges faced while automating different aspects of driving using modern Python libraries and architecturesBook Description Thanks to a number of recent breakthroughs, self-driving car technology is now an emerging subject in the field of artificial intelligence and has shifted data scientists' focus to building autonomous cars that will transform the automotive industry. This book is a comprehensive guide to use deep learning and computer vision techniques to develop autonomous cars. Starting with the basics of self-driving cars (SDCs), this book will take you through the deep neural network techniques required to get up and running with building your autonomous vehicle. Once you are comfortable with the basics, you'll delve into advanced computer vision techniques and learn how to use deep learning methods to perform a variety of computer vision tasks such as finding lane lines, improving image classification, and so on. You will explore the basic structure and working of a semantic segmentation model and get to grips with detecting cars using semantic segmentation. The book also covers advanced applications such as behavior-cloning and vehicle detection using OpenCV, transfer learning, and deep learning methodologies to train SDCs to mimic human driving. By the end of this book, you'll have learned how to implement a variety of neural networks to develop your own autonomous vehicle using modern Python libraries. What you will learnImplement deep neural network from scratch using the Keras libraryUnderstand the importance of deep learning in self-driving carsGet to grips with feature extraction techniques in image processing using the OpenCV libraryDesign a software pipeline that detects lane lines in videosImplement a convolutional neural network (CNN) image classifier for traffic signal signsTrain and test neural networks for behavioral-cloning by driving a car in a virtual simulatorDiscover various state-of-the-art semantic segmentation and object detection architecturesWho this book is for If you are a deep learning engineer, AI researcher, or anyone looking to implement deep learning and computer vision techniques to build self-driving blueprint solutions, this book is for you. Anyone who wants to learn how various automotive-related algorithms are built, will also find this book useful. Python programming experience, along with a basic understanding of deep learning, is necessary to get the most of this book.

This book takes a look at fully automated, autonomous vehicles and discusses many open questions: How can autonomous vehicles be integrated into the current transportation system with diverse users and human drivers? Where do automated vehicles fall under current legal frameworks? What risks are associated with automation and how will society respond to these risks? How will the marketplace react to automated vehicles and what changes may be necessary for companies? Experts from Germany and the United States define key societal, engineering, and mobility issues related to the automation of vehicles. They discuss the decisions programmers of automated vehicles must make to enable vehicles to perceive their environment, interact with other road users, and choose actions that may have ethical consequences. The authors further identify expectations and concerns that will form the basis for individual and societal acceptance of autonomous driving. While the safety benefits of such vehicles are tremendous, the authors demonstrate that these benefits will only be achieved if vehicles have an appropriate safety concept at the heart of their design. Realizing the potential of automated vehicles to reorganize traffic and transform mobility of people and goods requires similar care in the design of vehicles and networks. By covering all of these topics, the book aims to provide a current, comprehensive, and scientifically sound treatment of the emerging field of “autonomous driving".

This book is the first technical overview of autonomous vehicles written for a general computing and engineering audience. The authors share their practical experiences of creating autonomous vehicle systems. These systems are complex, consisting of three major subsystems: (1) algorithms for localization, perception, and planning and control; (2) client systems, such as the robotics operating system and hardware platform; and (3) the cloud platform, which includes data storage, simulation, high-definition (HD) mapping, and deep learning model training. The algorithm subsystem extracts meaningful information from sensor raw data to understand its environment and make decisions about its actions. The client subsystem integrates these algorithms to meet real-time and reliability requirements. The cloud platform provides offline computing and storage capabilities for autonomous vehicles. Using the cloud platform, we are able to test new algorithms and update the HD map—plus, train better recognition, tracking, and decision models. This book consists of nine chapters. Chapter 1 provides an overview of autonomous vehicle systems; Chapter 2 focuses on localization technologies; Chapter 3 discusses traditional techniques used for perception; Chapter 4 discusses deep learning based techniques for perception; Chapter 5 introduces the planning and control sub-system, especially prediction and routing technologies; Chapter 6 focuses on motion planning and feedback control of the planning and control subsystem; Chapter 7 introduces reinforcement learning-based planning and control; Chapter 8 delves into the details of client systems design; and Chapter 9 provides the details of cloud platforms for autonomous driving. This book should be useful to students, researchers, and practitioners alike. Whether you are an undergraduate or a graduate student interested in autonomous driving, you will find herein a comprehensive overview of the whole autonomous vehicle technology stack. If you are an autonomous driving practitioner, the many practical techniques introduced in this book will be of interest to you. Researchers will also find plenty of references for an effective, deeper exploration of the various technologies.

The automotive industry appears close to substantial change engendered by “self-driving” technologies. This technology offers the possibility of significant benefits to social welfare—saving lives; reducing crashes, congestion, fuel consumption, and pollution; increasing mobility for the disabled; and ultimately improving land use. This report is intended as a guide for state and federal policymakers on the many issues that this technology raises.

The technology and engineering behind autonomous driving is advancing at pace. This book presents the latest technical advances and the economic, environmental and social impact driverless cars will have on individuals and the automotive industry.

From famed automotive journalist Jason Torchinsky, of Jalopnik and Jay Leno's Garage, comes a witty insider's guide to make sense of self-driving cars and predict the road ahead. Self-driving cars sound fantastical and futuristic and yet they'll soon be on every street in America. Whether it's Tesla's Autopilot, Google's Waymo, Mercedes's Distronic, or Uber's modified Volvos, companies around the world are developing autonomous cars. But why? And what will they mean for the auto industry and humanity at large? In Robot, Take the Wheel, Torchinsky gives a colorful account of the development of autonomous vehicles and their likely implications. He encourages us to think of self-driving cars as an entirely new machine, something beyond cars as we understand them today, and considers how humans will get along with these robots that will take over our cars' jobs, what they will look like, what sorts of jobs they may do, what we can expect of them, how they should act, ethically, how we can have fun with them, and how we can make sure there's still a place for those of us who love to drive, especially with a manual transmission. This vibrant volume explores what's ahead and what we can do now to shape the automated future.

This report presents a framework for measuring safety in automated vehicles (AVs): how to define safety for AVs, how to measure safety for AVs, and how to communicate what is learned or understood about AVs.

#1 bestselling author Stephenie Meyer makes a triumphant return to the world of Twilight with this highly anticipated companion: the iconic love story of Bella and Edward told from the vampire's point of view. When Edward Cullen and Bella Swan met in Twilight, an iconic love story was born. But until now, fans have heard only Bella's side of the story. At last, readers can experience Edward's version in the long-awaited companion novel, Midnight Sun. This unforgettable tale as told through Edward's eyes takes on a new and decidedly dark twist. Meeting Bella is both the most unnerving and intriguing event he has experienced in all his years as a vampire. As we learn more fascinating details about Edward's past and the complexity of his inner thoughts, we understand why this is the defining struggle of his life. How can he justify following his heart if it means leading Bella into danger? In Midnight Sun, Stephenie Meyer transports us back to a world that has captivated millions of readers and brings us an epic novel about the profound pleasures and devastating consequences of immortal love. An instant #1 New York Times BestsellerAn instant #1 USA Today BestsellerAn instant #1 Wall Street Journal BestsellerAn instant #1 IndieBound BestsellerApple Audiobook August Must-Listens Pick "People do not want to just read Meyer's books; they want to climb inside them and live there." -- Time "A literary phenomenon." -- New York Times