Environment perception with cameras is an important requirement for many applications for autonomous vehicles and robots. This work presents a stereoscopic omnidirectional camera system for autonomous vehicles which resolves the problem of a limited field of view and provides a 360° panoramic view of the environment. We present a new projection model for these cameras and show that the camera setup overcomes major drawbacks of traditional perspective cameras in many applications.

Environment perception with cameras is an important requirement for many applications for autonomous vehicles and robots. This work presents a stereoscopic omnidirectional camera system for autonomous vehicles which resolves the problem of a limited field of view and provides a 360° panoramic view of the environment. We present a new projection model for these cameras and show that the camera setup overcomes major drawbacks of traditional perspective cameras in many applications. This work was published by Saint Philip Street Press pursuant to a Creative Commons license permitting commercial use. All rights not granted by the work's license are retained by the author or authors.

This work develops a motion planner that compensates the deficiencies from perception modules by exploiting the reaction capabilities of a vehicle. The work analyzes present uncertainties and defines driving objectives together with constraints that ensure safety. The resulting problem is solved in real-time, in two distinct ways: first, with nonlinear optimization, and secondly, by framing it as a partially observable Markov decision process and approximating the solution with sampling.

Multi-camera systems are being deployed in a variety of vehicles and mobile robots today. To eliminate the need for cost and labor intensive maintenance and calibration, continuous self-calibration is highly desirable. In this book we present such an approach for self-calibration of multi-Camera systems for vehicle surround sensing. In an extensive evaluation we assess our algorithm quantitatively using real-world data.

This work presents a behavior planning algorithm for automated driving in urban environments with an uncertain and dynamic nature. The algorithm allows to consider the prediction uncertainty (e.g. different intentions), perception uncertainty (e.g. occlusions) as well as the uncertain interactive behavior of the other agents explicitly. Simulating the most likely future scenarios allows to find an optimal policy online that enables non-conservative planning under uncertainty.

In motion planning for automated vehicles, a thorough uncertainty consideration is crucial to facilitate safe and convenient driving behavior. This work presents three motion planning approaches which are targeted towards the predominant uncertainties in different scenarios, along with an extended safety verification framework. The approaches consider uncertainties from imperfect perception, occlusions and limited sensor range, and also those in the behavior of other traffic participants.

Mobile robotic systems need to perceive their surroundings in order to act independently. In this work a perception framework is developed which interprets the data of a binocular camera in order to transform it into a compact, expressive model of the environment. This model enables a mobile system to move in a targeted way and interact with its surroundings. It is shown how the developed methods also provide a solid basis for technical assistive aids for visually impaired people.

This works describes an approach to lane-precise localization on current digital maps. A particle filter fuses data from production vehicle sensors, such as GPS, radar, and camera. Performance evaluations on more than 200 km of data show that the proposed algorithm can reliably determine the current lane. Furthermore, a possible architecture for an intuitive route guidance system based on Augmented Reality is proposed together with a lane-change recommendation for unclear situations.

Collision avoidance systems like emergency braking assist systems have demonstrated their effectiveness in increasing the safety of vehicle passengers in various studies. To further increase the effectiveness of collision avoidance systems, the exploitation of the lateral free space by evasive maneuvers is being investigated in this book. This work focuses on methods for integrated trajectory planning and vehicle dynamics control in collision avoidance scenarios by combined evasion and braking.

GNSS is often inaccurate and satellite signals are not always available, which results in ambiguous situations. In order to reduce their negative effects on train-borne localization, this work proposes an approach for the detection of tracks, turnouts, and branching directions solely from 2d lidar sensor measurements. The experimental evaluation shows highly correct and complete results. In summary, these detections are sufficient to reduce ambiguity problems in train-borne localization.