A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles

The goal of SafeBench is to systematically evaluate the safety and robustness of autonomous driving (AD) algorithms based on diverse testing scenarios and comprehensive evaluation metrics. Specifically, we consider 8 safety-critical testing scenarios following National Highway Traffic Safety Administration (NHTSA) and develop 4 scenario generation algorithms considering 10 variations for each scenario. For each AD algorithm, we report the evaluation results based on 10 metrics. Please find more details in our paper here.

Available Scenarios
Straight Obstacle
Turning Obstacle
Lane Changing
Vehicle Passing
Red-light Running
Unprotected Left-turn
Crossing Negotiation