0:0017:28

Autonomous Vehicle Safety Overview

Palak Talwar 17:28 2021

An autonomous car can have zero failures and still be unsafe

Bright sunlight on a camera lens breaks nothing, yet it can make an autonomous vehicle do something it was never meant to do. That gap, between a system that has not failed and one that is truly safe, is where much of the remaining work lies. Senior Safety Engineer Palak Talwar of Lyft's self-driving division walks through it, and the harder question behind it: how would anyone know a self-driving car is safe enough?

Learn the technical and regulatory hurdles standing between autonomous vehicles and public roads

Watch on YouTube

In short

Palak Talwar, Senior Safety Engineer at Lyft's self-driving division, gives a beginner-friendly overview of autonomous vehicle safety, from autonomy levels and vehicle architecture to the technical and regulatory hurdles that remain. She argues that functional safety (ISO 26262) is only a starting point: SOTIF, verification and validation, cybersecurity, liability and the lack of an agreed safety metric all stand between AVs and deployment at scale.

“Now, when you talk about functional safety, functional safety is only focused on detecting system failures and reacting to those failures, right?”
“But how do you know it's safe enough? So I think defining a metric, or, you know, how do you measure safety is a big question or a challenge, you know, for AVs.”

What you will learn

  • Distinguish functional safety (ISO 26262), which handles system failures, from SOTIF, which handles unintended behaviour when nothing has failed.
  • Map the four pillars of an autonomous vehicle: sensors, autonomy software, vehicle controls and electrical systems.
  • Explain the levels of autonomy from L1 driver assist to geofenced L4 and full L5.
  • Recognise why defining a metric for safe enough is the central open problem in AV verification and validation.
  • Identify the regulatory hurdles to deployment: proving customer safety, the shift of liability to manufacturers and AV-ready infrastructure.

Key takeaways from the speaker

  • Autonomous Vehicle Safety

Details

Level
Beginner
Format
Talk
Technical depth
Introductory technical
For
Student, Early career, Mid-career
Length
17:28
Published
June 2021

Questions this talk answers

What is the difference between functional safety and SOTIF?

Functional safety, under ISO 26262, focuses on detecting system failures and reacting to them. SOTIF, safety of the intended functionality, covers cases where nothing has failed but sensor limitations or inadequate training data make the vehicle behave in unintended ways.

Why is it so hard to prove an autonomous vehicle is safe enough?

Teams can run many hours of testing on the bench, in the field and on the vehicle, but there is no agreed metric for safety. Organisations such as IEEE, SAE and AVSC are working on how to define one.

Who is liable when an autonomous vehicle causes an accident?

Current liability laws already make manufacturers liable for safety incidents. As driving responsibility shifts from the driver to the car, liability may shift from the driver to the manufacturer too.

How soon will autonomous vehicles be commercialised at scale?

Talwar does not expect it right away or within the next couple of years, since L4 autonomy is still limited to geofenced areas and regulatory standards are not yet in place. Going from L4 to L5 will be a big jump.

How will AI affect autonomous vehicle safety?

AI and machine learning are interlinked with perception, prediction, localization and planning in the autonomy stack. Making sure neural networks have adequate training data and that perception errors are minimised is where the big challenge lies.

About this talk

The research and development of autonomous vehicles can potentially revolutionize the transportation sector. However, as several countries worldwide prepare to roll out the technology, that will take over driving functions from testing stages to commercial phases, safety measures and regulations remain a significant concern. In addition, the anticipated shift in driving responsibilities from a driver to an autonomous vehicle serves as a motivation for researching and analyzing liability and safety concerns. Failing to develop or observe safety regulations and standards exposes autonomous vehicle users to high risks, including unexpected accidents that may cause death. More importantly, reasonable and precise determination of safety liabilities are essential to encourage manufacturers to research further how to ensure autonomous vehicles are safe and secure.

Topics

Related talks

Browse the library