DRIVERLESS CAR SAFETY —

Report: Software bug led to death in Uber’s

self-driving crash
Sensors detected Elaine Herzberg, but software reportedly decided to ignore her.
TIMOTHY B. LEE - 5/8/2018, 6:12 AM

SUBSCRIBE SIGN IN
NTSB

Enlarge / NTSB officials inspecting the vehicle that killed Elaine Herzberg in a March crash in Arizona.

The fatal crash that killed pedestrian Elaine Herzberg in Tempe, Arizona, in March occurred because of a
software bug in Uber's self-driving car technology, The Information's Amir Efrati reported on Monday.
According to two anonymous sources who talked to Efrati, Uber's sensors did, in fact, detect Herzberg as she
crossed the street with her bicycle. Unfortunately, the software classified her as a "false positive" and decided
it didn't need to stop for her.

Distinguishing between real objects and illusory ones is one of the most basic challenges of developing self-
driving car software. Software needs to detect objects like cars, pedestrians, and large rocks in its path and
stop or swerve to avoid them. However, there may be other objects—like a plastic bag in the road or a trash
can on the sidewalk—that a car can safely ignore. Sensor anomalies may also cause software to detect
apparent objects where no objects actually exist.

Software designers face a basic tradeoff here. If the software is programmed to be too cautious, the ride will
be slow and jerky, as the car constantly slows down for objects that pose no threat to the car or aren't there
at all. Tuning the software in the opposite direction will produce a smooth ride most of the time—but at the
risk that the software will occasionally ignore a real object. According to Efrati, that's what happened in
Tempe in March—and unfortunately the "real object" was a human being.

FURTHER READING
"There's a reason Uber would tune its system to be less Police chief said Uber victim “came
from the shadows”—don’t believe it
cautious about objects around the car," Efrati wrote. "It is trying
to develop a self-driving car that is comfortable to ride in."

"Uber had been racing to meet an end-of-year internal goal of allowing customers in the Phoenix area to ride
in Uber’s autonomous Volvo vehicles with no safety driver sitting behind the wheel," Efrati added.

The more cautiously a car's software is programmed, the more often it will slam on its brakes unnecessarily.
That will produce a safer ride but also one that's not as comfortable for passengers.

This provides some useful context for Efrati's March report that cars from Cruise, GM's self-driving car
subsidiary, "frequently swerve and hesitate." He wrote that Cruise cars "sometimes slow down or stop if they
see a bush on the side of a street or a lane-dividing pole, mistaking it for an object in their path."

You could read that as a sign that Cruise's software isn't very good. But you could also view it as a sign that
Cruise's engineers are being appropriately cautious. It's obviously much better for software to produce a
jerky, erratic ride than to provide a smooth ride that occasionally runs over a pedestrian. And such caution is
especially warranted when you're testing in a busy urban environment like San Francisco.

Of course, the long-term goal is for self-driving cars to become so good at recognizing objects that false
positives and false negatives both become rare. But Herzberg's death provides a tragic reminder that
companies shouldn't get too far ahead of themselves. Getting fully self-driving cars on the road is a
worthwhile goal. But making sure that's done safely is more important.

Uber declined to comment to The Information, citing confidentiality requirements related to an ongoing
investigation by the National Transportation Safety Board. We've asked Uber for comment and will update if
the company responds.

READER COMMENTS 441 SHARE THIS STORY

TIMOTHY B. LEE
Timothy is a senior reporter covering tech policy, blockchain technologies and the future of transportation. He lives
in Washington DC.

EMAIL timothy.lee@arstechnica.com // TWITTER @binarybits

‘The Rock’ Picks Up $9.5

SPONSORED
CONTENT Million Georgia Farm
BY MANSION GLOBAL
 The F-35's next tech
upgrade

US Navy Gets an
Italian Accent
WATCH
The F-35's next tech
upgrade SITREP: DOD Resets
Ballistic Missile
Interceptor program
The F-35's next tech upgrade
New processor, new display, and software fixes are coming. SITREP DOD' N
Will they be enough? + More videos

← PREVIOUS STORY NEXT STORY →

Related Stories

NTSB: Uber’s sensors How terrible software Why it’s time for Uber to Video suggests huge
worked; its software utterly design decisions led to get out of the self-driving problems with Uber’s
failed in fatal crash Uber’s deadly 2018 crash car business driverless car program

Sponsored Stories
Powered by

Discover the Most This Watch Philippines: New Getting a Job in UK The cost of big data [Pics] This Is Why
Expensive Homes in surprises the whole WiFi Booster Stops may be easier than courses might We Don't See
Expensive Homes in surprises the whole WiFi Booster Stops may be easier than courses might We Don t See
Los Angeles country. The price? Expensive Internet you think surprise you Jessica Alba In
Mansion Global Ridiculous! (only Next Tech Jobs in UK | Sponsored Big Data Courses | Movies Anymore
$69) Listings Sponsored Listings CelebsPulse
News Gadget

Today on Ars

Feds seize OnePlus Buds, Private data gone public: 5G in rural areas bridges a Astra finally launches its
mistaking them for Razer leaks 100,000+ gap that 4G doesn’t, first orbital rocket, and it
“counterfeit” AirPods gamers’ personal info especially low- and mid- flew for 30 seconds
band

Oracle, one of Donald How the Warsaw Ghetto Nvidia buys ARM Holdings AI ruined chess. Now it’s
Trump’s favorite beat back typhus during from SoftBank for $40 making the game beautiful
companies, wins TikTok World War II billion [Updated] again
deal

STORE CONTACT US NEWSLETTER SIGNUP

SUBSCRIBE STAFF Join the Ars Orbital Transmission
ABOUT US ADVERTISE WITH US mailing list to get weekly updates
RSS FEEDS REPRINTS delivered to your inbox.
VIEW MOBILE SITE
SIGN ME UP →

CNMN Collection
WIRED Media Group
© 2020 Condé Nast. All rights reserved. Use of and/or registration on any portion of this site constitutes acceptance of our User
Agreement (updated 1/1/20) and Privacy Policy and Cookie Statement (updated 1/1/20) and Ars Technica Addendum (effective
8/21/2018). Ars may earn compensation on sales from links on this site. Read our affiliate link policy.
Your California Privacy Rights | Cookies Settings
The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written
permission of Condé Nast.
Ad Choices