Lessons from Toyota: Has software become too complex?

By John Dodge | Mar 10, 2010 |

As Toyota vehicles continue to experience so-called unintended acceleration and the electronics become increasingly suspect, think about this: the typical luxury automobile has 100 million lines of software code.

That’s expected to double and triple in the not-too-distant future.

That’s according to Spectrum magazine published by the Institute of Electrical and Electronics Engineers better known as the IEEE (I triple E). And it’s virtually impossible to weed out all the bugs out of that much software.

Those lines of code drive an estimated 50-100 electronic control units found in today’s automobiles. Compare that to modern day airplanes: an F-22 Raptor has a mere 1.7 million lines; F-35 Joint Strike Fighter will have 5.7 million lines and the Boeing 787 Dreamliner a mere 6.5 million lines, Spectrum reports.

Why does a car have so much more software? Because software development for airplanes is far more rigorous with more compact software systems kept separated depending on the levels of criticality. After all, you don’t want unintended acceleration in a Boeing 787.

A passage in the Spectrum article captures the plane/car software conundrum.

“Unlike most commercial aircraft, which have strict firewalls between critical avionic systems and the in-flight entertainment systems, there is more commingling of information between the electronic systems used to operate the car and those for entertaining the driver and passengers. According to a Wharton Business School article entitled ”Car Trouble: Should We Recall the U.S. Auto Industry?,” a few years ago, some Mercedes drivers found that their seats moved if they pushed a certain button; the problem was that the button was supposed to operate the navigation system.”

Could Toyotas experience unintended accelerator when the operator turns up the volume on the radio? This is absurd, of course, but the point is there’s virtually no way to ferret out all the bugs out of the infinite number of combinations, branches and behaviors that is 100 million lines of co-mingled software (or should I say co-mangled?).

“There’s little software that is mathematically proven to be perfect. If you gave me a software system, I would never say it’s bug free. There’s always room for human error. Ruling out bugs is arguably is one hardest possible claims to make,” says Coverity Inc. chief scientist and co-founder Andy Chou. Coverity analyzes software to weed out defects and vulnerabilities.

The upshot is that software behaves in unintended ways especially when there’s more of it. “As the number of lines of code increase, it becomes harder to test it exhaustively. As it branches out, the more possibilities there are for the unexpected behaviors,” says Chou.

We tend of think of integration as a highly efficient method to increase performance and functionality. Just look at everything a cell phone does. But the truth is co-mingling software creates serious problems, too.  “You can have two systems that are well tested, but when you connect them, there is more variance. That leaves lots of possibilities for unexpected behaviors,” Chou explains.

Could such unexpected behaviors be causing crashes like the the latest reported runaway Toyota? A Prius unexpectedly lurched into a stone wall yesterday in Harrison, N.Y. That’s a good question, but aren’t software bugs really a metaphor for human error. Indeed they are and as such, driver error can’t be ruled out either.

The fact is Toyota isn’t telling us precisely what caused each one of these accidents so we are left to speculate about the electronics and the software that tells them what to do. Whether software is blame or not,  Toyota and other auto recalls have inadvertently raised a critical question: is software complexity out of control and what toll will its inherent bugginess exact when millions of lines turn into billions.

“This complexity is real problem and goes way beyond autos. It lives in every sector,” says Coverity chief marketing and product officer Dave Peterson.

Previously on SmartPlanet:

Follow me on Twitter.

 

Smartplanet TalkbackShare your ideas and expertise on this topic

The following tags are supported in Smartplanet comments:
<b></b> <i></i> <u></u> <pre></pre>

Leave a Reply

  1. Name: You are currently: a Guest |
advertisement
advertisement

Quick Poll

advertisement
Click Here
advertisement

Deborah Gage

Contributing Editor, Technology

I've been a journalist for nearly 20 years, not counting the high school and college newspapers I edited, and I keep doing it because I love the work. Most of my time has been spent covering business and technology out of Silicon Valley -- most recently for the San Francisco Chronicle -- but I've also covered politics for Minnesota Public Radio and worked for magazines, Web sites and other newspapers.

My work has won over a dozen national awards over the years, including the Neal Award and Grand Neal. The story I'm most proud of was an investigation for Baseline magazine of American-made software that was exported to Panama and malfunctioned, which caused 28 patients at Panama's National Cancer Institute to be overdosed with radiation. The hospital assumed the workers who operated the machine were responsible, and they were charged with second-degree murder. Their case was ongoing the last time I checked.

I do have a family, which includes five cats, and I ride road bikes and practice Yoga so I remember to get out of my desk chair and away from my computer once in awhile.

She writes for SmartPlanet and is not an employee of CBS.

Follow her on Twitter.

Deborah Gage

I pride myself on being an independent journalist. My reporting and writing are not influenced by any financial holdings, and I have no business affiliations with companies other than the publishers I write for as a journalist.

She writes for SmartPlanet and is not an employee of CBS.

Dan Nosowitz

Contributing Editor, Technology

Dan Nosowitz is based in San Francisco, where he covers Silicon Valley, consumer electronics, green tech and the influence of technology on our daily lives. Formerly a contributing editor at Gizmodo, he is also a correspondent for Fast Company and founder and editorial director of Oh Em Gee., a pop culture criticism collective based in Montreal.

A native of Philadelphia, Nosowitz has an undergraduate degree in English literature from McGill University in Montreal. He spends most of his time on a pink leatherette loveseat in his San Francisco sunroom.

He writes for SmartPlanet and is not an employee of CBS.

Follow him on Twitter.

Dan Nosowitz

Dan Nosowitz does not hold any investments in the technology companies he covers.

He writes for SmartPlanet and is not an employee of CBS.

The Thinking Tech blog focuses on technologies such as virtualization, smart electric grids, enterprise 2.0, open source, data center management, green technology and the intersection between the innovation and application of these advancements.