Follow this blog:
RSS

IBM Watson supercomputer beats humans in practice round

By | January 13, 2011, 9:16 AM PST

YORKTOWN HEIGHTS, N.Y. — IBM’s Watson supercomputer won a practice round against Jeopardy champions Ken Jennings and Brad Rutter and raised a lot of questions about the capabilities of artificial intelligence.

Watson, a four-year effort by IBM, was quicker on the draw, didn’t fall prey to emotion and had a voice that could be confused for wayward computer Hal 9000 from the movie 2001: A Space Odyssey. For IBM, Watson is about tackling verticals and bringing hardware and analytics to the fore.

As one of the dozens of humans watching this practice round, I can’t deny I was a bit squeamish about seeing a supercomputer wing it, adapt and show off its artificial intelligence.

Is this thing going to be Skynet? That’s a bit farfetched—today IBM is thinking health care will make the most use of Watson—but a supercomputer that has self-awareness and can learn gives this human pause. David Ferrucci, principal investigator of Watson DeepQA technology, said Watson can conduct self-assessments and learn.

Naturally Ferrucci was asked about whether Watson had the risk of Hal 9000. “That’s science fiction,” Ferrucci said. “We’re not even close to that.” Ferrucci did say that Watson is more like the computer on Star Trek than Hal.

Here’s a look at the practice rounds, taken with my smartphone from the audience:

When the duel was finished, Watson won the round with $4,400, Jennings had $3,400 with Rutter bringing in $1,200.

IBM execs, Jeopardy host Alex Trebek, Rutter and Jennings fielded questions after the round.

Among the highlights:

  • The Jeopardy questions hit Watson’s chips as soon as the human retinas get the data. To take away any advantage, Watson has a mechanism to hit a signaling device, said Trebek.
  • It was odd watching a supercomputer playing a category called “chicks dig me”
  • The Jeopardy champs had more concerns about Watson coming back from the future and harming them. Skynet quips were plentiful.
  • Watson cannot be psyched out, which is a problem for human players. Jennings and Rutter said that it’s a disadvantage to play a computer that has no emotions. Both Jeopardy champs said they were able to psych out rivals during their win streaks.
  • Rutter said Watson can be a bit overwhelming. Jennings and Rutter quipped about how computer capabilities are part of human advancement, but acknowledged that they were a bit uncomfortable. Jennings said he “didn’t want technology to advance that far just yet.” When John Kelly III, director of IBM Research reminded Jennings and Rutter that computer and human intelligence were at an intersection point and computing would only improve, Rutter quipped: “So we’re all extinct.”
  • I asked Rutter what it was like playing against Watson. “I’m impressed with Watson and its speed,” he said. “But after 10 or 15 questions Watson is just another good player. I have every confidence that we’ll do well.”
  • If Rutter had Watson to help as a singularity tool, the Jeopardy champ said he’d most likely to be able to better assess risks for Double Jeopardy. “Watson’s biggest advantage has algorithms that can make bets instantly,” said Rutter. “If I had Watson’s algorithm I could make bets and assess risk.”
  • What’s Watson’s biggest weakness? Rutter said Watson’s ability to understand human language and get the quips inserted by writers. “They tell me Watson can get jokes and have fun,” said Rutter.

Start your week smarter with our weekly e-mail newsletter. It's your cheat sheet for good ideas. Get it.

Larry Dignan

About Larry Dignan

Larry Dignan is the editor-in-chief of SmartPlanet.

Larry Dignan

Larry Dignan

Editor-in-Chief

Larry Dignan is editor-in-chief of SmartPlanet and ZDNet. He is also editorial director of TechRepublic. Previously, he was an editor at eWeek, Baseline and CNET News. He has written for WallStreetWeek.com, Inter@ctive Week, New York Times and Financial Planning. He holds degrees from the Columbia University Graduate School of Journalism and the University of Delaware. He is based in New York but resides in Pennsylvania.

Follow him on Twitter.

Larry Dignan

Larry Dignan
Larry Dignan does not hold any investments in the companies he covers.
If you liked this, don't miss...
5
Comments

Join the conversation!

Follow via:
RSS
0 Votes
+ -
RE: IBM Watson supercomputer beats humans in practice round
I find this most interesting. I believe the answer is NO but I can't help asking if Watson ever missed a question. My comments
1. The fact that humans deal with emotions and watson does not makes human brains a more complext "machine" than Watson. While it may give watson and advantage is such a game - it doesn't help it in daily living.
2. Watson is given a mechanism to hit a signalling device. So do humans - its called their thumb. Watson must wait for the verbal question to end before hitting device but may still access answer quicker than the human brain.
3. Again - human brains are more complex than Watson because they also control the muscle movements to hit the signalling button. Watson does not have that. The brain must deal with heart and eye/ear signals and breathing and....... while at the same time; send message to the mouth and get vocal chords working to say the question.

A computer may be faster but it is only because it is doing less than the human brain.
Posted by llandau@...
14th Jan 2011
0 Votes
+ -
RE: IBM Watson supercomputer beats humans in practice round
They just have to word the questions cleverly enough. Then the humans would easily win. Examples:
* "It's the capital of California." (computer wins)
* "It's the city where the legislature meets for the state with the bridge shown here. [picture of Golden Gate Bridge]" (human wins)

Also, the contest is rigged in the computer's favor because the humans are both Jeopardy superchampions, so they are splitting the human-friendly questions fairly evenly. Either superchampion would win if he were pitted against the computer one-on-one.
Posted by dmm99
14th Jan 2011
0 Votes
+ -
Turing Test
Can Watson pass the Turing Test? Turing proposed a test to see if a computer can pretend to be human by a simple conversation between a human and the computer, if the human can not determine if he is talking to another human or a computer then the test is considered successful.

One of the more difficult problems with computers is to get it to have initiative. Living things have more complex behaviours because of biological initiatives for survival; computers pretty much just follow its programs and get stuck if a situation is outside its programming.
Posted by sboverie
14th Jan 2011
0 Votes
+ -
RE: IBM Watson supercomputer beats humans in practice round
I always knew somewhere, that one day, ''Windows" would become self aware ... wink
Posted by jeanruss
14th Jan 2011
0 Votes
+ -
RE: IBM Watson supercomputer beats humans in practice round
Computer-analytics running in smartphones should surpass Human-analytics by many many times - just a question of time. We need to hope it will be used for the good only.
Posted by mama0001
14th Jan 2011
Join the conversation
Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

Join the SmartPlanet community and join the conversation! Signing up is fast and free. Don't wait -- we want to hear your opinion!