Ken Jennings at Slate:
When I was selected as one of the two human players to be pitted against IBM’s “Watson” supercomputer in a special man-vs.-machine Jeopardy! exhibition match, I felt honored, even heroic. I envisioned myself as the Great Carbon-Based Hope against a new generation of thinking machines—which, if Hollywood is to believed, will inevitably run amok, build unstoppable robot shells, and destroy us all. But at IBM’s Thomas J. Watson Research Lab, an Eero Saarinen-designed fortress in the snowy wilds of New York’s Westchester County, where the shows taped last month, I wasn’t the hero at all. I was the villain.
This was to be an away game for humanity, I realized as I walked onto the slightly-smaller-than-regulation Jeopardy! set that had been mocked up in the building’s main auditorium. In the middle of the floor was a huge image of Watson’s on-camera avatar, a glowing blue ball crisscrossed by “threads” of thought—42 threads, to be precise, an in-joke for Douglas Adams fans. The stands were full of hopeful IBM programmers and executives, whispering excitedly and pumping their fists every time their digital darling nailed a question. A Watson loss would be invigorating for Luddites and computer-phobes everywhere, but bad news for IBM shareholders.
The IBM team had every reason to be hopeful. Watson seems to represent a giant leap forward in the field of natural-language processing—the ability to understand and respond to everyday English, the way Ask Jeeves did (with uneven results) in the dot-com boom. Jeopardy! clues cover an open domain of human knowledge—every subject imaginable—and are full of booby traps for computers: puns, slang, wordplay, oblique allusions. But in just a few years, Watson has learned—yes, it learns—to deal with some of the myriad complexities of English. When it sees the word “Blondie,” it’s very good at figuring out whether Jeopardy! means the cookie, the comic strip, or the new-wave band.
I expected Watson’s bag of cognitive tricks to be fairly shallow, but I felt an uneasy sense of familiarity as its programmers briefed us before the big match: The computer’s techniques for unraveling Jeopardy! clues sounded just like mine. That machine zeroes in on key words in a clue, then combs its memory (in Watson’s case, a 15-terabyte data bank of human knowledge) for clusters of associations with those words. It rigorously checks the top hits against all the contextual information it can muster: the category name; the kind of answer being sought; the time, place, and gender hinted at in the clue; and so on. And when it feels “sure” enough, it decides to buzz. This is all an instant, intuitive process for a human Jeopardy! player, but I felt convinced that under the hood my brain was doing more or less the same thing.
Indeed, playing against Watson turned out to be a lot like any other Jeopardy! game, though out of the corner of my eye I could see that the middle player had a plasma screen for a face. Watson has lots in common with a top-ranked human Jeopardy! player: It’s very smart, very fast, speaks in an uneven monotone, and has never known the touch of a woman. But unlike us, Watson cannot be intimidated. It never gets cocky or discouraged. It plays its game coldly, implacably, always offering a perfectly timed buzz when it’s confident about an answer. Jeopardy! devotees know that buzzer skill is crucial—games between humans are more often won by the fastest thumb than the fastest brain. This advantage is only magnified when one of the “thumbs” is an electromagnetic solenoid trigged by a microsecond-precise jolt of current. I knew it would take some lucky breaks to keep up with the computer, since it couldn’t be beaten on speed.
DID THE SINGULARITY just happen on Jeopardy? The Singularity is a process, more than an event, even if, from a long-term historical perspective, it may look like an event. (Kind of like the invention of agriculture looks to us now). So, yeah. “In the CNN story one of the machine’s creators admitted that he was a very poor Jeopardy player. Somehow he was able to make a machine that could do better than himself in that contest. The creators aren’t even able to follow the reasoning of the computer. The system is showing emergent complexity.”
I’m not a big Jeopardy geek, but my understanding is that players are surprised at how big a role button management plays in winning or losing a round. In the few minutes of the Watson game that I watched, it was pretty clear that Watson was excellent at pressing the button at exactly the right moment if it knew the answer, which is more a measure of electromechanical reflex than human-like intelligence.
To the credit of IBM engineers, Watson almost always did know the right answer. Still, there were a few bloopers, such as the final Jeopardy question from yesterday (paraphrasing): “This city has two airports, one named after a World War II hero, and the other named after a World War II battle.” Watson’s guess, “Toronto”, was just laughably bad—Lester Pearson and Billy Bishop fought in World War I, and neither person is a battle. The right answer, “Chicago”, was pretty obvious, but apparently Watson couldn’t connect Midway or O’Hare with WW II.
Mark Krikorian at The Corner:
I was on the show, in 1996 or ’97, and success is based almost entirely on your reflexes — i.e., pushing the buzzer as soon as Trebek finishes reading the question, er, the answer. (I came in second, winning a dining-room set and other fabulous parting gifts, which I had to sell to pay the taxes on them.)The benefit to society would come if we could turn Alex Trebek into Captain Dunsel.
Jim Behrle at The Awl:
If I owned a gun, it would probably be in my mouth as I type this. I don’t know how the physics of that arrangement would work, but the mood in Chez Jim is darker than Mothra’s hairy crotch. I’ve just been sitting here listening to Weird Al’s weirdly prescient “I Lost on Jeopardy” in the dark, cuddling with a tapped-out bottle of WD-40. Humanity took a hit tonight. Our valiant human heroes made it close, but that Watson tore us new assholes in our foreheads. ALL OF US. That noise you heard driving to work was your GPS system laughing at you. While you were sneezing on the D train this morning your Kindle was giving you the finger. There is blood in the water this morning and this afternoon and forever more. This wasn’t like losing some Nerdgame like chess. Who the hell even knows how to play chess? The horsies go in little circles, right? “Jeopardy!” is the game that makes dumb people feel smart. Like National Public Radio, it’s designed to make people feel superior. And we just found out that people are not superior. No, not at all.I might personally call the whole thing a draw. I read Ken Jennings’ piece in Slate and I can tell the machine was just better at ringing the buzzer than him. If it was truly a battle of Humanity versus Accursed Frankensteinian Monstrosity there should have been one human and one monstrosity. Or one smart human, one machine and me. I could answer sportsy questions. And the rest of the time stay out of Ken’s way. No disrespect to Brad, but this is one fight that ought to have been fought one-on-one. Don’t make humans battle each other to save the world from machines. It’s too cruel. I’d sit back and let the goddamned human expert answer the tough questions. I’d just be there to figure out a way how to unplug the fucking thing when no one was watching. So, here’s the lineup for this Rematch that I demand, formally, right here on The Awl—which I know everyone at IBM reads—Me, Ken and your little Betamax.
And you have to put a little more at stake than just money. For Ken, Me and the Watson. Why did they call it Watson, anyway? Wasn’t Watson just Sherlock Holmes’ butler? And Alexander Graham Bell’s friend who was in the other room and got the first phone call. Why not call the thing what it is: HYDE. Or LILITH. Or Beezelbub of the Underland? Its dark, soulless visage no doubt crushed the very spirit of our human champions. Maybe force it to wear a blonde wig. And talk in Valley Girl language. “Like Oh My God, Gag Me with a Spoon, Alex. I’ll like take like Potpourri for like $800!”
This rematch should happen on Neutral Ground. I suggest Indianapolis. Halftime at the next Super Bowl. This gives Ken a chance to put the pieces of his broken ego back together. And for me to eat some Twinkies. There probably won’t even Be a Super Bowl because of the Looming Lockout, so America will just be watching commercials and various superstars mangling America’s Favorite Patriotic songs. Make IBM take their little Cabinet of Wonders on the Road. Get the military involved to make sure there are no shenanigans this time like plugging it into the Internet or texting it answers from the audience. Also, I want the damned thing to NOT be plugged into the Jeopardy game. It needs to be able to hear Alex and to read the hint on the little blue screen. How much time does it take a human to hear Alex and see it printed out and understand just what the hell the half-idiot writers of “Jeopardy!” were getting at? (Was a Dave Eggers mention really necessary during Wednesday night’s episode? The category was Non-fiction. And it’s obvious that Watson has some kind of super Amazon app embedded in its evil systems. The first 200 pages of Dave’s Heartbreaking Work of Staggering Genius were pretty good. Everything else is Twee Bullshit. “I am a dog from a short story. I am fast and strong. Too bad you know I die in the river from the title of this short story. Woooof!” I mean, seriously, “Jeopardy!” Get a library card. There are billions of other writers and I’ve seen at least 5 shows in which you’ve used some form of Dave Eggers. )
Ben Wieder at The Chronicle Of Higher Education:
The victory made one group of people very happy.
The computer-science department at the University of Texas at Austin hosted viewing parties for the first two nights of the competition.
“People were cheering for Watson,” says Ken Barker, a research scientist at Texas. “When they introduced Brad and Ken, there were a few boos in the audience.”
Texas is one of eight universities whose researchers helped develop the technology on which Watson is based. Many of the other universities hosted viewing parties for the three days of competition as well.
Mr. Barker says he was blown away by Watson’s performance on the show, particularly the computer’s ability to make sense of Jeopardy!‘s cleverly worded clues.
But the computer did make a few mistakes along the way.
Most notably, Watson incorrectly wrote “Toronto” in response to a Final Jeopardy clue in the category of U.S. Cities. Both Mr. Jennings and Mr. Rutter returned the correct response, which was Chicago.
Mr. Barker says Watson may have considered U.S. to be a synonym of America and, as such, considered Toronto, a North American city, to be a suitable response.
Raymond J. Mooney, a computer-science professor at Texas, says Final Jeopardy is the Achilles heel of the computer.
“If it didn’t have to answer that question, it wouldn’t have,” he says.
Clues in that final round are often more complicated than others in the show because they involve multiple parts.
The phrasing of the question Watson got wrong included what linguists refer to as an ellipsis, an omitted phrase whose meaning is implicit from other parts of the sentence. The clue that tripped up Watson, “Its largest airport is named for a World War II hero; its second largest, for a World War II battle,” left out “airport is named” in the second clause.
Mr. Mooney says it will be some time before the average person will be using a computer with the capabilities of Watson, but he did see one potential immediate impact from the show.
The sentient computers of the future are going to think it pretty hilarious that a knowledge-based showdown between one of their own and a creature with a liver was ever considered a fair fight.
Around The Sphere 