On July 29, 1997, IBM researchers were awarded a $100,000 prize that had gone unclaimed for 17 years. It was the Fredkin Prize, created by Carnegie Mellon University (CMU) professor Edward Fredkin in 1980. An artificial intelligence pioneer, Fredkin challenged fellow computer scientists to create a computer that could beat the best human chess player in the world. That's exactly what Deep Blue did in May, 1997.
It was an extremely long road to victory. After Fredkin's initial challenge in 1980, a team from Bell Labs created a chess computer in 1981 that beat a chess master. In 1985, Feng-hsiung Hsu created ChipTest, a chess computer that set the stage for later efforts.
By 1988, a CMU team including Hsu created a system that beat an international master. That one was called "Deep Thought," named for the computer in The Hitchhiker's Guide to the Galaxy—a fictional computer spent 7.5 million years calculated "the Answer to The Ultimate Question of Life, the Universe, and Everything." (That answer, of course, was 42.)
Deep Thought underwent additional development at IBM, and in 1989 it went head-to-head with Garry Kasparov, who is widely considered the best chess player of all time. Kasparov destroyed the machine in a two-game match. Here's the first part of a documentary about Deep Thought, which helps set the stage for Deep Blue:
Deep Thought eventually led to Deep Blue, an IBM project led by Hsu, along with his former Deep Thought collaborator Murray Campbell, among others.
The computer science problem of chess is deep. First the machine needs to understand the state of the board—that's relatively easy—but then it needs to predict future moves. Given that the 32 pieces on the board are capable of moving to a variety of other positions, the "possibility space" for the next move (and all subsequent moves) is very large.
In theory, a sufficiently beefy computer could simulate every possible move (and counter-move) in its memory, rank which moves end up doing best in each simulated game, and then perform the optimal move on each turn. But to actually implement a computer that powerful—and fast enough to compete in a time-limited tournament—was a matter of extreme effort. It took Hsu more than a decade to master it.
On February 10, 1996 in Philadelphia, Deep Blue went head-to-head with Kasparov, and Kasparov beat the computer handily. Though Deep Blue scored one winning game and two draws, it lost three games to Kasparov outright. Deep Blue did set a record for winning that one game, but it needed the match to earn the Fredkin Prize.
By this point, Kasparov was used to destroying chess computers, and the media lapped it up—this was a man-versus-machine story for the ages. By May 1997, IBM had heavily upgraded Deep Blue (some called it "Deeper Blue") with vastly improved computing resources, preparing for a rematch. When that rematch came, Kasparov would face a worthy opponent.
On May 11, 1997 in New York City, the upgraded Deep Blue entered the match with a large, excited audience. Kasparov won the first game, but Deep Blue took the second, tying the players. Then came three games that ended in draws. In the sixth game, Kasparov made a mistake in the opening. Deep Blue won that sixth game quickly, winning the match, much to the astonishment of the crowd. Kasparov asked for a rematch. The Deep Blue team declined.
Kasparov claimed to have perceived a human hand in Deep Blue's play. Kasparov wondered whether a human chess player was somehow feeding the computer moves, much like the infamous Mechanical Turk of yore. Various conspiracy theories flourished, but came to nothing.
When the Fredkin Prize was awarded to Hsu, Campbell, and IBM researcher A. Joseph Hoane Jr., Fredkin told reporters, "There has never been any doubt in my mind that a computer would ultimately beat a reigning world chess champion. The question has always been when." Hsu told The New York Times, "Some people are apprehensive about what the future can bring. But it's important to remember that a computer is a tool. The fact that a computer won is not a bad thing."