AI Poker

U of Alberta’s DeepStack Bot Tops Pros in HUNL Poker Contest

Score another victory for artificial intelligence in the game of poker, after the publication in Science Journal of a convincing win for a University of Alberta AI in a series of heads-up no-limit (HUNL) poker matches against 11 different top HUNL players.  The program, which would generally be described as a “bot” in online-poker lingo, scored mathematically significant victories over 10 of the 11 human foes it faced, while reaching a virtual draw with the 11th player.

The program, called DeepStack, comes from the same team of U of Alberta researchers who made news back in 2015 with a program called Cepheus.  Back then, the researchers from the school’s Computer Poker Research Group declared one of the simpliest forms of poker — heads-up fixed-limit Texas hold’em — as being “essentially solved” by the Cepheus code.

In the series of matchups, which were conducted back in December, Deepstack was pitted against 33 different HUNL pros who were.  The 33 players were from 17 different countries and were recruited for the project via the International Federation of Poker.  Cash prizes of up to $10,000 were offered to the top three human finishers as an incentive for participation.

Each of the players was asked to play 3,000 hands each against the bot.  Of the 33 pros, 11 played out the full 3,000 hands, thus producing the statistically significant results.  The DeepStack program played an additional 14,000-plus hands against another 22 players, resulting in a total of  44,852 hands played.  The sample size against the other 22 players was too small for reliable individual analysis, but collectively was in line with the other results.

Those breakthroughs by Cepheus and an earlier U of Alberta bot, Polaris, formalized knowledge that’s been well known in the online-poker world for years:  Unfortunately, a well-programmed bot is already more than capable of holding its own against typical players in a limit hold’em format, and in a few years, will likely be capable of the same in many no-limit variants as well.

The win by DeepStack, though, represents a “paradigm shift,” according to its creators, because it’s a demonstration of excellence at no-limit rather than fixed-limit poker.  While it’s true that full-table solutions for no-limit hold’em represent yet another layer of complexity that poker AIs have yet to master, the betting line is that it’s only a matter of time.  The win by DeepStack also follows a similar newsmaking result involving poker AI.  Just a few weeks ago, a program called Libratus topped four professional HUNL players with relative ease.

DeepStack’s success come from additional breakthroughs in adapting to situations involving imperfect information, the crux of poker’s challenge.  According to Michael Bowling, lead writer for the U of A team’s publication, “A common feature of [most] games is that players have perfect information. Poker is the quintessential game of imperfect information, and a longstanding challenge problem in artificial intelligence.”

“DeepStack represents a paradigm shift in approximating solutions to large, sequential imperfect information games,” Bowling added.  “With many real world problems involving information asymmetry, DeepStack also has implications for seeing powerful AI applied more in settings that do not fit the perfect information assumption.”

DeepStack solution tree

A graphical representation of DeepStack’s solution tree.

 

 

 

 

 

The 33 players who participated in the study and played against DeepStack included Juergen Bachman, Alexander Bös, Pol Dmit, Eyal Eshkar, Gaia Freire, Fintan Gavin, Sergey Indonek, Jefri Islam, Phil Laak, Dmitry Lesnoy, Luca Moschitta, Igor Naumenko, Dara O’Kearney, Antonio Parlavecchio, Juan Manuel Pastor, Mike Phan, Silvio Pizzarello, Youwei Qin, Victor Santos, Lucas Schaumann, Sebastian Schwab, Muskan Sethi, Ivan Shabalin, Roman Shaposhnikov, Prakshat Shrimankar, Martin Sturc, Fan Sun, Kaishi Sun, Tsuneaki Takeda, Giedrius Talaka, Stas Tishekvich, Stanislav Voloshin, and Shai Zurr.

Of those, Martin Sturc was the pro who played the full 3,000 hands against DeepStack, presumably winning the $10,000 top prize.

COMMENTS

Leave a Comment

*

LATEST NEWS

filter by

Haley Hintze

16th June 2019 // Industry, Misc, News, Online Poker Action

PartyPoker Announces More Bot Seizures in May

Partypoker has announced the latest results in its continuing effort to combat poker bots, the computerized software...

Haley Hintze

15th June 2019 // Industry, Legal News, Misc, News

UKGC Hits Platinum Gaming and Gamesys With Hefty Social-Responsibility Failure Fines

The United Kingdom Gambling Commission (UKGC) is back in the news this week with the latest in a long-running series of...

Dan Katz

14th June 2019 // Gossip, News, Poker Tournaments

Maria Ho Involved in Minor Hand Controversy at WSOP After Misunderstanding

Last week, we discussed a controversial hand at the end of a World Series of Poker final table that had poker pros and...

Dan Katz

14th June 2019 // Industry, Legal News, News

DoJ Extends Wire Act Compliance Deadline Through End of Year

It seems that interstate online poker in the United States is safe for at least the rest of the year, as a new memo...

Haley Hintze

13th June 2019 // Industry, Misc, News

Boyaa Poker Tour Resurfaces, Moves Live Events Outside Chinese Jurisdiction

Here’s an interesting little tale from China, where poker remains not exactly The Next Big Thing™. Hong...

Haley Hintze

11th June 2019 // Industry, Misc, News, Online Poker Action

Publisher of Hold’em Manager HUD Bashes partypoker Over Upcoming Software Changes

The parent company of Hold’em Manager and several other third-party software programs, Max Value Software LLC...