The Perfect Poker Bot Is Almost Here
The Baby Tartanian 8 could be to closest developers have come to creating the perfect no-limit hold'em heads-up poker bot after it won the latest edition of the Annual Computer Poker Competition in the Total Bankroll category and placed third in the Bankroll Instant Run-Off category.
Eleven teams competed for the title of best poker bot with the Carnegie Mellon University's Baby Tartanian 8 being awarded that honor by the Association for the Advancement of Artificial Intelligence.
Noam Brown, a Ph.D. student at the School of Computer Science, designed Tartanian 8 alongside his adviser, Tuomas Sandholm, a professor in the Computer Science Department, specifically for the challenge of being able to play a strategy with the best results while using limited information.
Tartanian 8 was developed as a successor to Tartanian 7 using the Comet supercomputer at the San Diego Supercomputer Center, and was built from scratch to help increase the speed that it processed algorithms, but had to be scaled down due to restrictions on the participants. Thus, Baby Tartanian 8 was born.
"The algorithm is not specific to poker," explained Brown. "It should be generally applicable to any strategic interaction where you have multiple agents and asymmetric information."
Asymmetric information is where one person has information that the other person does not, such as your own hole cards in poker, or, to use a non-poker example, negotiation situations.
One major change to this latest poker bot was what Brown described as "pruning," which minimized the number of options that would be investigated while at the same time ensuring that the algorithm arrived at the optimal strategy.
"In a game like poker, where you have a lot of actions available to you, pruning helps cut down to actions that are worth investigating according to a given situation, instead of considering all the actions available to you," said Brown.
The Baby Tartanian poker bot was developed after the competition of the Brains vs Artificial Intelligence exhibition that ran from April 24 through to May 8, 2015. During this time, the Claudico bot took on poker pros Bjorn Li, Doug Polk, Dong Kim, and Jason Les over 80,000 hands. The humans finished the challenge $732,713 ahead (Li won $529,033, Polk $213,671, Kim $70,491, and Les lost $80,842), which seems like a wide margin, but more than $170 million was wagered during the challenge, meaning the humans' profit represented less than 0.5 percent of the total money wagered, which statistically made the challenge a tie.
Feedback from the four pros enabled Brown to make alterations to his new bot, changes he's continuing to make with the hope of one day being able to see his machine come out on top against the best poker players in the world.
"The ultimate goal in this line of research is to eventually beat the top humans," he said. "Hopefully, in the next 2-3 years, we will be able to accomplish that."
2016 10th Annual Computer Poker Competition Results
Duplicate Poker was used to determine the winner of this year's Annual Computer Poker Competition, around 15 million hands of it, in an attempt to remove much of the luck element. Duplicate Poker is a variant of poker based on the principles of duplicate bridge where players play poker with a pre-set deck.
In a heads-up scenario, Bot A and Bot B would play their match and then replay each other with Bot B receiving the cards that Bot A was dealt in round one and vice versa.
Baby Tartanian 8 lost by a narrow yet statistically significant margin (95 percent) to "Slumbot," narrowly overcoming "Act 1" by a non-statistically significant margin and completed annihilated the other nine AIs.
Across all the categories, the crosstable results were as follows:
| Poker Bot | Average |
|---|---|
| Baby Tartanian 8 | 394.44 ± 9.35 |
| Slumbot | 341.04 ± 10.68 |
| Act1 | 314.29 ± 12.14 |
| Nyx TBR | 312.61 ± 13.38 |
| Nyx IRO | 308.68 ± 10.81 |
| Hugh | 90.51 ± 14.35 |
| Rembrant5 | 18.09 ± 12.88 |
| Poker-CNN | 5.24 ± 18.03 |
| HITCZ | -355.23 ± 11.08 |
| Proteus | -572.54 ± 8.43 |
| KEmpfer | -750.00 ± 0.00 |
PokerNews has reached out to the developer of Baby Tartanian 8 and hopes to have an interview with him about his incredible AI, bots in the online poker world and more.
Image courtesy of captainmack.deviantart.com
Get all the latest PokerNews updates on your social media outlets. Follow us on Twitter and find us both Facebook and Google+!
