There have been several bot vs bot competitions in the past. There used to be something called the
Annual Computer Poker Competition, but it stopped running back in 2018.
The problem is that most adaptive poker bots - those able to adapt to any bet size and respond quickly - aren't public. So this makes it hard to find sparring partners. One of the few publically available bots is called
SlumBot - this was the champion of the most recent ACPC. So most researchers use this as a benchmark to test their own privately developed bots.
We even used Slumbot to benchmark GTO Wizard AI
Here are the results of various poker bots vs Slumbot:
I think one of the Slumbot's biggest weaknesses is that it's bad at responding to sizes outside of its abstraction. Internally, it has a plan for specific bet and raise sizes. Then if it encounters something between those preset sizes, it basically just looks at the two nearest sizes and makes a weak guess as to what the new strategy should be. But that's just my uninformed guess lol.
----
GTO Wizard ran this 150k battle twice and were surprised to find that a dynamic 1-sizing strategy outperformed a more complex 6-size strategy.
Theoretically, a complex strategy should outperform a simple strategy, but the time constraints (7s per move) meant that a the simpler approach could reach higher accuracy.
GTO Wizard AI vs Slumbot - Complex Strategy
Win rate: 13.1 ± 4.2 bb/100
GTO Wizard AI vs Slumbot - Dynamic 1-Size Strategy
Win rate: 19.4 ± 4.1 bb/100
If you'd like to see a deepdive - Kevin Rabichow explored the match in this RIO video:
https://www.runitonce.com/poker-trai...se-vs-slumbot/
Last edited by tombos21; 05-03-2024 at 02:51 AM.