Open Side Menu Go to the Top
Register
Brains vs. AI poker rematch coming to Rivers Casino Brains vs. AI poker rematch coming to Rivers Casino

01-07-2017 , 11:26 AM
Lol @ the 5-1 offers on bot
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 11:35 AM
Quote:
Originally Posted by Frankie Fuzz
Well...think about it like this: What edge would the humans need to have (in bb/100) to be a 5:1 favorite in a 120k sample given the standard deviation from the previous competition. Or if that STD is not publicly available, use typical HU NL STD with a loose, aggressive opponent.

Also, anyone making bets should specify whether "win" means to win money after 120k hands or to have a statistically significant win (as per scientific publishing standards). Last competition, humans only won by the former definition, so the organizers called it a draw.
If the definition of statistically significant win is something like 95% certainty that actual winrate is >0bb/100, doesn't that mean one needs a ridiculous winrate over that sample size to prove it? I mean almost any reasonably fathomable result (even results that ARE actual >0bb/100 winrates, but too small to fall over the 95% significanec!) over 120k hands is likely within the statistical margin of error, almost rendering the whole thing useless.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 11:41 AM
Quote:
Originally Posted by outfit
Anyone know if there is a time limit for how long the computer gets?
No but we have an agreed upon # of hands to play during an agreed upon number of hours so if it takes too long then reaching the desired sample size will not be possible, and that is important to CMU.

It plays instantly and stops to tank and recalculate its strategy at one point during the hand (I believe it's the river again, but just repeating what I was told). I was told that Claudico's avg tank time was 7 seconds and the new agent's avg tank time will be 12 seconds.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 02:31 PM
Quote:
Originally Posted by Clayton
how many buyins/big blinds must either side be positive after 120k hands for the results to be statistically significant?

i know this was a point of disagreement during the last challenge between polk and sandholm
bump
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 02:34 PM
Quote:
Originally Posted by Clayton
bump
it depends on the standard deviation...

Cannot be given ex ante.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 02:44 PM
the stdev of the match over 120k hands should be fairly easy to estimate, cant be that different from the previous match, huNL isnt that wide of a range
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 03:06 PM
Quote:
Originally Posted by Clayton
the stdev of the match over 120k hands should be fairly easy to estimate, cant be that different from the previous match, huNL isnt that wide of a range
stdev last time was 180 bb/100
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 03:07 PM
Quote:
Originally Posted by Frankie Fuzz
it depends on the standard deviation...

Cannot be given ex ante.
For obvious reasons, the "statistical significance" threshold should be determined before the match begins.

A less-than-perfect threshold announced before play commences is infinitely preferred to any threshold announced after the play ends.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 03:12 PM
^^ from the riverscasino site:

Quote:
Statistical significance
The winnings from each pair of mirrored hands are added together and considered to be one observation. If after 120,000 hands either Libratus or the humans are one standard deviation above break-even, they shall have won the competition with statistical significance.
Quote:
Originally Posted by ezdonkey
Same here. One of the major reasons why I'm on the human side is that the match takes place over 20 days. Team Brains has ability to share exploitative reads over the bot for every team member each night (and they're probably well incentivised to do so given the $200k freeroll) and adjust accordingly. However Team AI comes into the match with a fixed strategy, and the AI team will not be able to adjust AI during the course of the match because of lack of computing power.
Quote:
Libratus’s strategy is not based on the experience of expert human players, so its game play could differ markedly from the pros. It uses algorithms to analyze the rules of poker and set its own strategy, based on approximately 15 million core hours of computation at the Pittsburgh Supercomputing Center (PSC). Libratus will continuously sharpen its strategy during the Brains vs. AI competition, performing computations with the PSC’s Bridges computer each night while the pros get some shuteye. During games, Bridges will perform live computations to aid Libratus with its end-game play.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 04:08 PM
Quote:
Originally Posted by samooth
^^ from the riverscasino site:
So this is a much looser standard than would be required to publish in an academic journal, no? Last year I think they used the normal 95% confidence standard, which a lot of observers thought was too stringent (at least for the competition aspect of it).
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 05:41 PM
Someone mentioned Chad Powers playing, He's banned from the Rivers.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 06:29 PM
Quote:
Originally Posted by cheet
stdev last time was 180 bb/100
Is this big bets per 100 (as per PT/HEM), or big blinds per 100? Likewise, for your 9bb/100 win rate in the last competition, was that blinds or bets?
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 06:35 PM
Quote:
Originally Posted by Frankie Fuzz
Is this big bets per 100 (as per PT/HEM), or big blinds per 100? Likewise, for your 9bb/100 win rate in the last competition, was that blinds or bets?
big blinds

Quote:
Originally Posted by whosnext
For obvious reasons, the "statistical significance" threshold should be determined before the match begins.

A less-than-perfect threshold announced before play commences is infinitely preferred to any threshold announced after the play ends.
yep
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 06:40 PM
Quote:
Originally Posted by my_nameaintearl
Good video; especially, as I remember the Claudico battle as my introduction to "poker ambassador" Doug Polk.

Would have loved to have seen you serve as Coach to the human team for this contest, patrolling between the playing areas, carrying a clip board and wearing a "Bear Bryant" hat.

Hope the humans crush and embarrass the computer so badly that CMU can't reference a statistical tie again and starts blaming Russian hackers.

Last edited by restorativejustice; 01-07-2017 at 06:45 PM.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 06:50 PM
Quote:
Originally Posted by Frankie Fuzz
Is this big bets per 100 (as per PT/HEM), or big blinds per 100? Likewise, for your 9bb/100 win rate in the last competition, was that blinds or bets?
Big bets? What is this, 2007?
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 07:05 PM
Quote:
Originally Posted by Loctus
Big bets? What is this, 2007?
Haha...outed as a limit player.

Anyway, if the humans' true win rate is 9bb/100 (as per last competition) and STD is 180bb/100, they are over 95% likely to be ahead after 120k hands according to pokerdope.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-07-2017 , 07:08 PM
Quote:
Originally Posted by Sam Ganzfried
My prediction is that the humans will win, if for no reason other than this recent paper that shows that the exploitability of the best programs is significantly higher than always folding
Interestingly that paper seems to suggest that the way to exploit Carnegie Mellon bots is to play preflop and flop call or fold and wait for turn/river for the value bets/bluffs as the bot seems to be bad at estimating opponent ranges on last streets.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 12:08 AM
Quote:
Originally Posted by cheet
stdev last time was 180 bb/100
I have a few questions.

1. Is 180bb/100 std dev. normal for this stakes?
2. WCG mention that he employ a strategy where he would get to the river less often since the bot take longer to think. Was this strategy share by all 4 players or each 1 play a ddifferent strategy.
3. Did you guys try to be as close to GTO as you can while playing or just ttrying to exploit the bot?
4. If all 4 of you use similar strategy as WCG,
how much of this affect your winrate and std dev?
what do you think the std dev or true win rate should be?

5. Would you guys use similar strategy since this time tthere's more hand and longer tank time at the river by the bot but you get to multi ttable ?
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 01:17 AM
Is this match shown or streamed anywhere this time?
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 01:31 AM
Quote:
Originally Posted by Mr.Diamond
I have a few questions.

1. Is 180bb/100 std dev. normal for this stakes?
200bb deep 180bb/100 std dev sounds pretty normal.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 02:05 AM
what does 180bb/100 standard dev. mean exactly?
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 02:35 AM
they are idiots that dont understsand or just dont care. doing these challenges will make unbeatable bots sooner. and thats not what we want. they are so bad for poker and will be remembered as that.
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 03:42 AM
if anyone wants ill take computer at 1:4.15 upto 5k

My 1k to your 4.15k

can escrow to whoever
Brains vs. AI poker rematch coming to Rivers Casino Quote
01-08-2017 , 06:36 AM
is it gonna be 200 deep again?
Brains vs. AI poker rematch coming to Rivers Casino Quote

      
m