Two Plus Two Publishing LLC Two Plus Two Publishing LLC
 

Go Back   Two Plus Two Poker Forums > General Poker Discussion > Poker Theory

Notices

Poker Theory General poker theory

Reply
 
Thread Tools Display Modes
Old 08-07-2012, 08:54 PM   #166
grinder
 
Jerrod Ankenman's Avatar
 
Join Date: Jun 2004
Location: Avon, CT
Posts: 604
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Nichlemn View Post
What do you think happens to optimal hand ranges in NL/PL games when stacks are very large, there have been many raises and the nuts is relatively vulnerable to being outdrawn?

For instance, I believe it can never be optimal in NLHE or PLHE to have a range consisting solely of AA preflop if the stack pot ratio remains relatively high, because an effectively clairvoyant opponent over three streets can do very well against AA by calling with a range that has some variety. Postflop, sometimes this can occur too, especially in Omaha (where the "nuts" can easily be an underdog to a strong draw).

Thus, I think that eventually the in-position player (probably) reraises the "nut range", a range strongly weighted to the nuts but with the optimal number of "deceptive" hands that it can't be exploited for being transparent. The OOP player cannot reraise profitably, because the best he can do is reraise the "nut range" back, which just gets in more money out of position compared to just calling with it.

However, in NL games there is the possibility that eventually the nuts just shoves (no matter what the stack size) because claiming the pot against other non-nut hands does better than playing more streets with it.

Do you agree? What do you think is most likely for NLHE preflop?
I've made reference to the Fundamental Theorem of Chasing in this thread a few times, but it neatly covers this question:

"Given sufficient action yet to come, optimal strategy must threaten the nuts in any sequence."

So if there is sufficient money behind, then you're right that optimal strategy would never pare down to just AA, for example, because of exploitive destruction by the other guy. The key is "sufficient." What's sufficient? It might be pretty big.

Nevertheless, I would expect that at every deep stack size, there are probably value raises and bluffs (which are almost certainly blockers), as long as the money remaining makes it unprofitable to narrow one's distribution too much because of exploitation by the opponent. I don't think that the "seven-bet means aces" which has some kind of consensus is optimal, it's just that we all suck at balancing in practice.
Jerrod Ankenman is offline   Reply With Quote
Old 08-07-2012, 09:05 PM   #167
grinder
 
Jerrod Ankenman's Avatar
 
Join Date: Jun 2004
Location: Avon, CT
Posts: 604
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Nichlemn View Post
Also - how would you go about solving optimal "tournament" strategies where one player has a decided edge (either due to the opponent's weakness or the structure of the game)? An example is playing a HUSNG against a player who shoves every hand - clearly the best response is not to simply call whenever you have a chip EV advantage, but to sometimes fold and wait for better spots. But quantifying exactly where that level is non-trivial. I know about the "Theory of Doubling Up" but that's sort of assuming the conclusion here.

I imagine programming would probably help. As a beginner to programming, what would you recommend I learn to solve this and other poker problems?
This kind of problem isn't trivial to solve, even if you have programming skills. The idea isn't hard to understand, but I'm not going to flesh it out entirely.

Say it is a HUSNG where the other guy jams every hand. You don't know the equities for various stacks, though. So maybe the stacks start 50-50, but you don't know how much your edge is. You do know what your equity is if one guy has all the chips. So assume the following: that if you have X% of the chips, you have X% of the equity.

Now solve the game exploitively for the shove every hand strategy, assigning yourself 100% if you win, 0 if you lose, and 49% or whatever if you fold. Find your implied equity starting from this situation. Now that's your 50-50 equity estimate. Do this for several stack sizes (90-10, 80-20, 30-70 etc). OK, now you have rough estimates for your equity starting from various stack sizes. Now iterate that process, but instead of using the chip equities for future stacks, use the estimates instead. If you get to stacks not in your table, interpolate or something. Now iterating this process a few times should converge on something. That something is your implied equity given your edge from a particular stack, and conveniently, the strategy that realizes it.
Jerrod Ankenman is offline   Reply With Quote
Old 08-08-2012, 05:30 AM   #168
grinder
 
Join Date: Jul 2008
Location: London, England
Posts: 468
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Jerrod Ankenman View Post
I've made reference to the Fundamental Theorem of Chasing in this thread a few times, but it neatly covers this question:

"Given sufficient action yet to come, optimal strategy must threaten the nuts in any sequence."

So if there is sufficient money behind, then you're right that optimal strategy would never pare down to just AA, for example, because of exploitive destruction by the other guy. The key is "sufficient." What's sufficient? It might be pretty big.

Nevertheless, I would expect that at every deep stack size, there are probably value raises and bluffs (which are almost certainly blockers), as long as the money remaining makes it unprofitable to narrow one's distribution too much because of exploitation by the opponent. I don't think that the "seven-bet means aces" which has some kind of consensus is optimal, it's just that we all suck at balancing in practice.
I assume you know about the "Jesus Problem", where villain exposes AA after raising to $5 in a 1-2 game with $50k effective stacks and the hero can call with 100% of his range. I've always assumed that 50k was a random number.

Do you know what stacks need to be for villain to call with 100%?

What is hero's calling range when effective stacks are 5k? 1k? $500?
slowjoe is offline   Reply With Quote
Old 08-08-2012, 08:49 AM   #169
grinder
 
Jerrod Ankenman's Avatar
 
Join Date: Jun 2004
Location: Avon, CT
Posts: 604
Re: Ask me anything about poker game theory

Quote:
Originally Posted by slowjoe View Post
I assume you know about the "Jesus Problem", where villain exposes AA after raising to $5 in a 1-2 game with $50k effective stacks and the hero can call with 100% of his range. I've always assumed that 50k was a random number.

Do you know what stacks need to be for villain to call with 100%?

What is hero's calling range when effective stacks are 5k? 1k? $500?
Tom Weideman proved some kind of bound on the stack size at which calling 100% was right back when this problem was posed on RGP. I've never really been that interested in this problem, though, so I don't really know any of the answers.
Jerrod Ankenman is offline   Reply With Quote
Old 08-08-2012, 11:10 AM   #170
veteran
 
Huggy's Avatar
 
Join Date: Nov 2006
Location: Tag on the streets Lag under sheets
Posts: 2,897
Re: Ask me anything about poker game theory

A reasonably complex model suggests a Nash strategy has characteristic X.

A) There is a weak consensus amongst top HUNL players that a robust strategy does not have characteristic X.

B) There is a strong consensus amongst top HUNL players that a robust strategy does not have characteristic X.

Under scenario A and B would you implement a strategy which had characteristic X. (Obviously implementing and seeing what happens is costly)
Huggy is offline   Reply With Quote
Old 08-08-2012, 12:05 PM   #171
newbie
 
Join Date: Jul 2012
Posts: 20
Re: Ask me anything about poker game theory

Can you skype me cgalley77 is name would like to see if you could help me a bit thanks
TT2T is offline   Reply With Quote
Old 08-08-2012, 02:09 PM   #172
grinder
 
Jerrod Ankenman's Avatar
 
Join Date: Jun 2004
Location: Avon, CT
Posts: 604
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Huggy View Post
A reasonably complex model suggests a Nash strategy has characteristic X.

A) There is a weak consensus amongst top HUNL players that a robust strategy does not have characteristic X.

B) There is a strong consensus amongst top HUNL players that a robust strategy does not have characteristic X.

Under scenario A and B would you implement a strategy which had characteristic X. (Obviously implementing and seeing what happens is costly)
Well, if there is a such a consensus, that means they think that the characteristic a) doesn't add value to the strategy b) is exploitable. So if I think that it does add value to the strategy, then I would figure out how they plan to exploit it.

If they can't, and it does add value, then I would implement it, until such time as they exploit it.
Jerrod Ankenman is offline   Reply With Quote
Old 08-09-2012, 09:18 AM   #173
veteran
 
philnewall's Avatar
 
Join Date: Apr 2003
Location: @pnewall
Posts: 2,188
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Jerrod Ankenman View Post
Well, there's this tension inherent in playing in a balanced manner. For every value hand, maybe there's a particular way we want to play it. But doing stuff like that gives away too much to an exploitive nemesis, so we are forced to group similar hands and play them equivalently. Sometimes it's just easier for us and our puny-sized brains to do certain things (like always raise the same amount or never limp the button). We ESPECIALLY do those things when they seem to have little cost (like say never 4-betting from the button in HULHE). But a GTO strategy wouldn't be limited by our ability to balance reasonably -- it could literally stick tiny bits of mixed strategies on every single hand preflop because it finds that it very slightly prefers to limp with this ONE SINGLE HAND.

So "true" GTO strategies are probably mostly unplayable by humans. The strategies that are being generated now by researchers are often purified but that's a characteristic of their abstraction IMO. As to the degree to which information hiding is a property of a GTO strategy, it will be iff the cost of not information hiding is greater than the extra EV gained.
That's the interesting thing about the current crop of HU-LHE bots. Like you I came into the game with a strong prior that things like never limping and never capping were just easy ways for us humans to keep our ranges wide and probably not truly optimal.

And the first bunch of bots did in fact limp and cap, but as the bots have gotten much much better they've stopped doing these things entirely. (The 2012 winner, Slumbot, doesn't abstract on any street prior to the river.). At this moment I'd probably bet at reasonable odds that when the true equilibrium is found that it doesn't include these strategies preflop from the SB.

I find the tentative evidence, that perhaps we humans can use strategies on some streets that are both simple and very close to being optimal, really exciting.
philnewall is offline   Reply With Quote
Old 08-09-2012, 03:46 PM   #174
Pooh-Bah
 
Join Date: Mar 2005
Posts: 5,250
Re: Ask me anything about poker game theory

Some simplistic models I came up with suggests you can do ok by never raising in in position before the river in many situations, for example I believe (but I am in no way convinced) that you can only call 3bets in position in NL if the stacks are sufficiently shallow.
punter11235 is offline   Reply With Quote
Old 08-09-2012, 05:52 PM   #175
veteran
 
munkey's Avatar
 
Join Date: May 2006
Location: We are all but shadows in the Void.
Posts: 3,088
Re: Ask me anything about poker game theory

Thanks for MOP.

Do you think (part of) the poker playing ecology will or is by the process of evolution converging to GTO strategy?

i.e there is convergence or it is 'cyclical' changes

By 'cyclical' I mean e.g in exploitative {R,P,S} where an initial proportion of popn. play only R and participants play exploitable so play P and we end up with ecology changes where dominant exploitative strategy out there cycles though R->P->S->R.

Edit: * as in we're 'going round in circles' and getting no closer to GTO by just playing vs each other and changing our strategy to just not be exploitable by the current flavour of the month.

Last edited by munkey; 08-09-2012 at 06:04 PM.
munkey is offline   Reply With Quote
Old 08-09-2012, 06:11 PM   #176
journeyman
 
Join Date: Jul 2007
Posts: 300
Re: Ask me anything about poker game theory

Quote:
Originally Posted by punter11235 View Post
Some simplistic models I came up with suggests you can do ok by never raising in in position before the river in many situations, for example I believe (but I am in no way convinced) that you can only call 3bets in position in NL if the stacks are sufficiently shallow.
punter

or how about when stacks get shallower? say against 40bb stacks surely you need the option to 4 bet all in because calling a 3 bet in position leaves such a low SPR that position isn't worth as much as with 100bb stacks?

what do you think is the ideal SPR on the flop for your never raise in position before the river model?
tagWAG is offline   Reply With Quote
Old 08-09-2012, 07:45 PM   #177
Pooh-Bah
 
Join Date: Mar 2005
Posts: 5,250
Re: Ask me anything about poker game theory

Quote:
say against 40bb stacks surely you need the option to 4 bet all in because calling a 3 bet in position leaves such a low SPR that position isn't worth as much as with 100bb stacks?
What makes you think it's obvious ?
punter11235 is offline   Reply With Quote
Old 08-09-2012, 08:52 PM   #178
grinder
 
Jerrod Ankenman's Avatar
 
Join Date: Jun 2004
Location: Avon, CT
Posts: 604
Re: Ask me anything about poker game theory

Quote:
Originally Posted by munkey View Post
Thanks for MOP.

Do you think (part of) the poker playing ecology will or is by the process of evolution converging to GTO strategy?

i.e there is convergence or it is 'cyclical' changes

By 'cyclical' I mean e.g in exploitative {R,P,S} where an initial proportion of popn. play only R and participants play exploitable so play P and we end up with ecology changes where dominant exploitative strategy out there cycles though R->P->S->R.

Edit: * as in we're 'going round in circles' and getting no closer to GTO by just playing vs each other and changing our strategy to just not be exploitable by the current flavour of the month.
This is a pretty good question; of course the answer is complicated.

I think that play is moving toward GTO, but pretty slowly. Compare modern HUNL play to that from a few years ago, and it's kind of obvious in that sense. I don't think, however, that play will converge to optimal or even good unexploitable strategies without computer involvement. And the presence of very good exploitive players probably makes this process slower, because they may not only exploit your strategy but also other stuff like timing tells or physical tells (live) that game theory won't help you with. I also think it's possible that the process just stalls out because there are players playing strategies which are hard for humans to exploit because beating them just involves putting yourself in all kinds of uncomfortable situations and playing accurately in them, and basically humans aren't really up to that over the longer term.
Jerrod Ankenman is offline   Reply With Quote
Old 08-09-2012, 10:09 PM   #179
journeyman
 
Join Date: Jul 2007
Posts: 300
Re: Ask me anything about poker game theory

Quote:
Originally Posted by punter11235 View Post
What makes you think it's obvious ?
If we call a 3 bet in position against a 40bb stack as opposed to a 100bb stack then there is obviously less room to use position to outplay them. Even floating the flop can be dangerous because it's easy for them to bet flop and turn all in with only 2 streets of postflop betting.

Are you suggesting that never 4 betting in position v midstacks may be ok?
tagWAG is offline   Reply With Quote
Old 08-10-2012, 10:18 AM   #180
Carpal \'Tunnel
 
Nichlemn's Avatar
 
Join Date: Oct 2007
Location: The water hemisphere
Posts: 8,065
Re: Ask me anything about poker game theory

Quote:
Originally Posted by Jerrod Ankenman View Post
Tom Weideman proved some kind of bound on the stack size at which calling 100% was right back when this problem was posed on RGP. I've never really been that interested in this problem, though, so I don't really know any of the answers.
Can it really be profitable to call with say, A9o sharing a suit? My understanding was that even with clairvoyance and very large stack sizes, the best you can do per street is to add bluffs (almost) equal to the fraction of winners you have. For instance, if you have a bluffcatcher and I have a draw to 90% dead hands and 10% nuts, my optimal strategy is to bet all-in with my nut hands and enough of my dead hands such that you are indifferent to calling. At very large sizes, my bluff fraction approaches 50%. Since you are indifferent to calling these bets, we can calculate my equity by assuming you fold all the time, meaning I effectively win the pot just under 20% of the time. With another street, I can count those 20% hands as "winners" and bluff accordingly another 20% of dead hands.

But with A9o sharing a suit, you only have 5.9% equity. Even if all five community cards were dealt before the three streets of betting, you can only "convert" that to 47% winners (and I don't think you can leverage tied pots, for which there are many in this case, in the same way). As they're not, this is most likely an overestimate of A9o's equity, and so it might not be getting the pot odds to call depending on AA's raise size.

One possibility is that there are a significant number of situations where the non-AA player has "too few" bluffs in his distribution, such that the marginal value of extra dead hands is positive. I'm not sure of a quick heuristic for quantifying this so I'm not sure how important this is.

But in any case, this highlights my concerns about the "Fundamental theorem of chasing". Large stacks have sharply diminishing returns, so even a trillion big blinds isn't going to be enough to induce very weak nut-probable hands to call.
Nichlemn is offline   Reply With Quote

Reply
      

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -4. The time now is 11:30 AM.


Powered by vBulletin®
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.6.0 ©2011, Crawlability, Inc.
Copyright © 2008-2010, Two Plus Two Interactive