Open Side Menu Go to the Top
Register
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc"

11-24-2012 , 09:46 PM
Quote:
Originally Posted by kleinstein000
I dont understand why people keep using this as an example. Folding preflop 100% should not even be considered playing. Find a different example
You are being narrow minded. Using extremes is a very common and useful tool in logic and math to illustrate a point. Folding pre 100% is a horrible strategy for sure, but it is still a strategy. Folding is an action in poker and if you are taking actions then you are playing the game.

Finding a GTO solution to poker means finding a strategy that's unexploitable and at least 0-EV vs the set of all strategies, not just the ones that "make sense".

Last edited by Wolfram; 11-24-2012 at 09:53 PM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 09:54 PM
Quote:
Originally Posted by franxic
i bet my money on gto beating every random strategy, unless there is a strategy which plays all relevant situations (gto is +ev against any other strategy, see my example) gto-like and magically only deviates in possibly non-existant spots where a non-gto strategy breaks even against gto. would not really be a random strategy though.
Although I guess the point can't be proved sans solution, I think there's a decent amount of evidence to support the idea that a GTO solution will result in a ton of indifference points. If you look at toy games or even hold 'em mini-games, this is the general trend. You can come up with a lot of silly examples of suboptimal strategies that will almost for sure be -EV versus the GTO strat, but once you eliminate all of the really blunderous errors, the situation becomes less clear. Like the previous poster, I like your side of the bet -- I just think it's pretty clear from what we do know that the solution will result in lots of situations where such indifference points do exist. I'm tempted to suggest that it's theoretically inevitable, but I don't know if I really have my head wrapped around that thought well enough to argue the point.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 10:08 PM
Quote:
Originally Posted by Wolfram
That wasn't what I was trying to show. I was merely showing that a poker GTO strategy is +EV vs the set of all strategies, unlike the RPS GTO strategy.


Agreed. I realize that my first reply to you was wrong and that we can't know whether in poker a GTO strat is +EV vs every non-GTO strat.

But intuitively it seems extremely likely that it will be.
kk

Sorry for the derail. Back on topic.
  1. I think game theory is the future of poker strategy, but not every winning high-stakes pro uses it explicitly (PI, PA, zig, ect.)
  2. Some high-stakes pros are sick poker players and think they understand GT, but don't (ie. durrr).
  3. I think durrr would lose to the bot.
  4. I think one of the HU limit specialists stands a much better chance against the bot.
  5. Obviously any prop bet with durrr should have a time limit.
  6. I don't see the bet taking place.
  7. I would pay ~$100 to see a recorded match: durrr v. machine for 200k hands.

Last edited by Mindy Macready; 11-24-2012 at 10:14 PM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 10:09 PM
it was widely regarded that hoss was the best limit hold em player in the world, right? and he only lost to one person mainly- ivey. instead of durrrr, why don't we get ivey vs slumbot?

durrrr was known for making bad prop bets huh?

inb4 ftp rng rigged and mm lost over epic battle
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 10:34 PM
Quote:
Originally Posted by themuppets
Although I guess the point can't be proved sans solution, I think there's a decent amount of evidence to support the idea that a GTO solution will result in a ton of indifference points. If you look at toy games or even hold 'em mini-games, this is the general trend. You can come up with a lot of silly examples of suboptimal strategies that will almost for sure be -EV versus the GTO strat, but once you eliminate all of the really blunderous errors, the situation becomes less clear. Like the previous poster, I like your side of the bet -- I just think it's pretty clear from what we do know that the solution will result in lots of situations where such indifference points do exist. I'm tempted to suggest that it's theoretically inevitable, but I don't know if I really have my head wrapped around that thought well enough to argue the point.
i tend to disagree. poker is to complex.

in RPC your ev in any throw is either -1, 0, or 1. your avarage ev is 0, whatever you pick.

in poker, only calculating the ev or e.g. AT against a random hand for a preflop all-in situation requires computer-help and gives you a number like 58.7638...%, and it seems hard to construct action frequencies which would result in exactly equal evs. if not number-theoretically impossible.

also, it is shown for push/folding that gto gives you indeed a single maximum-point for equity compared for any other strategy, and the further you deviate the worse it gets. to assume that in other settings weird local maxima would exist is at least counter-intuitive.

Last edited by franxic; 11-24-2012 at 10:53 PM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 10:58 PM
I want to bet $1000, i have got durrrr winning AND durrrr never taking the bet in the next 6 months

would need escrow
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 10:58 PM
Quote:
Originally Posted by franxic
i tend to disagree. poker is to complex.

in RPC your ev in any throw is either -1, 0, or 1. your avarage ev is 0, whatever you pick.

in poker, only calculating the ev or e.g. AT against a random hand for a preflop all-in situation requires computer-help and gives you a number like 58.7638...%, and it seems hard to construct action frequencies which would result in exactly equal evs. if not number-theoretically impossible.

also, it is shown for push/folding that gto gives you indeed a single maximum-point for equity compared for any other strategy, and the further you deviate the worse it gets. to assume that in other settings weird local maxima would exist is at least counter-intuitive.
I see what you're saying but consider situations like the following (borrowed from the previously mentioned Bryce article):

Quote:
A common example of a half-street game would be one where we either hold hands that always win, or always lose if we see a showdown, and can either bet or check, and our opponent may only call or fold. If he calls, there is a showdown. This is often analogous to a river-betting scenario in real hold’em play where our opponent’s range is narrow and ours is polarized. By solving the mini-game we can see that the GTO strategy is to bluff an amount proportionate to the price we are laying our opponent on his call. For example, if we bet $1 into a $2 pot we are laying 3:1 by betting, and the GTO strategy is to bluff 25% of the time that we bet. Our opponent will be indifferent to calling or folding. As a result, we know that if we deviate from this strategy our opponent can exploit us by either always calling if we bluff more, or always folding if we bluff less.
These types of situations, even though only proven in mini-games, will almost certainly occur in the full game.

I think the complexity of the game actually argues in favor of the existence of such indifference points, and it's your focus on pf concepts that is overly simplistic.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 11:14 PM
200k hands!?!??!?! he never even finished the even one of the 50k hand challenges.
Also, did I get it right that he wants odds based on the amount he's wagering? Maybe I misunderstood.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 11:24 PM
Stepping away from the awesome GTO discussion (which im trying really hard to understand) and back to the original topic and notion that all top players use these "strategies" but may not express it that way. While reading this thread last night the following came on TV.



I freaken love this show. Its worth the full watch.

Is it this unique/imbalanced distribution of electrical activity that allows guys who dont use a HUD like ivey, durrrr, zigmund, isildur etc to recognise patterns in their opponents play and adjust accordingly?

Are sauce, kanu, ike , galfond wired similarly and expedite the process using a HUD?

Im not the sharpest tool in the shed but i think this plays a major role, so ill let you smart folks watch and take it from here.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 11:29 PM
jesus christ there's a lot of people who dont understand game theory in this thread, durrr included.

"optimal" in the game theory sense means "unexploitable". it is NOT necessarily the highest EV play. it is simply the play that is part of a strategy which is perfectly balanced and is unexploitable across all boards/hand ranges/bet sizes/whatever-else. it may raise a river with a frequency that is -EV in a specific situation and thus be "sacrificing" edge in that spot, but given the ranges it gets to the river with in that spot, and given that the river play is only part of the "whole" of the entire hand, and that the single hand is only a part of the "long run" of infinite hands, it will make up for that loss in EV on that singular river spot by gaining EV in other spots, and as a whole, the strategy it employs will not be beatable. if you adjust to it's seemingly incorrect river frequency, your adjustment will lose that value in other similar river spots, and overall your adjustment (assuming here that you adjust away from gto) will cost more than it will gain, and on average against all possible situations during the infinite hand game, you will be worse off.

here are some facts:

gto in hunl does exist. john forbes nash jr proved this long ago.

gto for hunl is currently unknown, even though we know that it does exist.

unlike in RPS gto where you breakeven no matter what, in poker, you will always lose to gto.

gto does not care what you do. it does not take into account your frequencies and hand ranges. it does not adjust. it simply knows that EVERYTHING you do will end up being inferior to it and thus it doesn't care what you do. it only knows raping you.

the above point means that it may not beat bad players for as much as a non-gto good player would, because the good player would make deviations to maximally exploit the bad player-- but those deviations in turn COULD also be exploited (and thus why gto doesn't employ them) -- but the good player just knows the bad player is so bad he won't re-exploit and thus deviating is safe. gto does not know (or care about) this.

in short, gto does NOT win the most money possible, but it DOES win money IN EVERY GAME (assuming no rake).

gto cannot be beaten. not by you, not by me, and not by durrr. not even ivey. if you use your amazing human sense to know that its frequencies are off in this spot or that spot, you will only lose less against it. and you might be wrong and do worse off. regardless, the best you can hope for is to lose less. you will never beat it.

are we clear yet 2+2???
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-24-2012 , 11:43 PM
Quote:
Originally Posted by themuppets




These types of situations, even though only proven in mini-games, will almost certainly occur in the full game.

I think the complexity of the game actually argues in favor of the existence of such indifference points, and it's your focus on pf concepts that is overly simplistic.
good example for sure. indifference points where all strategies perform equally well are possible.

will stop the derail now, i never said there was no such strategy possible. discussion has no practical purpose whatsoever. a strategy that is gto except in spots where it doesn't matter anyway is still gto, no?

note that the caller in your example plays gt-optimally whatever he does as long as hero's bluff frequency keeps him at that indifference-point. compare that situation with RPC where the response to gto is also indifferent. see analogies?

Quote:
Originally Posted by kk<<trupqq

here are some facts:

...

unlike in RPS gto where you breakeven no matter what, in poker, you will always lose to gto.
in before you are asked to give a source.

Last edited by franxic; 11-25-2012 at 12:06 AM.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-24-2012 , 11:43 PM
Quote:
Originally Posted by Mindy Macready
Here is a simple example which illustrates a few important points regarding GTO play.

My Example: Suppose we are playing "Rock, Paper, Scissor".
  • My strategy is to randomize rock, paper, and scissor (this is GTO plan).
  • Your strategy is to randomly select rock and paper.
We play 1,000,000 games and bet $5 on each game. What is my EV?

Spoiler:
Since the GTO strategy is my strategy, you might think that I have an advantage and will show a profit over time. But the reality is that my expected-value is zero. The advantage of my strategy is only that it is not exploitable. GTO does not exploit all other strategies, including non GTO strategies.

A simple simulation in excel can verify this (I did it a few minutes ago).

Next question: Suppose I knew your plan was to randomize rock and paper. How should I play against you?

Spoiler:
If you are randomizing rock and paper, I should play paper every time since I will either win or tie. In the case of 1,000,000 games at $5 each, my expected-value is $2,500,000.

Note that your strategy is not GTO and therefore it is exploitable.

Conclusions:
Spoiler:
  1. GTO is "un-exploitable" but not always the strategy that makes the most money.
  2. GTO does not exploit all other strategies, including non GTO strategies.
  3. In many cases to make money against someone who isn't playing GTO, you must also deviate from GTO, that is, you must play exploitatively.
+1, good analogy
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-24-2012 , 11:56 PM
Quote:
Originally Posted by ike
I'm not clear on exactly what you mean by "state" or "assumptions."

If you think of the 1-2-3 game in terms of a game tree, the river situations after patting or after discarding are definitely different branches. Does this mean they are different game states? I would think yes.
State is simply a block of data describing the state of the game. In my conception of some sort of GTO poker bot you'd be able to query into a table by hashing the 'state' and looking it up in a table. So for instance a state would include information including but obviously not limited to:

My cards:
My range:
Pot:
Opponent's known range:

So the state between where an opponent draws vs stands pat would be identical as your opponent's known range is still the same - 5 unknown cards. My mistake was viewing this as 'opponent's known range' which should have been something like 'opponent's known optimal range'. The draw doesn't change his known range but it changes his optimal range since the optimal weighting possibilities of trips or whatever becomes higher after the draw increasing the potential strength of his range. By assumption I was referring to changing the state on what 'ought' be without knowing something for a fact - an exploitable action.

A silly conceptual mistake that I'm happy to have been able to correct!
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:03 AM
lol at durrrr finishing at least one of his challenges (esp 100-200k hands lol)
jungleman must be sitting facepalming somewhere right now
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:06 AM
Quote:
Originally Posted by aaaaaaaa
If a bot is playing HUNL and trying to play GTO why wouldnt it just push/fold pre ? Correct me if i'm wrong but GTO just means playing unexploitably rather than optimally. If this is true why bother with other lines when u can just jam/fold PF .
Example: JTs on the button 200 BB's deep. How could anything involving folding or shoving be optimal? GTO would involve x% limp y% minraise z% 4x etc.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:29 AM
Quote:
Originally Posted by ike
There kinda needs to be a buyout. If someone is winning at 1BB/100, and it could easily be a lot more, that side wins $8MM in 200k hands of 2k/4k. I don't know how prepared to lose $8MM either of us is, but I'm pretty certain neither of us wants to risk $40MM+.

The nice thing about a buyout is that it allows us to escrow just the buyout amount and a bit more and whoever is losing can top up their escrow deposit as they lose or quit and forfeit the buyout.

On the same note, there needs to be a time limit. I don't know exactly how the interface for playing the bot will work, but let's say you get anywhere from 100 hands an hour to 400 hands an hour in. You're committing to somewhere between 500 and 2000 hours of play. With this much at stake, I can't just take you at your word that you'll make a good faith effort to put in up to 2000 hours of play at a reasonable pace until it's over.

edit for arithmetic fail
Yeah agree with all of this, maybe if you come out with a figure of the maximum that you are prepared to lose on the bet durrrr then we can match it on the other side and that can be the buyout amount. Also there will obv have to be a time limit on the bet which if you pass you forfeit the bet. Doesn't have to be a time frame that puts you under time pressure but I'm sure none of us want money tied up for years in escrow.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:44 AM
Wow. Hell of a thread.

Only thing I'm confused on is how, if the hypothetical GTO bot never adjusts its play to any variable factors such as opponent tendencies, it could show a profit against any opponent.


and even if this were the case, why is everyone insisting that the GTO strategy for hunlhe would not include player-to player or even realtime adjustments?
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:54 AM
Quote:
Originally Posted by look at me now
Only thing I'm confused on is how, if the hypothetical GTO bot never adjusts its play to any variable factors such as opponent tendencies, it could show a profit against any opponent.
gto means that there is no strategy that it needs to adjust against because the way it plays is not exploitable. that's the whole point.


edit: removed insult.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 12:55 AM
I'm not sure if it has been said, but since this is such a great thread, "A Beautiful Mind" is a great movie in which the guy who pretty much can rule this discussion is the main character. It is about the guy who proved this theory.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:00 AM
Quote:
Originally Posted by LeonardoDicaprio
gto means that there is no strategy that it needs to adjust against because the way it plays is not exploitable. that's the whole point.


edit: removed insult.

Yes, but how is it possible to not be exploited in HUNL without adjusting?

Seems contradictory.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:08 AM
Quote:
Originally Posted by Mindy Macready
kk

Sorry for the derail. Back on topic.
  1. I think game theory is the future of poker strategy, but not every winning high-stakes pro uses it explicitly (PI, PA, zig, ect.)
  2. Some high-stakes pros are sick poker players and think they understand GT, but don't (ie. durrr).
  3. I think durrr would lose to the bot.
  4. I think one of the HU limit specialists stands a much better chance against the bot.
  5. Obviously any prop bet with durrr should have a time limit.
  6. I don't see the bet taking place.
  7. I would pay ~$100 to see a recorded match: durrr v. machine for 200k hands.
Agree that's a great price to pay for info like that (would obv pay it).
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:13 AM
cuz then it wouldn't be GTO strategy. GTO strategy is playing a certain unexploitable way. It doesn't care what the opponent does. Adjusting the strategy would mean exploiting the opponent (which is in turn exploitable).
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:13 AM
Quote:
Originally Posted by look at me now
Yes, but how is it possible to not be exploited in HUNL without adjusting?

Seems contradictory.
if you look at one of the hundred posts about rock paper scissors that simplifies it in this thread it is easy to understand in a basic way.

throwing 1/3 rock 1/3 paper 1/3 scissors is never going to be able to be exploited in any way. so if you ever found the optimum frequencies in all situations in hunl then you can play in such a way that it is simply impossible to have a disadvantage.

Last edited by LeonardoDicaprio; 11-25-2012 at 01:15 AM. Reason: lol said 'way' a lot in this poast
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:18 AM
Quote:
Originally Posted by franxic
will stop the derail now,
No worries there. The whole thread is a derail with 3 or 4 unique discussions interwoven throughout. I kind of like it.

Quote:
i never said there was no such strategy possible.
This is true and I was originally hesitant to respond to your post for that very reason. Your phrasing did seem to suggest you were skeptical about the idea, so I decided to reply anyway, perhaps in part because this concept plays an important role in one of my previous posts.

Quote:
discussion has no practical purpose whatsoever. a strategy that is gto except in spots where it doesn't matter anyway is still gto, no?
It does sort of matter because it shows that to achieve the goal of GTO, you often have to create such spots to avoid being exploited yourself.

Quote:
note that the caller in your example plays gt-optimally whatever he does as long as hero's bluff frequency keeps him at that indifference-point. compare that situation with RPC where the response to gto is also indifferent. see analogies?
That's not precisely true. If he for example folds always, his play becomes exploitable even though his expectation against the bot doesn't change. The fact that the bot doesn't respond to this behavior doesn't make the strategy game theory optimal.

It's certainly analogous in the sense that it's another simple toy game, but I think it serves to clarify how such situations can arise in holdem. There are theoretically more complicated range composition and multi-street problems that also result in indifference points; it's just the complexity of it makes it hard to present meaningful examples and thus the reliance on simple mini-games to help with conceptualization. Obv this way of trying to understand the question doesn't satisfy scientific scrutiny, but it's the best I can do. I do take some comfort in the fact that ppl who have spent more time on this than I have seem to take the existence of indifference points in the GTO solution for holdem as a given and many pros have already spent a lot of time solving and/or studying these types of mini-games in an attempt to better understand them (see the intreview from the OP, for example).

Last edited by themuppets; 11-25-2012 at 01:43 AM.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote
11-25-2012 , 01:19 AM
Quote:
Originally Posted by look at me now
Yes, but how is it possible to not be exploited in HUNL without adjusting?
i wonder this too. sometimes I dont want to wander to far into this argument but what you guys are saying for the future implications of hu nl makes sense.

On another note, doesn't this want to make some of you just program a bot and see how good you could get it at hu nl. damn it would take a lot of time but if you could have user interfaces that made programming more fun and less of a grind, I could get it really ****ing good at hu nl with the help of the right people and feedback from other hu players. however, it would take to much work and I just dont care enough especially considering the hu economy.

i esp like when ike says he sees different preflop raise sizes (instead of just minraising every button) and correctly adjusting sizing and ranges will be a feature of the god like hu bots. can you bless us one more time ike and tell us why you think is the case? So god like hu bots wont only be 2x preflop but occasionally ...2.1-4x (how high does this # go, at some point raising more x% of ur stack with xbb is just mathematically never right)

Last edited by Homer.4; 11-25-2012 at 01:24 AM.
Hoss_TBF: &quot;All top players use game theory, distributions, bluff ratios etc&quot; Quote

      
m