Open Side Menu Go to the Top
Register
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc"

12-04-2012 , 07:07 PM
Quote:
Originally Posted by gaming_mouse
i'm not completely sure what you mean here, as i don't really see what the analog in poker would be for those intricate series of moves.

it is very likely true that humans can't arrive at GTO fullscale (HUNL or HUNLE) poker without computer aid.

on the other hand, i think it's unlikely that those solutions would seem "crazy" or totally incomprehensible to professional players. some of them would be surprising at first, but in most if not all cases i would bet they would make sense after some thought and analysis. this is the case in my experience with toy games as well as the play of bots like polaris.
[0,1] makes sense to me, I can see the lines and see the equations for FL/potbet-distributions. But when I see solutions for 52cards even just one street they start to not make sense in many cases. Sure I can see that some card has a blocker here for that combo there most of the times. But that is one street with one betsizing for the solver. But then add the turn, flop and preflop and different betsizings and future actions etc and I am pretty sure that I as winning NL2k player would be totally lost and that even Matt would be lost. Just keeping track of all different lines will be close to impossible.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-04-2012 , 07:19 PM
Quote:
Originally Posted by heltok
[0,1] makes sense to me, I can see the lines and see the equations for FL/potbet-distributions. But when I see solutions for 52cards even just one street they start to not make sense in many cases. Sure I can see that some card has a blocker here for that combo there most of the times. But that is one street with one betsizing for the solver. But then add the turn, flop and preflop and different betsizings and future actions etc and I am pretty sure that I as winning NL2k player would be totally lost and that even Matt would be lost. Just keeping track of all different lines will be close to impossible.
I think you misunderstood me. Obviously you cannot understand all precise reasons for every bet size for each individual hand. Truly understanding every detail would mean understanding GTO play perfectly. But I'm saying that the strategy, viewed from a high level, will still roughly fit with most of the heuristics you do understand. You'll be able to see portions of the range being used as bluffs, bluff catchers, balancing hands, etc. Whereas I don't think there is any such high level understanding to be had in those chess videos (I'm not a chess player though).
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-04-2012 , 07:27 PM
Quote:
Originally Posted by BlackStar9
ROFL wat?

It's quite clear from this thread that only nosebleed players seem to have even the mildest grasp of this.

It's also quite clear to me from this thread, knowledge of GTO strategies and the like, and the extent to which it matters when making a great poker player, are marginal at best.
Exactly. Understanding the correct theory of what to do vs. a range doesn't help much if you can't accurately estimate another player's range, etc etc.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-04-2012 , 07:49 PM
Quote:
Originally Posted by gaming_mouse
I think you misunderstood me. Obviously you cannot understand all precise reasons for every bet size for each individual hand. Truly understanding every detail would mean understanding GTO play perfectly. But I'm saying that the strategy, viewed from a high level, will still roughly fit with most of the heuristics you do understand. You'll be able to see portions of the range being used as bluffs, bluff catchers, balancing hands, etc. Whereas I don't think there is any such high level understanding to be had in those chess videos (I'm not a chess player though).
You have to be correct. Chess is like chaos theory but poker isn't.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-04-2012 , 07:59 PM
Quote:
Originally Posted by BlackStar9
It's also quite clear to me from this thread, knowledge of GTO strategies and the like, and the extent to which it matters when making a great poker player, are marginal at best.
I disagree.

Some of the ideas behind GTO play are very basic and many people apply the idea without even knowing it.

In the case where someone is playing a hand without the initiative, the idea behind GTO is to defend enough (by calling or raising).

Anytime someone says something like:
  • I can't fold this hand. I have ace-high, but the board is so dry, and I most of the time I won't even have a pair. I need to defend here. I could call or raise, let me think about it.
Or something like:
  • I'm near the bottom of my range, so I am okay folding here.
... they are basically thinking GTO in that they are making sure their villain isn't exploiting them, and the GTO approach is all about playing unexpoitatively.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 04:21 AM
Quote:
Originally Posted by gaming_mouse
I think you misunderstood me. Obviously you cannot understand all precise reasons for every bet size for each individual hand. Truly understanding every detail would mean understanding GTO play perfectly. But I'm saying that the strategy, viewed from a high level, will still roughly fit with most of the heuristics you do understand. You'll be able to see portions of the range being used as bluffs, bluff catchers, balancing hands, etc. Whereas I don't think there is any such high level understanding to be had in those chess videos (I'm not a chess player though).
So you are looking down at K7s in our solution for poker. We check for the branch Kh7h:r2.5r10 and see that it's call. Why is it a call? We looka bit more and see that the tree moves into 117600 different branches. Sure we can analyze a few of them and some of them we hit our hand, some of them a draw, some of them we get a nice blocker and some of them we fold. But why didnt we 4bet? "Because the EV is higher calling" will be the answear for tons of questions, not "we use it as a semibluff because the king has a blocker for KK, AK, KQo and 7 for A7,76s,75s".

same in chess, we see the complex position and see that Nxd4=1 Ba6=0 and 0-0=1/2. We just dont understand it. It is the same for both game's solutions.


Quote:
You have to be correct. Chess is like chaos theory but poker isn't.
Quote:
Chaos theory is probably the biggest misnomer in history, because chaos theory isn't about utter disorder at all. Instead, it defines the behaviour of systems that are non-linear and dynamic, but which also have entities/actions occurring therein which can intersect with each other over time and space. Differences in entity/action movement within such a system will be dependent on their sensitivity to initial conditions (occasionally called the "Butterfly effect").

Game theory is a strategy based mathematical theory, where two players in a system make decisions about a strategic situation, based on their interaction with each other. The objective of both players is to maximise their returns, thus cost and benefits to a strategic situation can only be properly calculated based on the decisions made by players.

Complexity theory can refer to systems theory (study of large systems including schools of thought, biological systems and engineering) as well as considerations of genetic and artificial life processes. Essentially, complexity theory considers what is generally predictable behaviour in a system, what is aberrant behaviour and how engagements between entities/actions in a system can result in either predictable outputs or aberrant results.
Try out a GTO for chess position solver:
http://www.k4it.de/index.php?topic=egtb&lang=en

Last edited by heltok; 12-05-2012 at 04:33 AM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 06:40 AM
Quote:
Originally Posted by ike
I think you're misunderstanding me. I agree with everything in your post. I'm not saying it has the same EV against the strategy as a whole. I'm sure it does better against the strategy as a whole. I'm saying that when you get dealt AA and 3bet it, you beat the GTO bot for exactly the same amount whether you 3bet other hands or not.
Please point out if something of the following is wrong.

The way I see it there is nothing to guarantee us that at the Nash equilibrium the strategy that is played is not a function of the other players frequencies of making certain actions. Thus, the Nash Eq strategy of how to play against 3-bets could be a function of the 3-betting range of the opponent, which means that different amounts are being lost against Aces depending which other hands opponent 3-bets.

Ofcourse in poker when both players are at a Nash Equilibrium, having the Nash equilibrium strategy to be a function of opponents actions would be pretty useless as other players strategy is known and hence the result of this function is known. However, when opponent deviates from his Nash Equilibrium strategy then the value of this function is no longer known and is opponent dependent. Hence, it is possible that the reaction to opponents 3-bets are opponent dependent, hence possible that different amounts are being lost against Aces depending on opponent when we are playing our Nash Equilibrium Strategy (I guess that' s what you mean by GTO?).
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 09:45 AM
Quote:
Originally Posted by ibang4aliving
Please point out if something of the following is wrong.

The way I see it there is nothing to guarantee us that at the Nash equilibrium the strategy that is played is not a function of the other players frequencies of making certain actions.

wrong

Thus, the Nash Eq strategy of how to play against 3-bets could be a function of the 3-betting range of the opponent, which means that different amounts are being lost against Aces depending which other hands opponent 3-bets.

wrong

Ofcourse in poker when both players are at a Nash Equilibrium, having the Nash equilibrium strategy to be a function of opponents actions would be pretty useless as other players strategy is known and hence the result of this function is known. However, when opponent deviates from his Nash Equilibrium strategy then the value of this function is no longer known and is opponent dependent.

wut

Hence, it is possible that the reaction to opponents 3-bets are opponent dependent, hence possible that different amounts are being lost against Aces depending on opponent when we are playing our Nash Equilibrium Strategy (I guess that' s what you mean by GTO?).

wrong
source: this thread, about a gazillion times.

i mean wtf, did you still not get what a NE is but prefer to keep guessing itt instead of reading the ****ing definition?

Last edited by franxic; 12-05-2012 at 09:51 AM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:34 AM
Quote:
Originally Posted by BlackStar9

It's quite clear from this thread that only nosebleed players seem to have even the mildest grasp of this.
It's quite clear from this thread that there are some counterexamples.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 02:24 PM
"So you are looking down at K7s in our solution for poker. We check for the branch Kh7h:r2.5r10 and see that it's call. Why is it a call? We looka bit more and see that the tree moves into 117600 different branches. Sure we can analyze a few of them and some of them we hit our hand, some of them a draw, some of them we get a nice blocker and some of them we fold. But why didnt we 4bet? "Because the EV is higher calling" will be the answear for tons of questions, not "we use it as a semibluff because the king has a blocker for KK, AK, KQo and 7 for A7,76s,75s"."

Exactly. Toy games are useful because they translate reams of information into a few principles which we can apply with human imprecision to many different game states. As a human trying to play GTO, we need to make heuristics for ourselves which capture the most information possible. For instance, the principle 'bet all your value bets and add an appropriate amount of bluffs,' does a good job capturing near optimal play even if we size our bet somewhat conventionally.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 02:29 PM
Quote:
Originally Posted by BlackStar9
ROFL wat?

It's quite clear from this thread that only nosebleed players seem to have even the mildest grasp of this.

It's also quite clear to me from this thread, knowledge of GTO strategies and the like, and the extent to which it matters when making a great poker player, are marginal at best.
I know several people who understand all this game theory stuff and can't beat 50nl. I also know several people who beat 5/10+ and their knowledge of game theory stops at just the basics of exploitability/balance. I'd guess in general there is a positive correlation between understanding game theory/nash equilibriums and poker, but in general since it's a game where the goal is to maximize how much you win by (as opposed to chess where you get a win if you win in 5 moves or 50 moves, so gto will always out-perform any strategy), you generally see much better returns working on figuring out strategies of opponents and exploiting them rather than trying to play gto, especially given there's a rake (aka it's possible gto would actually lose post-rake).
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 03:39 PM
Bots win by forfeit apparently.

Good game humanity.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 07:20 PM
Quote:
Originally Posted by franxic
source: this thread, about a gazillion times.

i mean wtf, did you still not get what a NE is but prefer to keep guessing itt instead of reading the ****ing definition?
Ya I think you didn't understand anything of what I wrote.. I obv know about Nash Equilibriums. There are a lot of ideas in my previous post but I don't want to overwhelm your brain so for a start focus on the main idea which is simple:

How can you guarantee that the NE Strat (of our bot) doesn't contain instructions like "If he 3-bets x% call cx%", where c is constant say?

Kisses
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 07:41 PM
Quote:
Originally Posted by ibang4aliving
How can you guarantee that the NE Strat (of our bot) doesn't contain instructions like "If he 3-bets x% call cx%", where c is constant say?

Kisses
...because then it wouldn't be the nash equilibrium strategy.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 07:44 PM
Quote:
Originally Posted by zachvac
I know several people who understand all this game theory stuff and can't beat 50nl
Hi.

Yea, lots more to poker than game theory - tilt control, accurate range estimation, game selection...
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 07:59 PM
Quote:
Originally Posted by bware
...because then it wouldn't be the nash equilibrium strategy.
nah thats wrong..
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 09:55 PM
Quote:
Originally Posted by Cangurino
Sometimes I state things casually since many people get turned off by formal mathematical reasoning.

Let us assume that the waitress has no influence on the cards. Then we can ignore her, solve the waitress-less game, and play our equilibrium. If our opponent is somehow influenced by her, she causes him to deviate from his GTO, and therefore probably costs him money. In a heads-up situation, this means that we win.

So we can restrict ourselves to the actual game of poker, which is finite. From our perspective the opponent's deviations are purely random. Of course if we want to maximally exploit him we need to know his turn check-raising range in the presence of an Asian waitress with green eyes and cup size C.

BTW, "uncountable" has a precise mathematical meaning, which certainly does not apply here.

If there were poker games that are not games then something would be seriously wrong with the mathematical definition of a game. If you came up with such a game I doubt we would recognize it as Poker.

This might be interesting to some.
So you've excluded a bit of strategy therefore the definition of a game theory game has not been fulfilled since you need to be able map every possible combination of strategy to determine specified pay offs.

I think the only practical semi-solution for solving heads up holdem is to feed the computer trillions of session histories (and regularly update) and build an algorithm based upon the winning positive expectation moves.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 10:34 PM
Quote:
Originally Posted by Jerrod Ankenman
Eh, this is imprecisely worded, but I think the spirit of it isn't quite correct. GTO strategy does take into account another (optimal) opponent range and does do specific things with regard to blockers/card removal. This is not often seen in the toy games that are commonly discussed, because in general the toy games with card removal are too simple and the more complex toy games ignore card removal. However, I will give an example that I have mentioned before.

Consider the limit holdem game where both players have a random hand, it's the river on a board of like T8532 rainbow, and there is just one bet left. The pot is like, say, 6. If you solve for GTO strategies, you find that the first player does something interesting with his big pairs. He will (for example) bet AA, QQ, and JJ, but check KK. This seems odd until you look at the second player's strategy, where his "check behind" hands are mostly king-high. So the heuristic interpretation of this is the first player wants to check/induce a pretty good hand for balance sometimes. When he has KK, he blocks the opponent from checking behind the most, so he chooses that hand as the inducer, because the opponent will tend to bluff or value bet more often when he holds that.

So GTO does take advantage of the features of a specific distribution/strategy for the villain in the card removal domain.
What if a certain opponent actually never checks behind with King high, but does with A high ? (which is very possible as some players check behind a high expecting it can win showdown but has no value to bet, and bluff there K high hands so that opponent might fold A high or bottompair)
Then doesn't the "gto" strategy, get it wrong? I guess I am saying that the nash eq strategy would not make an assumption like this that the opponent will check behind more often with K high. It cannot make these kind of assumption on player ranges in specific spots, if it did, it would be exploitable. The "bot" cannot assume that K high is more often in the range of a player checking behind in this spot then A high.

I realize i probably misunderstood something along the lines of the first player is doing that because it is playing optimal against what the second player "should" do. It is interesting to note though, that if the GTO is doing as you say and making plays like the one you detail, by using what the "optimal" range of the opponent is, it seems that it could be making "mistakes" against someone NOT using those "optimal" ranges, and therefore calls into question whether or not the bot would even make plays like this.

Last edited by jusgivithere; 12-05-2012 at 10:43 PM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:08 PM
Quote:
Originally Posted by SD15
So you've excluded a bit of strategy therefore the definition of a game theory game has not been fulfilled since you need to be able map every possible combination of strategy to determine specified pay offs.

I think the only practical semi-solution for solving heads up holdem is to feed the computer trillions of session histories (and regularly update) and build an algorithm based upon the winning positive expectation moves.
You don't seem to have made any moderately convincing arguments that HUNL strategies are not a finite set. Millions, billions, trillions, whatever, it's theoretically countable and mappable, ie. there is at least one GTO solution.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:09 PM
Quote:
Originally Posted by jusgivithere
What if a certain opponent actually never checks behind with King high, but does with A high ? (which is very possible as some players check behind a high expecting it can win showdown but has no value to bet, and bluff there K high hands so that opponent might fold A high or bottompair)
Then doesn't the "gto" strategy, get it wrong? I guess I am saying that the nash eq strategy would not make an assumption like this that the opponent will check behind more often with K high. It cannot make these kind of assumption on player ranges in specific spots, if it did, it would be exploitable. The "bot" cannot assume that K high is more often in the range of a player checking behind in this spot then A high.

I realize i probably misunderstood something along the lines of the first player is doing that because it is playing optimal against what the second player "should" do. It is interesting to note though, that if the GTO is doing as you say and making plays like the one you detail, by using what the "optimal" range of the opponent is, it seems that it could be making "mistakes" against someone NOT using those "optimal" ranges, and therefore calls into question whether or not the bot would even make plays like this.
Re: last sentence 1st paragraph:
Yes, the bot can "assume" that if it is the best response. A GTO/NE bot is playing the best response to itself, thus if doing something w/ range x is the best play vs the bot then the bot is also playing the best response to that something. The bot doesn't care whether it is right or wrong, because when its opponent deviates from GTO strategy the bot gains.

Re: 2nd paragraph:
If by "make mistake" you mean use a less profitable strategy than one that is purely exploitive, then yes a GTO bot can "make a mistake" in any given scenario.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:15 PM
Quote:
Originally Posted by ibang4aliving
nah thats wrong..
The whole concept of an equilibrium is that nothing changes. In a Nash Equilibrium, nothing changes because neither player has strict incentive to change. Therefore, the Nash Equilibrium is where both players are playing a best response to their opponent. Because of this unchanging equilibrium, a NE player would never have a varying 3bet % - his strategy is set and he has no incentive to change it. Because a NE player would never have a varying 3bet %, his NE opponent would not have a 4bet % using the 3bet % as an input variable (a varying 4bet %) - he is already playing a best response to the best response.

You are thinking more about creating a maximally exploitative bot, and I think your point could be valid. It does not apply to a Nash Equilibrium bot, though.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:36 PM
Quote:
Originally Posted by bware
The whole concept of an equilibrium is that nothing changes. In a Nash Equilibrium, nothing changes because neither player has strict incentive to change. Therefore, the Nash Equilibrium is where both players are playing a best response to their opponent. Because of this unchanging equilibrium, a NE player would never have a varying 3bet % - his strategy is set and he has no incentive to change it. Because a NE player would never have a varying 3bet %, his NE opponent would not have a 4bet % using the 3bet % as an input variable (a varying 4bet %) - he is already playing a best response to the best response.
Ya I understand and agree with everything you say. Obv when both of them are playing their NE strategies they will not vary their frequencies based on other player frequencies because they already know the other players frequencies!!! My point is that there is nothing to guarantee that our bot's NE strategy doesn't contain an instruction line like "If he 3-bets x% call cx%" that would simply be "asleep" when the other player plays his NE (would be "asleep" because we would know his x due to knowing his strategy). BUT at the moment that the other player stops playing his NE strat then this line "wakes-up" and starts to vary depending on opponents x value!!

I don't doubt that when the other player plays NE strat our strategy is set I just question whether the instructions that have it being set could unset it when opponent stops playing his NE strat. Think about it.. its definitely not something obvious.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:45 PM
Quote:
Originally Posted by ibang4aliving
My point is that there is nothing to guarantee that our bot's NE strategy doesn't contain an instruction line like "If he 3-bets x% call cx%"
Yes there is....NE must play exactly the same against all opponents. The strategy is static....so every hand is played as if it was it's first hand against a totally unknown opponent.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-05-2012 , 11:50 PM
Quote:
Originally Posted by ibang4aliving
Ya I understand and agree with everything you say. Obv when both of them are playing their NE strategies they will not vary their frequencies based on other player frequencies because they already know the other players frequencies!!! My point is that there is nothing to guarantee that our bot's NE strategy doesn't contain an instruction line like "If he 3-bets x% call cx%" that would simply be "asleep" when the other player plays his NE (would be "asleep" because we would know his x due to knowing his strategy). BUT at the moment that the other player stops playing his NE strat then this line "wakes-up" and starts to vary depending on opponents x value!!

I don't doubt that when the other player plays NE strat our strategy is set I just question whether the instructions that have it being set could unset it when opponent stops playing his NE strat. Think about it.. its definitely not something obvious.
You're somewhat right in that GTO, at least in some games, has exploitive plays 'written in', even though they would never be used vs a GTO opponent. If you have quads on board in stud and the other player keeps calling bets, clearly there's no way to act 'as if' the opponent is playing GTO. However the GTO strat doesn't 'think' it's switching into explo mode at that point; it's just maximising vs the nemesis like it always does.

Opponent's frequency of taking any action doesn't come into it though.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
12-06-2012 , 03:33 AM
yeah im going to disagree and say a lot of top players dont and play more by feel. As long as their feel doesnt get "off" they're good, but those sorts of players can be a little more streaky and can get stuck in ruts. I mean I watched a bunch of PoorUser videos and I never thought the theoretical side of poker was his strength, but he had a good sense of where he stood in a hand.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote

      
m