Open Side Menu Go to the Top
Register
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc"

11-23-2012 , 04:23 AM
Quote:
Originally Posted by zachvac
So the only reason one is solvable and the other isn't is because it's simpler? What if we use the numbers 1-5 instead? I'm trying to come up with something that still has the element of standing pat you seem to think defies having a NE but being simple enough for me to actually come up with what that NE (or if there is none prove there is none, but that won't happen because you're wrong) is. It would probably take a computer to come up with NE in that other example whereas the 1-3 game I could solve pretty easily by hand.
Well in the 1-3 game, if you called against a stand pat with the 2 with any frequency at all, then the counter strategy is to only ever pat with the 3, and then the counterstrat has an instant edge. So the "solution" to the 1-3 game is then to never call against a pat with a 2 right?

But then If I have the 1, you either have the 2 or 3, and if I bluff every time I have the 1, you need to call me with the 2 some of the time to gain an edge don't you? But only calling with the 3 should break even.

So am i right that the solution to the 1-3 game is just to never call with the 2?
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 04:28 AM
Quote:
Originally Posted by mperich
Dont understand why people keep trying to argue with ppl who obviously have no clue (except durrrr I guess since he wants to bet). Ike I would pm egj (author of slumbot)
Thanks! I'd been trying to dig up his contact info. I just PM'ed Mike Johanson of U of A.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 04:48 AM
Quote:
Originally Posted by ike
I don't know enough about the underlying AI but there are also a bunch of practical problems. It's not a format that lends itself to getting max hands/hr. It requires him to hang out in a casino all day with another independent observer to verify results. It's not very spectator friendly. Tom has expressed interest in using a HUD.

All that being said, if we can't find a better solution, I'd probably do that.
It doesn't adjust to your play. One reason to use it is that IGT might throw in some freeroll money for the publicity.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 04:57 AM
Quote:
Originally Posted by David Sklansky
It doesn't adjust to your play. One reason to use it is that IGT might throw in some freeroll money for the publicity.
I know it doesn't adjust, I just don't know much else about it. Who developed the AI? Has it ever been entered in a competition? Have any academics done an exploitability analysis on it? I know it's been seen making some obviously poor plays though I do have the impression that it's pretty strong overall.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 05:31 AM
This thread is surprisingly excellent.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 05:31 AM
if ever a thread deserved a its this one.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 05:50 AM
Quote:
Originally Posted by durrrr
GTO (game theory optimal) implies there is a solution for poker... like chess or backgammon etc. there isn't for hunlhe (or plo etc), and I'm very confident (but can't be sure b/c simpler game and I'm worse at it) there isn't for lhe etc. just about every good nlhe specialist disagrees with me on this... except jungle/galfond/few others who r actually good. altho i think galfond wasn't sure iirc or something like that (limit games probably ruined his brain).
Just because we don't know the solution to a problem doesn't mean that it doesn't exist. It can be proven that there exists a GTO Nash equilibrium for HU NLHE games - we just have not found it yet.

It can also be proven that there exists no exact solution to 3+handed games, but that there are good approximations that can lead to solutions.

Edit: darn, answered to early, people have already said what I said, sorry. Interesting thread, nonetheless!
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 05:56 AM
Quote:
Originally Posted by ScreaminAsian
it's weird to think that there's one GTO strategy when so many people are winning using much different strategies (isildur vs jman for example).
GTO does not mean "most profitable". Sadly the O in GTO confuses many people.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 05:58 AM
inb4 obama posting itt
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 06:00 AM
Didn't Hoss_TBF play a bot a few years back for x amount of hands. I can't find the details but i think it was this program

http://en.wikipedia.org/wiki/Polaris_%28poker_bot%29
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 08:05 AM
Quote:
Originally Posted by jusgivithere
Not if I decide I am going to PAT every single hand, then I am exploiting a supposed GTO strategy, because it cannot adjust to that. Basically I dont think there is a calling frequency for this spot that is both going to have positive expectation vs
1.someone who is patting every hand,
2. someone who is patting some made hands and some bluffs

3.someone who is only patting made hands

I don't think a calling frequency exists that will have positive expectation against all 3 of those patting strategies simultaneously.
I'm not an expert on game theory, and I have pretty much no draw poker experience, but I think there are some flaws in your logic here. First, you seem to be assuming that a GTO strategy is going to be very passive (either it calls down or it folds) when in reality it will probably be quite aggressive and putting you in lots of tricky spots. Second, you're neglecting what happens with the rest of your range when you don't pat all of it. Suppose you only pat with good made hands and never bluffs: it is entirely possible that, in hands where you pat, you win money in the long run vs. GTO play. However, because you are never patting with bluffs, you have more air in your non-patting range, it becomes weaker, and your strategy, as a whole, loses money.

Conversely, suppose you pat every hand. You will probably successfully bluff a GTO player out of more pots than you should. This doesn't mean that you are beating it, however, because when it *does* call you down, your range will be so weak that you are getting killed, and, on the whole, you are losing money.

In other words, it's easy to tune a strategy to beat, or even crush, GTO play in certain specific scenarios, but by doing so, you hurt yourself in other scenarios in a way that doesn't favor you. It's a bit like how a maniac will shove all in with air ten times in a row and keep picking up the pot and laughing to himself about how exploitable everyone is... until the eleventh time when someone wakes up with a hand and he bluffs his stack off.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 08:09 AM
Quote:
Originally Posted by ToDeepToFold
Didn't Hoss_TBF play a bot a few years back for x amount of hands. I can't find the details but i think it was this program

http://en.wikipedia.org/wiki/Polaris_%28poker_bot%29
Another Mike Johanson quote (from the same HULHE thread cited earlier):

Quote:
In 2007, Polaris played against Phil Laak and Ali Eslami in the first Man-vs-Machine match, and the humans won by a small margin. We used a couple of different strategies in that match, but we now know that the one that was closest to equilibrium was beatable for 275.88 mb/g. That's 13 big bets per hundred, which is huge. Keep in mind that this is really is the worst-case performance, against an opponent that knows every detail of the strategy. It's unlikely that anyone (human or computer) that doesn't know Polaris' strategy could pull off a win rate close to that without being lucky. Still, Polaris 2007 was beatable, and while it was designed to be close to an equilibrium strategy, it wasn't there yet.

In 2008, the next version of Polaris played against Matt Hawrilenko and several other heads-up limit hold'em specialists in the second Man-vs-Machine match, and Polaris won by a small margin. Polaris switched between 5 strategies during each match, and it's tough to tell how far from equilibrium the whole system was. However, we can evaluate each of the 5 strategies individually. The one we intended to be closest to equilibrium was beatable for 235.294 mb/g, a decent improvement over our 2007 program. That's still a loss of 11.75 BB/100 against a perfect opponent, so it was still far from equilibrium, but that was apparently good enough to compete with top humans. The most aggressive strategy from Polaris 2008 was a little bit less exploitable, at 227.457 mb/g. Even though excess aggression is a "mistake" in a game theoretic optimal sense (that is, if all you care about is protecting yourself against a perfect opponent), it looks like the aggression protected some of the other holes that Polaris 2008 had.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 08:21 AM
It's really important to appreciate the distinction between "We know a GTO strategy exists" and "We know what the GTO strategy is". It is known that there is a GTO strategy for heads-up poker (as sauce and ike explained, that is Nash's proof). Additionally, because poker is a game of hidden information, we know that the solution is a Nash equilibrium in mixed strategies, in other words, what the strategy gives us at each step is a weighted distribution of actions which we sample from randomly (I don't remember the name of the proof of this and can't be arsed to look it up). We do not currently know the GTO strategy for any real heads-up poker game. If we did, the game would be declared "solved", as has happened for RPS, noughts and crosses, and less-trivially drafts, for example.

Now when people say "would a GTO bot adjust"? A lot of further misunderstanding creeps into the debate. A GTO strategy for a game is by definition a total strategy for the game - that is, it specifies exactly the optimal thing to do at every possible decision point in the game based on all available information. So it would of course do something differently in a draw game if you drew two versus if you drew one - it would do the optimal thing in each case.

Last edited by huntse; 11-23-2012 at 08:25 AM. Reason: Add point about mixed strategies.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 08:27 AM
Ok, finally read this long thread to the end. And a few very good posts in there, seriously!

a) As many have noted, durrrr is completely wrong. You can prove that there are (is a) solution(s) to a theorem without solving it. I do hope he takes on a bet, though.

b) Game Theory Optimal in general terms for poker sakes can be summarized as the balanced strategy that maximizes value. In that sense, you strive for unexploitability from your opponent. We had this discussion some time ago when people were wondering if c-betting 100% HU in LHE was GTO (probably not, but it is at least balanced and unexploitable). http://forumserver.twoplustwo.com/35...ology-1218514/

c) afaik (and I am NOT up to date with this) there still isn't a complete GTO solution for HU LHE even, though there are pretty large solution branches of the game tree tackled. Naturally it follows that NLHE HU has not been solved.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 08:31 AM
ok so GTO is a strategy employed in a way which isn't exploitable no matter what the opposition does? for some reason i just can't get my head round this even being possible, i get that 2 player games like chess is solveable (no incomplete information/luck involved?) but how is a hu game like poker which includes incomplete information (how does it calculate card removal? -mucked cards/villain's holecards) wouldn't this be important in figuring out what the most optimal line would be in any given spot that isn't exploitable?

also how do you confirm that a bot is actually playing 100% perfectly without a human actually knowing what a GTO game looks like?

(assuming this lhe bot is really good which i guess is the case ) won't the biggest edge be the bot/computer playing their A game (this "apparent" GTO strategy) no matter if it's losing or winning? is 100k hands even enough to determine if this GTO bot is even profitable vs a human or vice versa?
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:07 AM
Quote:
Originally Posted by ike
You're wrong about this. Discarding is an action in a draw game. A GTO draw bot would take account of draw decisions just the same as it would take account of whether you called or 3bet preflop.
I was definitely wrong. Thinking about things in terms of state was confusing the matter. The state itself doesn't change but the action of discarding introduces new strategies that could potentially exploit a strategy that does not consider it.

I think a lot of other people were also confused about this and it's not easy to explain in a fashion that gets by the intuitive but incorrect issue that it must be making 'assumptions' about your range if it does respond to somebody drawing. But it's not really making assumptions about your range so much as compensating for the fact that the the max potential strength of your range has been increased.

I think the stand pat issue in draw is actually a great way to elaborate upon that. If I'm not mistaken them we get the very counter intuitive result that the GTO play for the bot against a person who stands pat would be very near identical to somebody who draws 5. But further more there seems to be an even more counter intuitive issue that the bot may need to actually treat the person's range who draws 5 as very slightly stronger than the person who stands pat since if the person only draws 5 when they have unpaired/low cards below 'x' then card removal would result in a presumably very slightly stronger random 5 card draw versus the initial deal. I realize that sounds crazy so I'd appreciate some feedback there as I'm not exactly ignorant on this topic but obviously also not quite educated enough!
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:08 AM
Durrrr is obv wrong itt: poker is solvable; a GTO solution exists (though we haven't yet found it); you can't beat it by "i can play similarly back but exploit occasional spots and you won't be sure if I'm doing that"

I would be very surprised if Galfond or Jungleman came in here and confirmed this:
Quote:
just about every good nlhe specialist disagrees with me on this... except jungle/galfond/few others who r actually good
Not that I doubt durrrrs integrity, I just think there must have been some misunderstanding, perhaps caused by the lack of understanding this demonstrates:
Quote:
someday when i have more time on my hands i'll explain y this is wrong- but it clearly will take a while. If i had to disclose my strategy to u and u to me n we played then theres an optimal strategy (i think this is nash equilibrium but it doesn't interest me so i dunno much abt it). if you play a strategy that is the most optimal were i to know it... then ur gonna lose a lot- b/c its pretty easy to figure out what that is, and i can play similarly back but exploit occasional spots and you won't be sure if I'm doing that. if you then adapt ur play based on how I'm playing u aren't playing GTO anymore (GTO is a strategy that doesn't need to be adapted).

edit: i think most (probably all?) 2player games are solvable unless they involve incomplete information (and some of those are but only the very simple ones).
btw, on the final point in that quote, incomplete information doesn't prevent a game from being solved, it just means that the GTO solution will include randomization.

Regarding the challenge, 2 possibilities:

(1) Bot strategy is not disclosed in advance: Durrrr has (ignoring variance miracles) no chance (don't waste your money!)

(2) Bot strategy is disclosed to Durrrr (a reasonable time) before the match: Durrrr can beat it for a small amount (ex rake) if he bothers to do the work (and has the processing power) in advance to identify the optimum counter-stategy (this assumes he is allowed to use computer help when he plays btw).

Last edited by raidalot; 11-23-2012 at 09:30 AM. Reason: fixed quote box
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:14 AM
Quote:
Originally Posted by partywme
ok so GTO is a strategy employed in a way which isn't exploitable no matter what the opposition does? for some reason i just can't get my head round this even being possible, i get that 2 player games like chess is solveable (no incomplete information/luck involved?) but how is a hu game like poker which includes incomplete information (how does it calculate card removal? -mucked cards/villain's holecards) wouldn't this be important in figuring out what the most optimal line would be in any given spot that isn't exploitable?

also how do you confirm that a bot is actually playing 100% perfectly without a human actually knowing what a GTO game looks like?

(assuming this lhe bot is really good which i guess is the case ) won't the biggest edge be the bot/computer playing their A game (this "apparent" GTO strategy) no matter if it's losing or winning? is 100k hands even enough to determine if this GTO bot is even profitable vs a human or vice versa?
I'm not sure exactly how one goes about proving that a strategy is GTO, but I imagine it involves absolutely immense amounts of computerized number crunching to analyze every possible situation. HU limit is close to solved because it has relatively few situations, but the number explodes exponentially as you add in more players or variable bet sizes. I think it's likely that we won't see someone solving GTO NLHE within our lifetimes (though we will probably see bots more than good enough to beat the best humans).
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:16 AM
Quote:
Originally Posted by zachvac
You'd be wrong. Can we simplify the game a bit more?

1. both players ante 1 unit and are dealt a random number 1-3
2. Player 1 gets a chance to either stand pat or re-draw, then gets the chance to bet 2 units (pot-sized bet) or check
3. If faced with a bet, player 2 may fold or call, if player 1 checks hand goes to showdown
4. the player whose hand is the bigger number wins the pot, they split the pot if they have the same number

I currently have no idea what the gto solution would be but I'd be willing to bet (or if you don't want to bet might just do it for fun anyway) that I can come up with a strategy that is gto, that is no matter what you do assuming we each get to be player 1 and player 2 an equal number of times you will not come out ahead. Interested in a bet?
This is like betting you can make one and one add to two.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:18 AM
Quote:
Originally Posted by Do it Right
But further more there seems to be an even more counter intuitive issue that the bot may need to actually treat the person's range who draws 5 as very slightly stronger than the person who stands pat since if the person only draws 5 when they have unpaired/low cards below 'x' then card removal would result in a presumably very slightly stronger random 5 card draw versus the initial deal. I realize that sounds crazy so I'd appreciate some feedback there as I'm not exactly ignorant on this topic but obviously also not quite educated enough!
I think that's wrong. Someone who has a legitimate pat hand (straight or better) will never draw, which skews the range for a pat hand after the initial deal upwards enough to offset the card removal effect in any mixed strategy that includes either standing pat or drawing.

Interesting discussion btw.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:22 AM
Quote:
Originally Posted by hopefull12
Why GTO is unobtainable. For every player that you're playing, you don't know
how many hands you'll be playing with him in the future. Because he could go
broke and leave poker, or you could go broke and leave poker.

The GTO play where you "know" that you'll be playing him for 300,000
more hands is different from the GTO play where you "know" you'll
have only 250 more hands against him.

Just an idea.
You don't have to consider specific opponents when playing GTO. You only have play different depending on what your cards are and te bet to pot size ratio.

Edit: and your opponents previous action

Last edited by manjondeere; 11-23-2012 at 09:49 AM.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:24 AM
Quote:
Originally Posted by manjondeere
You don't have to consider specific opponents when playing GTO. You only have play different depending on what your cards are and te bet to pot size ratio.
... and a few other factors
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:25 AM
durrrr i like you but please don't waste your money against the limit bot. you stand no chance.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:28 AM
wow this thread really delivered.
and is uber interesting
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote
11-23-2012 , 09:28 AM
Quote:
Originally Posted by bellatrix
c) afaik (and I am NOT up to date with this) there still isn't a complete GTO solution for HU LHE even, though there are pretty large solution branches of the game tree tackled.
I understand there are still very large simplifications/groupings to reduce the game tree by orders of magnitude.
Hoss_TBF: "All top players use game theory, distributions, bluff ratios etc" Quote

      
m