Open Side Menu Go to the Top
Register
*SnG Solver* - open beta *SnG Solver* - open beta

09-09-2011 , 03:17 PM
Can you please make explicit how your program is substantially better than say, holdemresources.net with built in futuregames equity? This is what I mean specifically:

Holdemresources.net does the following, as you said it populates a tree with up to 3 people all in, using plain old ICM as the guess of the equity. Suppose holdemresources.net applied this recursively as necessary to the leaf nodes (based on some simple constraint), in order to update its guess of the equity at key leaves. Is this what your program does, or is there something stronger?

I mean, of course stronger, because you are claiming you have some ACM that makes naive evaluation (before chipflow processes) of the equity of an ordered list of stacks [under some underlying payout structure] stronger than ICM? Does it consider how many big blinds you have (eg. does naive ACM consider 10,10,10,10,10,10 to be the same as 100,100,100,100,100,100 ?) Is that what you have (a better naive eval of ICM)?... or do you just consider your more accurate evaluation of a players' equity (ICM+future games, which I call WCM) to be "ACM" in itself?

Also just to be clear I have read every paper about computing in poker there is, so feel free to be as specific as possible. Btw, it occurred to me to use MGA to clean up tables, but I'm not sure how solid that is.
09-09-2011 , 08:01 PM
Quote:
Originally Posted by sng_jason
I have contacted them about getting on their "white list", though I'm not sure how helpful this will ultimately be.

If you (or anybody having this kind of problem) could let me know exactly which of their products you're using (and exactly what version), it would be super helpful. That and at what point the trouble happens... e.g. the installer get quarantined right after download, or the app gets quarantined after running the installer, etc...
Im using Norton Internet Security 2011. As soon as the file is downloaded norton analyses it, as it does with all downloaded files. If norton considers the file dangerous it deletes it completely, and that is what happens with the exe file downloaded from your site. That is, as soon as it is completely downloaded it is first checked by norton and then deleted directly, it is not put in quarantine.

The update file was put in quarantine and could be restored, but not the main file

Mhv
Inga
09-09-2011 , 10:41 PM
mckrogh / double ice,

I'm not going to go into many more specifics beyond what I've already mentioned in this thread... at this time.

Re: comparing SnG Solver to what holdemresources.net does... This is another case where the *other* tool does not consider future rounds of play. If you set SnG Solver's "Advanced ICM Mode" to "off", I believe you will results similar to what you get from holdemresources.

Double, I'm a little confused by your choice of terminology. I define "ICM" to be any function that equates tournament chips to real money. I consider the algorithms written by Harville and Weitzman to be the "standard" ICM models. Finally, I define "Advanced ICM" to be the algorithm I employ in SnG Solver. The "Advance ICM" algorithm is very complex because it typically involves calculating many thousands of equilibrium push/fold strategies over a game tree that spans beyond the immediate hand... but at the end of the day, it still solves the equation $ = f( chips ). Granted, unlike "standard ICM", my algorithm does take stack positions and blinds as additional inputs.


Inga,

Thanks for the info. Wow, that situation is particularly brutal given the size of the download for the "full" install package. I will definitely be doing all I can to try to remedy this.
09-10-2011 , 11:11 AM
Quote:
Double, I'm a little confused by your choice of terminology. I define "ICM" to be any function that equates tournament chips to real money. I consider the algorithms written by Harville and Weitzman to be the "standard" ICM models. Finally, I define "Advanced ICM" to be the algorithm I employ in SnG Solver. The "Advance ICM" algorithm is very complex because it typically involves calculating many thousands of equilibrium push/fold strategies over a game tree that spans beyond the immediate hand... but at the end of the day, it still solves the equation $ = f( chips ). Granted, unlike "standard ICM", my algorithm does take stack positions and blinds as additional inputs.
So you agree that there is no difference in naive evaluation between standard icm and your icm [advanced icm]? That is to say, is BOTH of the following true:

1. Using only standard icm and future game evaluations, one can arrive at the same results you do

2. When future game evaluations are no longer allowed, when evaluating your advanced icm function on the current leaf node, is it different than evaluating the standard icm function on that same leaf node?
09-10-2011 , 12:39 PM
Why is the installer file so large? Does it contain a lot of precomputed data that is not yet/cannot be compressed? Just wondering. Testing it nevertheless ofc.
09-10-2011 , 03:11 PM
Quote:
Originally Posted by Double Ice
So you agree that there is no difference in naive evaluation between standard icm and your icm [advanced icm]? That is to say, is BOTH of the following true:

1. Using only standard icm and future game evaluations, one can arrive at the same results you do

2. When future game evaluations are no longer allowed, when evaluating your advanced icm function on the current leaf node, is it different than evaluating the standard icm function on that same leaf node?
No, I do not agree.

1) it is not enough to just apply standard ICM equations to future game nodes

2) if you disallow processing of future nodes, you are no longer doing "Advanced ICM". Ergo, if you apply "Advanced ICM" to a leaf node, you have created a paradox
09-10-2011 , 03:33 PM
Quote:
Originally Posted by cygenius
Why is the installer file so large? Does it contain a lot of precomputed data that is not yet/cannot be compressed? Just wondering. Testing it nevertheless ofc.
Yes, there is a lot of precomputed data... and it *is* compressed.

I do apologize for the size of the download, it couldn't be helped. Hopefully you'll find it was worth it.
09-10-2011 , 06:58 PM
So when I solve for BB 150 SB 75
UTG 10500
BTN 1500
SB 1500
BB 1500

button +ev push AQ+ 99+

seems pretty tight push range
09-10-2011 , 09:18 PM
I think it would be helpful if you could provide some worked analyses to better demonstrate why your program is giving better advice than say SNGWiz or the holdemresources.net NE calculator.

Juk
09-10-2011 , 09:29 PM
Quote:
Originally Posted by sng_jason
The future depth is always *at least* 1... that is, I always fully solve for at least the next hand. How far beyond that is somewhat variable... with extra depth focused on areas that are deemed to be more important. So I guess, yes, this does help minimize the "horizon effect" you mentioned. But I think also this is much less a problem for poker as opposed to, say, chess. In a game like chess, an entire branch of the game tree might have an actual "equity" of zero, but this is never true in poker. So, the effects of becoming "trapped" can never be as devastating.
Well the horizon effect can be seen pretty clearly when searching just 1 tier (ie: like the current software on the market does) so searching a fixed depth will also have the same problem (ie: UTG+1 search will suffer the same problems if you just search 1 more hand in to the future and so on).

The "with extra depth focused on areas that are deemed to be more important" comment though, it sounds like you are doing something akin to a "quiescence search" and if so this should lessen the problems associated with the horizon effect.

It would still be interesting to see how much difference you get between searches each depth in turn as this should help show where your idea is an improvement on current software (see my post above requesting worked examples, etc).

Quote:
And yes, I do use a standard (Harville) ICM to evaluate the leaf nodes... at least for now. But ironically, I might end up using a *worse* model (like proportional equity) in some spots instead because if faster leaf processing can lead to additional depth, the value of that depth can trump accuracy at the leafs.
Interesting - this is analogous to chess search too (ie: cheaper evaluations functions can often trump complex ones by searching deeper, although I agree the differences between child and parent evaluations is never going to be anything like as extreme). Have you done any experiments with this idea yet?

Somewhere on 2+2 there is a good thread about difference approaches to approximating tournament equity (you may well have read it already?) and IIRC, some of them are cheaper to calculate that ICM (although less accurate), but these may well be useful to you though.

Juk
09-12-2011 , 08:21 AM
Quote:
Originally Posted by jukofyork
I think it would be helpful if you could provide some worked analyses to better demonstrate why your program is giving better advice than say SNGWiz or the holdemresources.net NE calculator.

Juk
THIS
09-14-2011 , 04:24 AM
I love how I asked a simple question and I cant get a straight answer, is advanced ICM equal to ICM + future game considerations? Yes or no
09-14-2011 , 04:40 AM
Quote:
Originally Posted by Annuit20
THIS
OKAY

I think if we look at some basic numbers, some pretty clear distinctions will emerge. Lets compare some equity estimations between SitNGo Wizard, holdemresources.net, and SnG Solver. Calculating stack equity is going to be the *core* of any kind of strategy analysis we eventually want to make.

Lets imagine a simple scenario... but one where the players are short stacked, short handed, and near the bubble. We've got 5 players with 500 chips each. Blinds are 100/50 with a 500-300-200 payout structure.

So first thing actually, lets see what a "standard" ICM calculator will say about this scenario:

Code:
"Standard" ICM

      Equity
UTG:  200.0
CO:   200.0
BTN:  200.0
SB:   200.0
BB:   200.0
Since the standard ICM model only takes stack sizes and payouts as inputs, it can only think that equal stacks must have the same equity. Everyone (hopefully) knows this does not match reality. We know that the 500 chips on the BTN is worth more than the 500 chips UTG. We may not be able to say how much more, be we know that it must be more because of the advantage of position. So thats problem #1 for the standard ICM model.

Problem #2 is that it doesnt make sense that the SB and BB have the same equity since they are forced to commit some of their chips into the pot whether they like it or not. Clearly, they should have at least some amount of reduced equity relative to the BTN since they have donated chips to the pot that are now vulnerable to attack.

Already, it should hopefully be clear that standard ICM all by itself has some serious issues.


Okay, let put our scenario into the calculator at holdemresources.net:

Code:
holdemresources.net
ICM Nash Calculator Results

       EQ post
UTG:   209.4
CO:    209.4 
BTN:   209.3  
SB:    193.2   
BB:    178.7
Okay, well there's clearly some improvement in representing the loss of equity from the stacks in the blinds. But right away, we see the values from the other positions dont match what we know to be true in reality.

According to this anaylsis the stack UTG is more valuable than the stack on the BTN. If you were sitting at the BTN in this tournament would you want to trade seats with the UTG player? Me neither.


SitNGo Wizard doesnt seem to have an "equity display" that just shows the value of each stack (unless I'm missing something... someone please correct me if I am). But you can get a "EQ Fold" for each stack. This is not exactly the same thing as stack equity, but these values should follow the same pattern as what a calculated total equity would be.

Code:
SitNGo Wizard

      "EQ Fold"
UTG:  216.0
CO:   209.8
BTN:  203.7
SB:   189.5
BB:   168.3
Here again, we've got some numbers that are not what we should expect. Like holdemresrouces.net, SitNGo Wizard is also trying to tell us that the stack UTG has an equity advantage over the rest of the table.


So now lets see what SnG Solver says.

Code:
SnG Solver

      Equity    
UTG:  189.1  
CO:   216.4   
BTN:  218.3   
SB:   201.3    
BB:   174.9    
Ah ha! At last, some numbers that make sense... The BTN has the most equity, followed by the CO. Next, even though the SB has to put up some "dead" equity, the fact that it has good position (both for attack potential on the BB and that it has a long way to go before the blinds) has made up for it. Finally, the BB is clearly the loser here... lots of "dead" equity, it is vulnerable to attack and the next hand it must put up even more of its stack in the SB. These are numbers that are consistent with good poker thinking.... and therefore the best chance to a good foundation to support later analysis.

Again, I am not trying to bash either holdemresources or SitNGo Wizard... they have both been a tremendous benefit to the poker community. But its also true that they both have some fundamental limitations that keep their analysis from being the best possible.

Last edited by sng_jason; 09-14-2011 at 04:52 AM. Reason: typos
09-14-2011 , 04:47 AM
Quote:
Originally Posted by Double Ice
I love how I asked a simple question and I cant get a straight answer, is advanced ICM equal to ICM + future game considerations? Yes or no
Sorry, I'm not trying to avoid your question, but I think what you're asking is a little bit vague. I feel the phrase "ICM + future game considerations" can be interpreted a lot of ways.

If you're asking: "When calculating $ equity from tournament chips, does your Advanced ICM algorithm consider future rounds of play?" Then the answer is *yes*.

If you're asking: "Does Advanced ICM work by combining the Malmuth-Harville algorithm applied to future rounds with the Malmuth-Harville algorithm applied to the present round?" Then the answer is *no*.
09-14-2011 , 06:33 AM
Any news on the Symantec/Norton front?
09-14-2011 , 07:09 AM
Quote:
Originally Posted by myNameIsInga
Any news on the Symantec/Norton front?
I'm afraid not much. I have not received a response from them since requesting to be added to their "whitelist".

I have a few things I can try to make the installer seem "less threatening" that I do to the next update.

Until then there are maybe a few more workarounds in this thread:
http://community.norton.com/t5/Norto...ck/td-p/398696

And should you be inclined, you could submit a "false positive" report here:
https://submit.symantec.com/false_positive/

I will certainly update this thread with any new information I find.
09-14-2011 , 09:04 AM
Quote:
Originally Posted by sng_jason
Sorry, I'm not trying to avoid your question, but I think what you're asking is a little bit vague. I feel the phrase "ICM + future game considerations" can be interpreted a lot of ways.

If you're asking: "When calculating $ equity from tournament chips, does your Advanced ICM algorithm consider future rounds of play?" Then the answer is *yes*.

If you're asking: "Does Advanced ICM work by combining the Malmuth-Harville algorithm applied to future rounds with the Malmuth-Harville algorithm applied to the present round?" Then the answer is *no*.
Sounds like you know what you are talking about.

Looking forward to getting the HH import feature implemented, I can see this easily replacing sngwiz...
09-14-2011 , 10:27 AM
Hey I just downloaded the software but I am not receiving my key.


Nvm, just received it, took quite a while.
09-14-2011 , 02:08 PM
Why do some of the Equilibrium Strategy Tree results differ quite a bit from Nash results, when Advanced ICM is turned off?
09-14-2011 , 02:45 PM
I've noticed some errors with advanced icm on and off

example

400bb 200sb 40ante
advanced off

utg 3000 utg+1 2000 co 1200 btn 1800 sb 3800 bb 3200

when co pushes bb call range includes 23o but excludes 63o
09-14-2011 , 06:44 PM
SparkMan,

What do you mean by "Nash results" that you're comparing to whats in the Equilibrium Strategy Tree?

And when you say "errors", what are you using as the basis for comparison?
09-14-2011 , 09:15 PM
if you pokerstove 23o and 63o vs co push range 63o has higher equity and yet your app has 63o a fold and 23o a call
09-14-2011 , 09:20 PM
Quote:
Originally Posted by sng_jason
SparkMan,

What do you mean by "Nash results" that you're comparing to whats in the Equilibrium Strategy Tree?

And when you say "errors", what are you using as the basis for comparison?
Does the nash sng calculator not spit out equilibrium push and call ranges?
09-14-2011 , 09:32 PM
The ex I gave you NE has UTG pushing 26.7% and your equilibrium strategy tree has 16.7% with advanced ICM mode off

      
m