Open Side Menu Go to the Top
Register
CoTW: Why all-in-EV is a horrible measure of overall luck CoTW: Why all-in-EV is a horrible measure of overall luck

07-12-2010 , 08:09 PM
I'm an engineer with a pretty good grasp of statistics and probability (or so I thought) but reading through this thread just gave me a major brain cramp!!
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-12-2010 , 09:45 PM
Quote:
Originally Posted by AnAnonymousCoward
I'm an engineer with a pretty good grasp of statistics and probability (or so I thought) but reading through this thread just gave me a major brain cramp!!
Could you be more specific? Was it completely unintelligible start to finish or where there particular parts that caused cramps? If the later, please list them.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-12-2010 , 09:52 PM
Quote:
Originally Posted by Marshall28
If I shove and he calls, my actual money won will be whatever the size of the pot is if I hold. However, for AIEV, the number will be fixed given the odds I have of winning the pot on the river. If I just call the turn, yes sometimes he will have a bigger set and I'll lose when I call the river, but now we aren't counting all the times he bluffs the river. My edge is bigger when just calling the turn, but in these circumstances when I am ahead on the turn and my opponent gets there on the river, AIEV is saying I'm playing poorly compared to actual money won when I'm actually playing better.
Can't tell what you're saying but AIEV only measures after all-in and it doesn't say anything about how you're "playing poorly". It simply says how good you're running when all the money is in. Also you're ignoring the times when you flat turn and villain does NOT get there on the river.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-12-2010 , 10:08 PM
Quote:
Originally Posted by Marshall28
when I am ahead on the turn and my opponent gets there on the river, AIEV is saying I'm playing poorly compared to actual money won when I'm actually playing better
No, AIEV +/- is never an indication of whether you are playing poorly or not. If you are down overall and AIEV is also negative, it is one possible reason among many for some of your losses. Blaming the loss on all-in luck would be a mistake. You could have good luck in other areas cancelling that out, and net losses could be entirely due to bad play.

Last edited by spadebidder; 07-12-2010 at 10:16 PM.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-12-2010 , 10:32 PM
Quote:
Originally Posted by funkyj
Could you be more specific? Was it completely unintelligible start to finish or where there particular parts that caused cramps? If the later, please list them.
Oh no, I didn't mean it that way at all.

More like a "I hadn't really considered all of this, although I probably realized it on some base level, and now trying to wrap my brain around all of the math presented to me makes my head spin FML" kind of way.

I think that you did an excellent job presenting the material, and generating intelligent discussion on the topic. Fine work, sir.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-15-2010 , 05:38 AM
Quote:
Originally Posted by SammyG-SD
pick up any DE, or operational research book.
Okay, bad question, bad answer. I hope you have phd in maths/stats/etc. I just dont buy it and don't have the time to go over the whole field of OR just to get that one fact, which is totally irrelevant as OP messed up anyway and I don't think that OP knows sth about OR/DE.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-15-2010 , 04:50 PM
Quote:
Originally Posted by zocketpocket
I run way above ev for the last 3 years. Any idea why?
Yes...because someone has to balance out the universe to compensate for people like me on the other end of the spectrum.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-15-2010 , 05:12 PM
Quote:
Originally Posted by Pahvak
Okay, bad question, bad answer. I hope you have phd in maths/stats/etc. I just dont buy it and don't have the time to go over the whole field of OR just to get that one fact, which is totally irrelevant as OP messed up anyway and I don't think that OP knows sth about OR/DE.
how is this, anything sample or that is statistically represented is discrete by definition. Then they use mathematical modelling to try to recreate the continuous behavior believed to be observed in natural systems. But as Nyquist and Euler both pointed out those can only be accurate based on the 'sample rate' compared to the arbitrary units used to describe one of the dimensions.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
07-15-2010 , 05:15 PM
Quote:
Originally Posted by SammyG-SD
how is this, anything sample or that is statistically represented is discrete by definition. Then they use mathematical modelling to try to recreate the continuous behavior believed to be observed in natural systems. But as Nyquist and Euler both pointed out those can only be accurate based on the 'sample rate' compared to the arbitrary units used to describe one of the dimensions.
"Math is idiotic".

- borrowed from Barry Greenstein.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
08-10-2010 , 04:08 PM
Quote:
Originally Posted by brocksavage1
"Math is idiotic".

- borrowed from Barry Greenstein.
Agree with op. Would like to add that poker tracker just doesn't calculate aiev correctly. It omits a lot of allin hands for some reason. That said, I still feel really sorry for people running horribly below expectation. Its not the only kind of luck, or even the most important one, but its the most in your face.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
08-18-2010 , 03:20 PM
So in my HEM i filtered out all in pots and it said my Std Dev was 37.7BB. With all ins factored in it is 52.97BB. So would this mean All ins are 15.27/52.97 = 28.8% of our overall variance?
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
08-31-2010 , 09:18 PM
Very interesting thread IMO. Too bad no one has calculated aa AIEV standard deviation so far. So I sat down and wrote a small program that reads hem's .csv-file and calculates the standard deviation of the all in ev adjusted winnings. It calculates the "normal" standard deviation as well, and this one matches with HEM, so it should be accurate.

And here are the results (for my actual db, all 6max NL100 fwiw):

Hands: 46,986
standard deviation: 53.67 BB/100
AIEV standard deviation: 47.2 BB/100

just for the sake of comparison:
hands with >0 % and <100 % equity: 410 = ~0.87/100 hands




Quote:
Originally Posted by Seven7s
So in my HEM i filtered out all in pots and it said my Std Dev was 37.7BB. With all ins factored in it is 52.97BB. So would this mean All ins are 15.27/52.97 = 28.8% of our overall variance?
No. You can't just filter out all the all in hands, because they contain a lot of non-all-in-variance as well.

Last edited by Kornspitz; 08-31-2010 at 09:30 PM.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
09-01-2010 , 10:15 PM
Quote:
Originally Posted by Kornspitz
Very interesting thread IMO. Too bad no one has calculated aa AIEV standard deviation so far. So I sat down and wrote a small program that reads hem's .csv-file and calculates the standard deviation of the all in ev adjusted winnings. It calculates the "normal" standard deviation as well, and this one matches with HEM, so it should be accurate.

And here are the results (for my actual db, all 6max NL100 fwiw):

Hands: 46,986
standard deviation: 53.67 BB/100
AIEV standard deviation: 47.2 BB/100

just for the sake of comparison:
hands with >0 % and <100 % equity: 410 = ~0.87/100 hands






No. You can't just filter out all the all in hands, because they contain a lot of non-all-in-variance as well.
What? By filtering them out it shows you what your standard deviation is without all ins. When you filter them back in it's combining both. With no all ins your variance is X, with all ins factored back your variance is XY. Therefore it keeps the relativity.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
09-05-2010 , 04:52 AM
Quote:
Originally Posted by Seven7s
What? By filtering them out it shows you what your standard deviation is without all ins. When you filter them back in it's combining both. With no all ins your variance is X, with all ins factored back your variance is XY. Therefore it keeps the relativity.
The problem is that you are filtering out the whole hands where you were all in, and not just the all in luck. What we want to filter out is just the variance AFTER the action was closed. If you filter out the whole hand then you filter out as well the variance BEFORE that.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
09-06-2010 , 10:02 PM
Quote:
Originally Posted by Kornspitz
The problem is that you are filtering out the whole hands where you were all in, and not just the all in luck. What we want to filter out is just the variance AFTER the action was closed. If you filter out the whole hand then you filter out as well the variance BEFORE that.
right. the most natural way (IMO) is to replace AIEV hands results with their EVs. This removes AIEV variance yet keeps all the other variance (e.g. how frequently you give or receive coolers).

The advantage of seven's approach is it is easier to do -- no new coding required, just apply a filter.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
09-07-2010 , 12:21 AM
Quote:
Originally Posted by TacticalCoder
+1 to zachvac and +1 to mpethybridge!

Time to shime in...

Tiny background: I've written a $AIEV engine that can import (from scratch) and perform $AIEV computation as fast as 17 000+ hands per second (it's not a typo). One beta-tester managed to reach such speeds on an octo-core (granted, on a normal machine you'll 'only' be running at 2000 or 3000 hands per second). So using that software I wrote, you can import 2 million hands in less than two minutes and instantly plot a shiny real results + $AIEV graph

First, the title of this CoTW is a strawman right? It's a logical fallacy, but I'm not sure of it's name (I'm not a native english speaker).

It says "Why all-in-EV is a horrible measure of overall luck" but nobody ever said that. Never ever. It has already been pointed in this thread but it bears repeating. This entire CoTW is a strawman.

Neither the HEM nor the PT3 definition are saying it's a measure of overall luck.

zachvac is right on spot with this: if you think that money won is a better indication than the all-in ev line is of expected winnings you have a super flawed understanding of what ($AIEV) luck means and what all-in ev is.

The $AIEV is computed when perfect (spacebidder would say near perfect) information is available: an $AIEV computation for a particular has no "past memory" (no betting history, no nothing). The only thing an $AIEV does is computing the indisputable mathematical expectation value once perfect information is available (what happened previously in the deal has no effect and no player action can happen anymore).

What that value represent is very simple (yet very often not understood at all, including by people with 4-digits+ posts).

The $AIEV represents your actual results, from which one luck factor, namely the variance associated to pre-river all-in luck, has been removed. If you believe this is pointless, then you should never ever look at your real results, because they're even more pointless

The only thing that is right is that there's a TINY card removal effect. The one spacebidder is talking about, altough he's IMHO unnecessarily dramatizing the effect of card removal in that case. It is tiny. It has nothing to do with the bias in the street-by-street-EV-mega-fiasco towards hands that hit the board/are willing to go to showdown.

From spacebidder's very interesting research, you can see that an ace is actually 2.5% less likely then what "normal" AIEV computation consider and a deuce 2.5% more likely or so.

Let us now be serious: an all-in occuring at flop means there are, typically, C(45,2) possibilities to run to do a full exhaust. How much do you think having a deuce 2.5% more likely and an ace 2.5% more likely will change the mathematical expectation of the $AIEV? It is going to be tiny. Negligible. I'm willing to change my $AIEV engine for research purpose to take spacebidder's numbers/card removal effect into account but I'm not holding my breath: it is going to be a tiny insignificant number.

Even by taking this tiny card removal effect into account, the $AIEV still gives a number that is going to be much closer to your theoretical results than your real result.

In addition to that, there's something else very important to point out: if you sum the "$ - $AIEV" of all the players in your DB, then it will add up to exactly... zero! (or your $AIEV engine is severely broken).

So, ok, there's a tiny card removal effect, but for each deal, either the fact that an Ace is 2.5% less likely will either disadvantage you or advantage you OR neither advantage nor disadvantage you (because both you and your opponents are affected in the same way by the tiny card removal effect). And unless you have a very weird playing style, the tiny card removal effect will tend to always cancel out (for all the allins it is going to advantage you, you'll have about the same number of allins where it is going to disadvantage you).

So IMHO even if we consider the tiny negligible card removal effect that spacebidder is taking into account, it will totally cancel out.

On the subject of rake: my tracker performs all the $AIEV computation, for every pot, with the pot amount after the rake has been deduced. There's zero rake issue in that computation, it's a non-existing problem.

A CoTW entitled "What is really the $AIEV"" would have been much more constructive. But here I'm tempted to call this whole CoTW strawman and FUD because once again: nobody ever said that the $AIEV was a measure of overall luck

A thread wouldn't be complete without a car analogy right?

"CoTW: Why a Formula 1 is a horrible car to win Pike's Peak"?

A Formula 1 is a horrible car on gravel, hence it is useless.

Erf, what!? It is useless to win Pike's Peak, sure. Just as the $AIEV is useless to measure overall luck. That's not what a Formula 1 does. That's not what the $AIEV does. It makes neither of them useless.

And most of all, it makes absolutely zero sense to start a discussion around the "concept" of "Why a Formula 1 is a horrible car to win Pike's Peak"...

Once again, zachvac is right on spot: if you think that money won is a better indication than the all-in ev line is of expected winnings you have a super flawed understanding of what ($AIEV) luck means and what all-in ev is.

Now I'm a stupid person: I just managed to connect two neurons to write a software able to import at speed up to 17 000+ hands/second (and which also can do things like 3-ways preflop ranged "22+ vs AJs+ vs 88+" full enum 40 times faster than PokerStove) and maybe I'm all wrong on this

But still, I stand with zachvac.

The $AIEV problem is people thinking that it's a measure of overall luck and people saying that the $AIEV is useless because it's not a measure of overall luck.

Now I'm willing to modify my $AIEV engine for research purpose if someone is willing to send me 50 000 or so deals with an all-in postflop (and pre-river) [that should amount to 8 MB zipped or so] and put the numbers spacebidder came up with and see what gives. I shall show a tiny insignificant card removal effect that tends to always cancel out...

IOW the $AIEV adjusted using spacebidder's numbers will be very close (nearly identical) to the plain $AIEV and it will still be a much closer representation of your theoretical winrate than what your actual results are.

I'm all for a "CoTW: Really understanding what the $AIEV is", made using math and logical argumentation, not logical fallacies
BOOM. Long read but worth it.

Just quoting this bc whoever still is reading this thread should just read this and then move on with their life.

Simple-minded summary: AIEV is not a good measure of luck indeed, but that doesn't mean it's useless. Even though not 'correct' it's the best measure there is your performance.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
09-07-2010 , 06:14 PM
I read the OP and most of the replies. I still don't really understand what all this really means (English isn't my motherlanguage and tbh I'm not so good at math). I was just wondering if somebody could break it down for me in simple English?
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 03:11 PM
Since this thread is filled with much smarter people than me, I hope this question doesn't sound stupid.

Is it correct to say that all-in-ev only acounts for a small % of luck, but it is still a better performance measure than your actual results?

If this is true, is it safe to say the more hands you play, the closer your actual results gets to your theoretical results and your actual results become a better performance measure than all-in-ev? Like 1mm+ hands.

Or, will all-in-ev always be a better measure, even if you play 20mm hands?
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 04:16 PM
Quote:
Originally Posted by KingKongGrinder
Since this thread is filled with much smarter people than me, I hope this question doesn't sound stupid.

Is it correct to say that all-in-ev only acounts for a small % of luck, but it is still a better performance measure than your actual results?
Yes.
Quote:
If this is true, is it safe to say the more hands you play, the closer your actual results gets to your theoretical results and your actual results become a better performance measure than all-in-ev? Like 1mm+ hands.
No.
Quote:
Or, will all-in-ev always be a better measure, even if you play 20mm hands?
Yes. Computing all-in EV removes one element of luck from the equation, while a lot of others remain.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 05:15 PM
Quote:
Originally Posted by Cangurino
Yes.

No.

Yes. Computing all-in EV removes one element of luck from the equation, while a lot of others remain.
I was just thinking that at some large amount of hands all the luck is eventually removed and the gap between actual results and all-in EV is filled with the luck we can't account for, but know exists. I guess that isn't correct. Thanks.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 06:26 PM
Quote:
Originally Posted by KingKongGrinder
I was just thinking that at some large amount of hands all the luck is eventually removed and the gap between actual results and all-in EV is filled with the luck we can't account for, but know exists. I guess that isn't correct. Thanks.
It sounds like you are talking about the fallacy of "it all evens out in the end".

No, normal (or binomial) distributions are still normal (binomial) no matter how big the sample.

As the sample size gets bigger your actual results tend to move farther and father from the mean in absolute (e.g. dollars) terms.

E.g. if you WR is +8 bb/100 (a really good WR) but you are very unlucky (your actual performance is always -2 stddevs) then you will win money in the long run but start off a loser.

What does happen is that as the sample size gets bigger and bigger, your win rate (i.e. your +ev decisions) dominates variance more and more.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 06:29 PM
so you guys still making CoTW to make the games harder??? great success.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
10-06-2010 , 09:40 PM
Quote:
Originally Posted by funkyj
As the sample size gets bigger your actual results tend to move farther and father from the mean in absolute (e.g. dollars) terms.
This is very slightly incorrect, but the difference is critical. The correct statement is, as the sample size gets bigger the average result will tend to be farther and farther from the mean in absolute terms. Not "your actual results".

What this means is that the average offset from the mean tends to get bigger, with average here referring to the average sample or average player. It does not mean that a particular player can expect their offset to continue to grow with the sample size. The future expectation for any specific player is that their offset remain exactly where it is right now, forever. Their future random walk is about that point (where they are now) not about absolute zero.
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
12-02-2010 , 01:02 AM
Nice!
CoTW: Why all-in-EV is a horrible measure of overall luck Quote
12-02-2010 , 03:10 AM
Quote:
Originally Posted by funkyj
As the sample size gets bigger your actual results tend to move farther and father from the mean in absolute (e.g. dollars) terms.

E.g. if you WR is +8 bb/100 (a really good WR) but you are very unlucky (your actual performance is always -2 stddevs) then you will win money in the long run but start off a loser.

What does happen is that as the sample size gets bigger and bigger, your win rate (i.e. your +ev decisions) dominates variance more and more.


Quote:
Originally Posted by spadebidder
This is very slightly incorrect, but the difference is critical. The correct statement is, as the sample size gets bigger the average result will tend to be farther and farther from the mean in absolute terms. Not "your actual results".
last I checked "average" in statistics means "mean". EV is a weighted average i.e. the mean value expected. So actually the average will always be the same as the mean or EV because, by definition they are the same.


Quote:
What this means is that the average offset from the mean tends to get bigger, with average here referring to the average sample or average player.
again, from what I've read, when we are talking about normal distributions (or binomial distributions, for which a normal is often a reasonable approximation) we use "standard deviation" to describe the probability distribution of values away from the mean (EV). I'm not sure what this "average offset" you speak of is. A quick googling did not enlighten me.

Quote:
It does not mean that a particular player can expect their offset to continue to grow with the sample size. The future expectation for any specific player is that their offset remain exactly where it is right now, forever. Their future random walk is about that point (where they are now) not about absolute zero.
by definition, is is more likely that you will perform closer to your EV rather than farther. OTOH, if you want to do worst case analysis, you typically pick some probabilistic threshold you are comfortable with (e.g. +- 2 stddevs) and base you analysis on that. E.g. the "20 buy-in rule" is based on assumptions about win rates, standard deviations and confidence intervals. It is a fact, that as the sample size gets larger, any fixed confidence interval (e.g. +- 1 stddev) gets bigger. This is what I mean when I say:

Quote:
Originally Posted by funkyj
As the sample size gets bigger your actual results tend to move farther and father from the mean in absolute (e.g. dollars) terms.
i.e. the minimum and maximum of what ever confidence interval you have chosen will grow father and farther apart as the sample size (e.g. number of hands played) grows bigger.

What I'm saying is that the signal-to-noise ratio improves as the sample size gets bigger which is just another way of saying that, in the long run, WR (a linear function) dominates stddev (a sqrt() function).

Happy nitpicking!
CoTW: Why all-in-EV is a horrible measure of overall luck Quote

      
m