Open Side Menu Go to the Top
Register
Need help with RNG audit - Moved from BQ Need help with RNG audit - Moved from BQ

02-19-2018 , 04:06 AM
Hey guys,

I have a simple theory that I want to test in an online poker RNG audit. I want to see if any given player's chip losses (and wins) in previous hands have any influence on the performance of their hole cards in the next few boards on their table. So far I have transcribed the majority of a final table on Stars's Sunday Million from Feb 11, 2018 and my results seem to indicate that my theory is correct: players who lose chips receive winning hands (although they can be bluffed off of them), whereas players that make gains in chips are prone to being set up in bad beat situations. However it is a small sample size and I need to examine more data.

I was hoping there would be a few folks on here that have an idea of how to do this most efficiently. Ideal data would be from a broadcast with all players' hands shown. However, transcribing that data takes many hours if done manually. I would need: every players' hole cards (including those that fold), the cards that get dealt (if any), the stack sizes pre-flop, and the change in stack sizes from the previous board.

Ideas greatly appreciated. I know there will be a tendency to discuss rigged RNGs but I am just asking for help with planning data collection and analysis here.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 09:49 AM
Since an effective admin moved this thread here, I guess he didn't want to just delete this thread as it should have been done.

This type of thread has been created ad naseum since the beginning of online poker. The RNG for Pokerstars is routinely audited to ensure that it is truly random. No one has proven there is a deliberate bias at Pokerstars.

However, anything is possible. If you want serious help, the first step is to provide your "proof" that there is a bias. We don't need the raw data to start, but rather the sample size and your methodology of determining whether the next hand is a "good" hand. How did you sample the data? How many sigma is the data off from what would be random?

In addition, what did Pokerstars say when you presented your "proof" to them?

Let us know.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 11:24 AM
Describe the mathematical correlation you're going to invest and how many sigma your threshold for proof is. Also show how you intend to do the calculations on the data set and how you're going to account for dynamics like rising VPIP, ICM considerations from players, adjusted ranges due to tilt, etc etc.

In other words, what calculations have you run on your (small) sample size that you're going to repeat on a bigger one. You need a clear hypothesis, else of the 100000 "possible" rigs you might hit one of them by accident if you haven't determined what you're going to investigate.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 01:39 PM
Quote:
Originally Posted by puzzlefish
I know there will be a tendency to discuss rigged RNGs
Fairly certain this thread will not devolve into a ZOMG, pokerz is ROGGED fiasco.

And with that said.... and now much more directly to the point----> without constructive help for OP, please look elsewhere for your 'fun'.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 03:17 PM
venice10: While I appreciate the sentiment regarding the number of threads historically suggesting existing RNG biases, I have a greater appreciation for guidance in testing my theory. To that end, thank you for your support and I am grateful that you are prepared to at least entertain my request for help.

Firstly, if I had definite proof that there is a bias, I would be posting all of my data and statistical analysis to show that the bias exists. This is the ethical thing to do instead of holding it back to myself or exploiting it for profit at the expense of others. This thread is the beginning of the process for proper data collection and analysis. I have personal observations from tournaments that I have played in on PokerStars and now my transcribed data set from the February 11th 2018 Sunday Millions final table. This isn't nearly enough data at this time to bring to confront Pokerstars or to claim that anything is "rigged" or biased. However, at this point, based on my observations I am having a hard time believing that a bias does not exist. I believe that I have enough evidence to warrant further investigation.

Hence the title of this thread: Need help with RNG audit

Here are my grounds for belief:

1. Pokerstars claims that their RNG is regularly audited by a third party. However, the details of the audit process (what aspects of the RNG are tested) are not readily available to the public. In my theory, I do not assert that the RNG favours certain cards and card combinations over others. My theory is that the RNG creates the card combinations but awards them to players based on a different set of rules. As such, the card combinations may truly be random but the final outcomes of a given board for any given player may not be random at all. There is no documentation that I know of from Pokerstars that describes any kind of third party testing into this aspect of their games: i.e. the influence of previous board outcomes on future board outcomes.

2. I have played and observed hundreds of real money tournaments at the low-stakes level. The reason why I play there is that there is a higher probability of any given player calling with any given hole cards. Hence, there is more data to be extracted from any given hand since there are fewer folds. I have observed anomalies during play that I cannot explain:

2.1. I have repeatedly observed instances where a player will lose a large proportion of their stack from a bad beat and then shove all-in the very next hand (as if on tilt), only to be called by several other players with good hole cards. The player that had previously lost most of his chip stack would catch miracle draws on the board (runner runner flushes, straights, etc.) to reclaim their chip stack and more.

2.2 I have repeatedly observed instances where a player is eliminated from a tournament, thus leaving a gap at the table. In these instances, I frequently observed the player immediately adjacent to the eliminated player (ex. Seat 3 when Seat 2 just got eliminated) raising in the very next hand and winning the board.

2.3 I have investigated the above by betting my own hands when finding myself in these positions and have hit miracle boards that have allowed me to crack Aces, hit sets, hit runner flushes, and full houses with rags.

3. After observing the above, I started looking further into my hand histories and finding additional instances of the above taking place. I began tracking changes in stack sizes for players who were involved in exchanges that led to a showdown where significant draws had been achieved (ex. straights, flushes, full houses). I found that more often than not, the winning player was a net chip loser in the previous few hands whereas the losing player had recently won a significant number of chips, had just collected the blinds, or was just inactive (posting antes only) for the last few hands.

4. I began studying broadcasts of higher-stakes games. I studied the final table of the Sunday Million from February 11th, 2018 and observed the same patterns described in #3 above. I created an Excel spreadsheet documenting same. Players that busted from the final table did so by overplaying their hole cards when they were not the biggest chip losers in the previous few hands. Many players missed their nut draws by folding their hole cards after losing a substantial amount of chips on the previous few hands.


Kelvis and venice10, the reason why I am asking for help is because this particular type of data collection is very complicated and very specific data points have to be considered in order to make the analysis valid. There is a lot of background noise in the data due to player actions (i.e. bluffing, folding winning hands, etc.) that effectively conceal evidence and cut down the number of valid data points. As a result, the data collection process is incredibly slow. I have a basic university-level background in statistics and mathematics, so I can understand sample sizing and sigmas. However, I cannot comment on measurements that are more specific to poker at this time. I will have to study them further to have any kind of intelligent response to your challenges about VPIP, ICM, etc.

What I do have right now:

1. Repeating patterns that I have observed through my own play and through the play of others. I have not tabulated it because there are so few valid data points without knowing what other players at the table had for their hole cards. The only valid data points are those where the winner had the only winning combination for a given board (ex. a royal flush, an A-high straight where no other cards could win, etc.)

2. A data set for one final table. This is the most valid data, as I can see all hands of all players at the table and compare the results to the board in those instances where the play reached the river card. Then I can look back at previous hands and see what was going on with each player's chip stack (did they lose chips? did they gain chips?). I can also identify where players folded hole cards that would have won on the table by the river and look at their chip stack as well.

3. A hypothesis (more so than a theory) as to what may be going on.


This is a lot of typing, so I am going to take a break and come back here later to add more. Please be kind, as I do have the best intentions with this. I love poker and I want to make sure that the integrity of the game is intact.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 03:31 PM
I don’t want to sound rude, but there’s only one item in your wall of text that’s really relevant:
“Hundreds of real money tournaments” is your claimed sample size.

If you have analyzed the results of millions of real money tournaments, we are talking about a sample size to start with.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 03:47 PM
Thank you, madlex. I realize that the sample size is small. Please take some time to read my wall of text, because I explain why this is.. the data collection is very complex due to the nature of what I am studying. I am also only one person collecting data. There is a reason why this has not been studied before. It is incredibly complex and, if what I am seeing is true, this is also why it is potentially hiding in plain sight.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 05:49 PM
sixfour: thanks, appreciate the clarification.

Everyone else, attached here is my Excel spreadsheet of the 2018 Feb 11 Sunday Million final table on PokerStars. It was transcribed from video replay of the final table. The hands and stack size information is accurate to the best of my knowledge, although it was checked manually so if there are mistakes then I will take responsibility for them.

It contains 170 hands and about 34 hands of interest that are highlighted.

The layout of the spreadsheet is as follows:

Left side: Information about each hand as it pertains to the cards that were dealt to the players and on the board. Each player's hole cards are also accompanied by information about their position at the table and, to a limited extent, their actions during the hand (did they bet, raise, fold, etc.). Also indicated are (missed) draws on the board due to folding. The latter was discontinued at a certain point because I did not find the betting information to be valuable or predictive at this point.

Middle: Information about each player's chip stack at the start of each hand. Information about the change in each player's chip stack from the previous hand to the current hand.

Right: Some information about the table and, again, player positions at the table (really just to help me confirm that I was not making mistakes due to being tired while doing data entry).

Take a look at the highlighted hands, which include those where players get busted out of the final table. Look at what is happening to their stack size in the hands immediately preceding the hand where they get busted. You will find that, often-times, the winner of the hand where a player got busted would have lost to a different player that recently lost a lot of chips and that had folded their hand pre-flop.

Next, I will define exactly what I am looking for in terms of a plan for a more thorough analysis of these observations over a greater number of hands.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 06:14 PM
@Kelvis:

The mathematical correlation that I am seeking to identify:

An increased incidence of any particular player being dealt winning hole cards based on changes in their stack size in the previous "n" number of hands (where n may be between 1 and likely maxes out at the number of seats occupied at the table, so 9 with a table of 9 players) relative to changes in other players' stack sizes over the same "n" number of hands.

There is probably a more eloquent way of describing this mathematically, but I am not a mathematician so I apologize. I will describe it in the simplest case for a table of 2 players playing heads up: Player 1 and Player 2.

I want to test if Player 1 is more likely to be dealt winning hole cards if Player 1's stack size has decreased more than Player 2's stack size over the past "n" number of hands. Likewise, I want to test if a player's hole cards are more likely to lose (no matter what they are) in situations where they recently added to their stack size over the past "n" number of hands.

The biggest challenge, in my opinion, is that players fold their cards and I think that folding a winning hand pre-flop affects the outcome of the next hand (ex. if you folded KsKc after being re-raised by AdAc, but you would have hit a winning set, then your next hand's hole cards may be deliberately set to lose no matter what they are).


In terms of comparing this to what is random, we would expect a player at any given table to get the winning hole cards for the board roughly ~100% x (1/[# of seats at the table)) of the time, so 11% of the time at a table of 9? If we group together the data points involving the hole cards of recently losing players and see how often they get the winning hole cards in the hands that follow (maybe the next 3-4 hands after significant losses), we should be able to make a rough comparison together with a sigma calculation? Likewise, if we group together the data points involving the hole cards of recently winning players and see how often they get losing hole cards in the hands that follow, we could do the same thing in reverse? Then, if there is a significant deviation from the expected percentage then we could say we are onto something?

Last edited by puzzlefish; 02-19-2018 at 06:22 PM.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 06:56 PM
Quote:
Originally Posted by puzzlefish
If we group together the data points involving the hole cards of recently losing players and see how often they get the winning hole cards in the hands that follow (maybe the next 3-4 hands after significant losses)..........
You may have the answer to your question is you expand from 3-4 hands after to 9-10 hands after...

I suggest you limit your research to the very next hand only.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 06:59 PM
I have only skimmed these posts.

Are you saying that you watched a cards-up replay of a 170-deals final table and think you have spotted a pattern which suggests to you that the RNG is not "fair"?

Suppose we stipulate that you have indeed observed a "peculiar" behavior in the collection of hands at that 170-deals final table.

Of course, weird **** can occur in a sample of 170 deals. Surely you agree with that. The crux of proving/confirming any "bias" is that it persists outside of the one sample that led you to originally consider that particular bias may exist in the first place.

Why don't you watch several other cards-up replays of other final tables and track whether or not the behavior can be observed in those final tables too?
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 07:36 PM
Thanks KS and whosnext.

KS: Just to clarify, I am not suggesting to look ahead 9-10 hands, but that cumulative losses from a player's chip stack may count for up to 9 hands before the losses become insignificant. The winning hole cards usually appear within 3-4 hands of substantial chip losses.

The trouble with limiting my analysis to the next hand only is that I suspect if a losing player had just folded a winning hand (for example, if they had folded before they saw their draw land on the river OR got bluffed off their hand), then their very next hand loses. This is part observation from my own experiences and part hunch. I think you are right, however, and I will start with just one hand ahead first, but eventually I would have to expand it or just exclude data points that fit what I just described in this paragraph.


whosnext: I'm saying that I formed suspicions from my own tournament play and watching others playing tournaments on Pokerstars. Then I corroborated my suspicions on a 170-deals final table replay. I do agree that weird things do happen with a small sample size like that, but when the same pattern appears in every single bust then it raises red flags: someone loses a lot of chips, someone else (often times a recent chip gainer) picks up what looks like good cards and gets busted by either the previous chip loser or another player who would have been busted by the chip loser (had the chip loser played their next hole cards). I will be looking at several more cards-up replays but it takes a lot of time to mine the data from the replays. If you know of any more efficient way of getting the data that I am seeking from these replays, please let me know. It takes hours, literally, to properly collect the data by normal manual data entry.

Last edited by puzzlefish; 02-19-2018 at 07:46 PM.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 09:28 PM
This happening right now as I watch:

PokerStars Hand #182766448038: Tournament #2221413979, $0.50+$0.05 USD Hold'em No Limit - Level XII (200/400) - 2018/02/19 20:23:56 ET
Table '2221413979 61' 9-max Seat #3 is the button
Seat 1: Ti Flush 43 (8989 in chips)
Seat 2: Atlanteg (3855 in chips)
Seat 3: aguiapc (1398 in chips)
Seat 4: sarisel (3619 in chips)
Seat 5: fagno388 (8576 in chips)
Seat 6: alexmazol (5442 in chips)
Seat 7: Riberquily (4320 in chips)
Seat 8: Chr0n0lith (3670 in chips)
Seat 9: H. Moura BR (3771 in chips)
Ti Flush 43: posts the ante 50
Atlanteg: posts the ante 50
aguiapc: posts the ante 50
sarisel: posts the ante 50
fagno388: posts the ante 50
alexmazol: posts the ante 50
Riberquily: posts the ante 50
Chr0n0lith: posts the ante 50
H. Moura BR: posts the ante 50
sarisel: posts small blind 200
fagno388: posts big blind 400
alexmazol: raises 400 to 800
Riberquily: folds
Chr0n0lith: folds
H. Moura BR: folds
Ti Flush 43: folds
Atlanteg: folds
aguiapc: folds
sarisel: calls 600
fagno388: raises 7726 to 8526 and is all-in
alexmazol: calls 4592 and is all-in
sarisel: calls 2769 and is all-in
Uncalled bet (3134) returned to fagno388
*** FLOP *** [9h 9d Qh]
*** TURN *** [9h 9d Qh] [Ts]
*** RIVER *** [9h 9d Qh Ts] [6s]
*** SHOW DOWN ***
fagno388: shows [Ad Kc] (a pair of Nines)
alexmazol: shows [As Jd] (a pair of Nines - lower kicker)
fagno388 collected 3646 from side pot
sarisel: shows [8c 8h] (two pair, Nines and Eights)
sarisel collected 11157 from main pot
alexmazol finished the tournament in 675th place
*** SUMMARY ***
Total pot 14803 Main pot 11157. Side pot 3646. | Rake 0
Board [9h 9d Qh Ts 6s]
Seat 1: Ti Flush 43 folded before Flop (didn't bet)
Seat 2: Atlanteg folded before Flop (didn't bet)
Seat 3: aguiapc (button) folded before Flop (didn't bet)
Seat 4: sarisel (small blind) showed [8c 8h] and won (11157) with two pair, Nines and Eights
Seat 5: fagno388 (big blind) showed [Ad Kc] and won (3646) with a pair of Nines
Seat 6: alexmazol showed [As Jd] and lost with a pair of Nines
Seat 7: Riberquily folded before Flop (didn't bet)
Seat 8: Chr0n0lith folded before Flop (didn't bet)
Seat 9: H. Moura BR folded before Flop (didn't bet)



PokerStars Hand #182766471553: Tournament #2221413979, $0.50+$0.05 USD Hold'em No Limit - Level XII (200/400) - 2018/02/19 20:24:45 ET
Table '2221413979 61' 9-max Seat #4 is the button
Seat 1: Ti Flush 43 (8939 in chips)
Seat 2: Atlanteg (3805 in chips)
Seat 3: aguiapc (1348 in chips)
Seat 4: sarisel (11157 in chips)
Seat 5: fagno388 (6780 in chips)
Seat 7: Riberquily (4270 in chips)
Seat 8: Chr0n0lith (3620 in chips)
Seat 9: H. Moura BR (3721 in chips)
Ti Flush 43: posts the ante 50
Atlanteg: posts the ante 50
aguiapc: posts the ante 50
sarisel: posts the ante 50
fagno388: posts the ante 50
Riberquily: posts the ante 50
Chr0n0lith: posts the ante 50
H. Moura BR: posts the ante 50
fagno388: posts small blind 200
Riberquily: posts big blind 400
Chr0n0lith: folds
H. Moura BR: raises 3271 to 3671 and is all-in
Ti Flush 43: folds
Atlanteg has timed out
Atlanteg: folds
Atlanteg is sitting out
Atlanteg has returned
aguiapc: folds
sarisel: folds
fagno388: raises 3059 to 6730 and is all-in
Riberquily: folds
Uncalled bet (3059) returned to fagno388
*** FLOP *** [Th Jd 3d]
*** TURN *** [Th Jd 3d] [Js]
*** RIVER *** [Th Jd 3d Js] [Kh]
*** SHOW DOWN ***
fagno388: shows [Qd Ah] (a straight, Ten to Ace)
H. Moura BR: shows [7c Ac] (a pair of Jacks)
fagno388 collected 8142 from pot
H. Moura BR finished the tournament in 642nd place
*** SUMMARY ***
Total pot 8142 | Rake 0
Board [Th Jd 3d Js Kh]
Seat 1: Ti Flush 43 folded before Flop (didn't bet)
Seat 2: Atlanteg folded before Flop (didn't bet)
Seat 3: aguiapc folded before Flop (didn't bet)
Seat 4: sarisel (button) folded before Flop (didn't bet)
Seat 5: fagno388 (small blind) showed [Qd Ah] and won (8142) with a straight, Ten to Ace
Seat 7: Riberquily (big blind) folded before Flop
Seat 8: Chr0n0lith folded before Flop (didn't bet)
Seat 9: H. Moura BR showed [7c Ac] and lost with a pair of Jacks

I can pull dozens of these from my hand histories at this level, because people actually call all-ins and take the chance. That is why this effect is so easy to see in low and micro play.

Last edited by puzzlefish; 02-19-2018 at 09:42 PM.
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 11:22 PM
This last post.....is unacceptable.

Your sample size is laughable to begin with and this last post..... (btw, dozens won't be any better)

This is bordering on a "bad beat" thread. If you want to continue talking about the math and science you will need to continue working on a proof, go ahead and post theory and ask questions. But posting a hand history or three to boost your unproven "theory".....will need to stop. Comprehend?
Need help with RNG audit - Moved from BQ Quote
02-19-2018 , 11:34 PM
Quote:
Originally Posted by King Spew
This last post.....is unacceptable.

Your sample size is laughable to begin with and this last post..... (btw, dozens won't be any better)

This is bordering on a "bad beat" thread. If you want to continue talking about the math and science you will need to continue working on a proof, go ahead and post theory and ask questions. But posting a hand history or three to boost your unproven "theory".....will need to stop. Comprehend?
I think for this to be a relevant survey, OP is going to have to define what constitutes a confirming event, and what constitutes a normal event, then compare frequencies. i highly suspect that we are just looking at confirmation bias here.

That hand history just shows a guy getting a big ace two hands in a row, hardly a damning
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 12:18 AM
Ok KS - point taken - I only posted the hand history as an example of what I am talking about - not to lend credibility to my unproven theory. I'm not the losing player in that hand history. I have no intention to post any more here in this thread.

Can we establish what kind of sample size I am looking to achieve in order to show that this is not background noise? I would have to isolate a number of these instances and then compare them to what would be considered statistically normal. How many do I need?

SpewingIsMyMove: Thank you for providing some direction here. I consider a confirming event to be an instance where a player has just lost a large amount of their chips (in the previous hand or even in the previous 2-3 hands). I am not sure if both hands have to go all the way to the river card, but it may be significant. The losing player then finds the winning hole cards dealt to him shortly afterwards (in the next hand and at most 2-3 hands later on tables with 6+ players). By winning hole cards, I mean that if the hole cards were played all the way to the river, they would beat every other player's hole cards presently at the table for that particular board.

A normal event would be one where the winning hole cards in the above situation would be dealt to any player at the table, but they should not be dealt to the previous loser more than what would be expected for a random event (so on average no more than 100% x 1/[number of players at a table]).

I'm absolutely not saying that those two hands that I posted show anything except an illustration of what I am talking about. I have many of these and I agree that it could be confirmation bias, because it is exactly what I am looking for. Can we calculate how often this should be happening if it was normal? No more than 11 times in 100 for a 9 player table and no more than about 17 times in 100 for a 6 player table?
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 12:43 AM
You may be unaware that 2+2 has a Probability Forum where this type of statistical inquiry may be more likely to engender productive discussion and responses.
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 12:47 AM
Thanks. Is there any way to link this thread to appear in the Probability Forum? Or should I post a separate question there pertaining to the calculation of probabilities that will be used in this particular study?
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 12:51 AM
Quote:
Originally Posted by madlex
I don’t want to sound rude, but there’s only one item in your wall of text that’s really relevant:
“Hundreds of real money tournaments” is your claimed sample size.

If you have analyzed the results of millions of real money tournaments, we are talking about a sample size to start with.
puzzle, madlex offered the sample size that many of us feel is a good starting point.
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 01:05 AM
Ok, I think Probability would be a good spot for this thread in the current stage that it is in.

Re: the sample size ideally being in the millions for what I am trying to study, I would love to be able to do that, but the question is how? There is no way to extract that data via computer processing without Pokerstars and other online poker sites releasing full hand histories of entire tournaments, showing everybody's cards. Do you think that this would happen?
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 01:17 AM
What would be the point of a site actually doing something like this to a group of random players? What would it achieve for them? How does whatever explanation that you come up with for those questions stand up to the more simple explanation that it's all just a product of random occurrence?
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 01:50 AM
I love the jabs! I know it is to be expected with the subject matter.

Worldzmine: Regarding reasoning as to why something like this may be hard-programmed into a poker site's software - that is where the discussion spirals into conspiracy theories. Personally, I don't know. Assuming it is real, then it may be intentionally or unintentionally there. It's not important to me. What is important to me is to determine whether it is real or not real. If you would like to talk about the possible reasons, let's do it through PMs or in another thread.

Again, thanks for the input so far, everyone! It's going way better than I would have hoped. I am still hoping to hear some good ideas as to how I can effectively (and practically) accumulate the necessary amount of data to establish a decent sigma for significance. This is why I took this discussion online rather than dealing with it in private, because the data mining for this is very tedious.
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 06:15 AM
Quote:
Originally Posted by puzzlefish
sixfour: thanks, appreciate the clarification.

Everyone else, attached here is my Excel spreadsheet of the 2018 Feb 11 Sunday Million final table on PokerStars. It was transcribed from video replay of the final table. The hands and stack size information is accurate to the best of my knowledge, although it was checked manually so if there are mistakes then I will take responsibility for them.

It contains 170 hands and about 34 hands of interest that are highlighted.

The layout of the spreadsheet is as follows:
I still don't see what work you've done on calculating the correlation or significance.

What are you going to do with a bigger sample other than give anecdotal evidence? I want to see what method you have used on this tiny sample that you intend to use on a bigger one. Do you have one?
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 03:48 PM
Quote:
Originally Posted by Kelvis
I still don't see what work you've done on calculating the correlation or significance.

What are you going to do with a bigger sample other than give anecdotal evidence? I want to see what method you have used on this tiny sample that you intend to use on a bigger one. Do you have one?
Kelvis, you're right in that it mostly appears to be anecdotal evidence. In assessing this small sample, I am looking at instances where winning hole cards are dealt to a player within 1-4 hands of them losing a significant number of chips (more than just the ante, but blinds do get counted as losses). By "winning hole cards", I mean those hole cards that would be the "solution" to the current board if it were played out to the river. (Sometimes we know what the winning hole cards are before the river hits, so this does allow for additional data points.)

The expected incidence of the above instances will vary depending on the number of players at the table. I propose that the above should happen for a:

9 player table - 11% of the time (winning hole cards on the next hand), 20% of the time (by the second hand), 30% of the time (by the third hand), and 38% of the time (by the fourth hand).

8 player table - 13% of the time (next hand), 23% of the time (by the second hand), etc. etc.

For the February 11th, 2018 sample set, there are ~170 hands. Out of those hands, the vast majority were folded so it is impossible to tell what hole cards would have won for sure. Out of ~170 hands, there are 48 hands where it is possible to see whose hole hand cards would win (or if it was a tie).

Out of the 48 hands, 12 were on a 9 player table.

Of those 12 hands that could be analyzed, 5 (41%) would have been won by the player that had lost the most chips in the previous hand and while 3 (25%) would have been won by the player that had lost the most chips two hands ago. That makes 8 (66%) of won hands by "net chip losers" from the last one or last two hands. The other 4 (33%) winners did not appear to follow any pattern on first pass, but may also be due to the influence of folded winning hole cards in previous hands.

Out of the remaining hands, only 1 full hand played on a 8 player table. The player that got busted in that hand was busted on a board that should have been won by a player who lost the most chips in the previous two hands, but instead he got busted by the player who lost the most chips in the previous hand (with Aces).

Out of the remaining hands, only 1 full hand played on a 7 player table. The player that got busted in that hand should have been busted by the player who lost the most chips over the previous two hands, but instead was busted by the player who lost the most chips in the previous hand (with a set of 3s).

Out of the remaining hands, only 1 full hand played on a 6 player table. The player that got busted in that hand got busted by the player who lost the most chips in the previous hand. The true winner (who had folded) was a less active player who had also been losing chips over the last few hands.

Out of the remaining hands, only 1 full hand played on a 5 player table. A player got busted by a net chip loser from the previous hand.

Out of the remaining hands, only 1 full hand played on a 4 player table. The net winner from the previous hand got busted by the net chip loser from the past two hands.

The pattern persists further, as the remaining busts were also on net winners in previous hands by net losers in previous hands. However there is no useful statistical analysis that can be applied with these few hands when considering play on such small table sizes.

10 of 48 hands were three-way - 7 were (or should have been) won by net chip losers from previous hand, 3 appeared random. (70%/30%)

21 of the 48 hands were heads up and there is no obvious pattern. The amount of folding completely washes out the data.


I am having trouble designing a statistical test that would capture all of this information fairly, all at once. The expected percentages will change depending on the number of players at a table, so it looks like I would have to partition the audit and look at hands with constant table sizes.

I am thinking of dividing the data points for each table size into a winning group and a losing group. I will further partition each group:

Losers that lost to a net chip winner (counted over the past 1-2 hands) who had the winning hole cards to the board and losers that lost (or should have lost) to a net chip loser (counted over the past 1-2 hands, including loss of blinds but excluding antes for now) who had the winning hole cards to the board.

Likewise, the winners will be partitioned in a similar fashion except that their victims, the losing players, will be partitioned based on whether they were net chip winners over the past 1-2 hands or net chip losers.

I need to figure out what statistical test to use to determine correlation and significance for this analysis. I am thinking to compare the occurrence rates of each type of situation in each group (ex. winning or losing under those specific conditions) versus expected baselines (ex. 88% to lose at a 9 player table or 11% to win at a 9 player table). Then I would compare the occurrence rates to determine significance? How does that sound, Kelvis? Dog's breakfast? There might be a simpler way to go about it.

Last edited by puzzlefish; 02-20-2018 at 04:02 PM.
Need help with RNG audit - Moved from BQ Quote
02-20-2018 , 04:09 PM
Quote:
Originally Posted by puzzlefish
Kelvis, you're right in that it is entirely anecdotal evidence.
fyp

You can't possibly think a 48 hand sample tells you anything.
Need help with RNG audit - Moved from BQ Quote

      
m