HUD Free, open source poker tracking software: FPDB - (Version 0.40.5) - Nov 14, 2013 - Page 84 - Poker Software -- Two Plus Two Poker Forums

It looks like matplotlib installed ok--maybe your problem is that you need to install numpy. There is probably a port for it. Do this to test for matplotlib:

Code:

$ python
Python 2.6 (r26:66714, Jun  8 2009, 16:07:29) 
[GCC 4.4.0 20090506 (Red Hat 4.4.0-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import matplotlib
>>> import numpy
>>> import iaintgotthis
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named iaintgotthis
>>>

(I'm using python 2.6, 2.5 is also fine.)

I am not hopeful that we'll ever have a HUD for OSX written in gtk. One thing I am doing is changing the way that HUDs are set up so that you don't have to use gtk, you could use QT or some native OSX thing that I've never heard of. (I'm not doing this just for mac folks, it will make other things work better, too.) These changes are not ready for prime time yet. However it is done, it will require someone who knows his way around OSX graphics to wrestle the problem to the ground.

Code:

bash-3.2$ sudo port install py25-pil py25-numpy py25-scipy
Password:
--->  Computing dependencies for py25-pil
--->  Cleaning py25-pil
--->  Computing dependencies for py25-numpy
--->  Cleaning py25-numpy
--->  Computing dependencies for py25-scipy
--->  Cleaning py25-scipy
bash-3.2$ python
Python 2.5.4 (r254:67916, Oct 29 2009, 01:40:04) 
[GCC 4.2.1 (Apple Inc. build 5646) (dot 1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import matplotlib
>>> import numpy
>>> import iaintgotthis
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named iaintgotthis
>>> quit
Use quit() or Ctrl-D (i.e. EOF) to exit
>>> 
bash-3.2$

Will try to get more output from sorrow's code.

Quote

10-30-2009 , 02:22 AM

#2078

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Ok, so I changed the code in GuiGraphViewer.py to this:

Code:

...

try:
    import matplotlib
    matplotlib.use('GTK')
    from matplotlib.figure import Figure
    from matplotlib.backends.backend_gtk import FigureCanvasGTK as FigureCanvas
    from matplotlib.backends.backend_gtkagg import NavigationToolbar2GTKAgg as NavigationToolbar
    from numpy import arange, cumsum
    from pylab import *
except ImportError as inst:
    print """Failed to load libs for graphing, graphing will not function. Please in
                 stall numpy and matplotlib if you want to use graphs."""
    print """This is of no consequence for other parts of the program, e.g. import
         and HUD are NOT affected by this problem."""
    print "ImportError: %s" % inst.args

...

but now the program won't execute at all, and terminates silently with error code 1. I have no clue about python whatsoever, so I have no idea where the syntax error is.

Quote

10-30-2009 , 02:44 AM

#2079

sorrow

old hand

Join Date: Apr 2008 Posts: 1,531

Quote:

Originally Posted by p3rc4

Ok, so I changed the code in GuiGraphViewer.py to this:

Code:

...

try:
    import matplotlib
    matplotlib.use('GTK')
    from matplotlib.figure import Figure
    from matplotlib.backends.backend_gtk import FigureCanvasGTK as FigureCanvas
    from matplotlib.backends.backend_gtkagg import NavigationToolbar2GTKAgg as NavigationToolbar
    from numpy import arange, cumsum
    from pylab import *
except ImportError as inst:
    print """Failed to load libs for graphing, graphing will not function. Please in
                 stall numpy and matplotlib if you want to use graphs."""
    print """This is of no consequence for other parts of the program, e.g. import
         and HUD are NOT affected by this problem."""
    print "ImportError: %s" % inst.args

...

but now the program won't execute at all, and terminates silently with error code 1. I have no clue about python whatsoever, so I have no idea where the syntax error is.

Make sure that the lines you added are using spaces rather than tabs

Quote

10-30-2009 , 03:39 AM

#2080

1meandog4u

old hand

Join Date: Apr 2007 Posts: 1,286

Since we can't delete files from the MySQL database, and we have to recreate the database every time there is a major upgrade, at what point (number of hands) does Mysql/FPDB start to slow down?

In my case, if it makes any difference, I'm running Vista, Intel Pentium Dual Core 64bit processor, 2 gigs memory. I play around 20k hands a month. Not that I need more than six month's history, or more, just want to know the point that pushes FPDB enough to bog down. (Opinions accepted)

Thanks

Dog

Quote

10-30-2009 , 08:05 AM

#2081

Exoow

stranger

Join Date: Oct 2009 Posts: 1

Hi, a quick question:

Is FPDB in any way compatible with pokersites that aren't on the list yet? In particular, Pacific Poker. If not, will compatibility expand for sites like those in the (near) future?

Thanks.

Quote

10-30-2009 , 09:28 AM

#2082

sorrow

old hand

Join Date: Apr 2008 Posts: 1,531

Quote:

Originally Posted by 1meandog4u

Thanks

Dog

I've no real idea to be honest. the greatest # of hands i've heard about so far is ~200k without any issues. I'd assume it could probably hit 1M hands without significant performance issues - its hard to know until some pushes it that far.

Sorrow.

Quote

10-30-2009 , 10:56 AM

#2083

Eratosthenes

old hand

Join Date: Oct 2004 Posts: 1,535

Quote:

Originally Posted by Exoow

If there is a program that converts Pacific HHs to the PokerStars (+ etc.) format, fpdb could probably read that. The HH import code uses plugins to support new sites. Writing a plugin only takes a few hours for someone with modest Python skills (Maybe less if the HH looks a lot like Stars or FTP or one of the other supported. More if the HH format is something different.). I'm not going to add any more sites until I clean up some messes in the current code. I suspect that most of the other devs are thinking the same way.

Quote

10-30-2009 , 11:06 AM

#2084

Eratosthenes

old hand

Join Date: Oct 2004 Posts: 1,535

Quote:

Originally Posted by sorrow

I had >150k hands in the db I just accidently overwrote.

Performance was still fine. Both mysql and postgres are used for databases much larger than the ones we are likely to generate. (not necessarily poker dbs)

Database speed will slow down some as the database gets larger. There are some tweaks in the bulk import code to minimize that now and I think the new importer will be significantly faster.

Quote

10-30-2009 , 12:14 PM

#2085

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Quote:

Originally Posted by sorrow

Make sure that the lines you added are using spaces rather than tabs

Looks like the problem is somewhat of a glitch. No matter how much I copy/pasted your code, I wasn't able to run it with python25 (insta exit code 1). So I decided to try python26 (yes i did python_select), and now the code works. Here's what the output told me:

Code:

bash-3.2$ pythonw fpdb.py 
Note: error output is being diverted to fpdb-error-log.txt and HUD-error.txt. Any major error will be reported there _only_.
Xlib:  extension "RANDR" missing on display "/tmp/launch-0lVN5z/:0".
Failed to load libs for graphing, graphing will not function. Please in
                 stall numpy and matplotlib if you want to use graphs.
This is of no consequence for other parts of the program, e.g. import 
         and HUD are NOT affected by this problem.
ImportError: No module named _backend_gdk
Reading configuration file HUD_config.xml

Quitting normally

Looks like python is looking for a module called backend_gdk, instead of backend_gtk, which I assume to be the correct module name. Now, I wasn't sure whether or not this was a typo in the code, so I decided to try to load the libs manually:

Code:

bash-3.2$ python
Python 2.6.4 (r264:75706, Oct 29 2009, 02:07:39) 
[GCC 4.2.1 (Apple Inc. build 5646) (dot 1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import threading
>>> import pygtk
>>> pygtk.require('2.0')
>>> import gtk
Xlib:  extension "RANDR" missing on display "/tmp/launch-0lVN5z/:0".
>>> import os
>>> from time import *
>>> import matplotlib
>>> matplotlib.use('GTK')
>>> from matplotlib.figure import Figure
>>> from matplotlib.backends.backend_gtk import FigureCanvasGTK as FigureCanvas
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gtk.py", line 25, in <module>
    from matplotlib.backends.backend_gdk import RendererGDK, FigureCanvasGDK
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gdk.py", line 29, in <module>
    from matplotlib.backends._backend_gdk import pixbuf_get_pixels_array
ImportError: No module named _backend_gdk
>>> from matplotlib.backends.backend_gtkagg import NavigationToolbar2GTKAgg as N
avigationToolbar
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gtkagg.py", line 10, in <module>
    from matplotlib.backends.backend_gtk import gtk, FigureManagerGTK, FigureCan
vasGTK,\
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gtk.py", line 25, in <module>
    from matplotlib.backends.backend_gdk import RendererGDK, FigureCanvasGDK
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gdk.py", line 29, in <module>
    from matplotlib.backends._backend_gdk import pixbuf_get_pixels_array
ImportError: No module named _backend_gdk
>>> from numpy import arange, cumsum
>>> from pylab import *
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/pylab.py", line 1, in <module>
    from matplotlib.pylab import *
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/pylab.py", line 247, in <module>
    from matplotlib.pyplot import *
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/pyplot.py", line 78, in <module>
    new_figure_manager, draw_if_interactive, show = pylab_setup()
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/__init__.py", line 25, in pylab_setup
    globals(),locals(),[backend_name])
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gtk.py", line 25, in <module>
    from matplotlib.backends.backend_gdk import RendererGDK, FigureCanvasGDK
  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.
6/site-packages/matplotlib/backends/backend_gdk.py", line 29, in <module>
    from matplotlib.backends._backend_gdk import pixbuf_get_pixels_array
ImportError: No module named _backend_gdk
>>> 
bash-3.2$

Am I getting anywhere? Halp!

Quote

10-30-2009 , 12:48 PM

#2086

Eratosthenes

old hand

Join Date: Oct 2004 Posts: 1,535

...
Looks like python is looking for a module called backend_gdk, instead of backend_gtk, which I assume to be the correct module name. Now, I wasn't sure whether or not this was a typo in the code, so I decided to try to load the libs manually:

...
Am I getting anywhere? Halp![/quote]

The gtk stuff loads and calls gdk stuff (gdk is the lower level lib).

I did some googling on this stuff and found that you have run in to a pretty common problem using python, pygtk, and matplotlib on osx, via macports. Take a look at this (and the messages that follow), for example. I am reasonably sure this is a problem with matplotlib or (more likely) how you have installed matplotlib. You might get more help from macport types.

Quote

10-30-2009 , 12:58 PM

#2087

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Aight, thanks for pointing me in the right direction!

Edit: Read through the thread, and didn't find a solution, am I blind?

Quote

10-30-2009 , 01:41 PM

#2088

1meandog4u

old hand

Join Date: Apr 2007 Posts: 1,286

Quote:

Originally Posted by Eratosthenes

I had >150k hands in the db I just accidently overwrote.

Thanks, I did suspect that MySQL was built for large databases. The new importer in "0.12" (i know it's not official but we have to call it something), works MUCH faster when I do bulk importing than past recreate/bulk imports. It would take hours, now less than 20 mins.

Until we can selective delete, I'll just recreate and load only the freshest stats. I'm sure PS's will do some major update soon that will bust all this stuff wide open. They are even getting sneaky. I use the NON update "pokerstars.exe" file. Last update, it even said I needed to update and would not log on...sigh.

Dog

Thanks for the efforts, everyone who contributes!!

Quote

10-30-2009 , 08:31 PM

#2089

sorrow

old hand

Join Date: Apr 2008 Posts: 1,531

Quote:

Originally Posted by p3rc4

Code:

except ImportError as inst:

Mea culpa - Turns out this only works in python 2.6.

You'll get the same results by removing the try: except block entirely.

ie.

Code:

try:
    import matplotlib
    matplotlib.use('GTK')
    from matplotlib.figure import Figure
    from matplotlib.backends.backend_gtk import FigureCanvasGTK as FigureCanvas
    from matplotlib.backends.backend_gtkagg import NavigationToolbar2GTKAgg as NavigationToolbar
    from numpy import arange, cumsum
    from pylab import *
except ImportError as inst:
    print """Failed to load libs for graphing, graphing will not function. Please in
                 stall numpy and matplotlib if you want to use graphs."""
    print """This is of no consequence for other parts of the program, e.g. import 
         and HUD are NOT affected by this problem."""
    print "ImportError: %s" % inst.args

becomes:

Code:

import matplotlib
matplotlib.use('GTK')
from matplotlib.figure import Figure
from matplotlib.backends.backend_gtk import FigureCanvasGTK as FigureCanvas
from matplotlib.backends.backend_gtkagg import NavigationToolbar2GTKAgg as NavigationToolbar
from numpy import arange, cumsum
from pylab import *

Quote

10-30-2009 , 08:35 PM

#2090

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Thanks sorrow, I actually upgraded to python26 and that solved the syntax issue.

Apart from that, I'm no closer to finding a solution =/

Quote

10-30-2009 , 09:04 PM

#2091

sorrow

old hand

Join Date: Apr 2008 Posts: 1,531

Quote:

Originally Posted by p3rc4

Thanks sorrow, I actually upgraded to python26 and that solved the syntax issue.

Apart from that, I'm no closer to finding a solution =/

You should get some sort on import error in the console if you remove the try-except block.

The graph viewer actaully gets loaded at startup time so you should be looking for the error then rather than when you open the graph viewer.

starting with "python fpdb.py -x" may help too.

Sorrow

Edit: Bah - just read the other posts - matplotlib + gtk issue

From a net post

"Thanks!

I ran

sudo port -ncuf upgrade py25-gtk
sudo port -ncuf upgrade py25-matplotlib

This solved the problem!
"

May need to be done in order

Last edited by sorrow; 10-30-2009 at 09:12 PM.

Quote

10-30-2009 , 10:18 PM

#2092

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Allright, sweet, I'll port those packs and have another go!

Quote

10-30-2009 , 11:47 PM

#2093

Caysewell

enthusiast

Join Date: Feb 2009 Posts: 73

I'm having problems with the HUD in PLO cash games. When the mucked cards are shown, the table freezes. This did not happen in NLHE cash games. Does anyone encounter something similar?

Also, how do I disable the mucked cards?

Quote

10-31-2009 , 12:04 AM

#2094

p3rc4

banned

Join Date: Jul 2006 Posts: 10,991

Quote:

Originally Posted by p3rc4

Allright, sweet, I'll port those packs and have another go!

Did the port -ncuf upgrade thing for both versions 2.5 and and 2.6, none of which changed anything. I'm pretty sure the port upgrade function only executes if there is a newer version availabke to upgrade to. The command also gave no output and exited with code 0.

Seems like this is a problem outside of fpdb's scope, so thanks a lot for support! I really hope we can find a way around this.

Quote

10-31-2009 , 02:18 AM

#2095

ekdikeo

old hand

Join Date: Aug 2006 Posts: 1,364

re: import speed

A large quantity of our time is actually spent in parsing the hands, and decoding the information that we need to know. Time spent in the database is almost negligible at this point. Cash hands, I typically import between 60 and 90 per second depending on how involved the hands are. Tournaments seem to have something hitching them pretty well still. But, I would be rather surprised if you'll ever hit anything noticeable for database slowdown, when talking about an individual insert, which is usually what most people would be doing.

There's two ways that I can see to tackle database layout changes .. one, is basically do as we are doing now, and when changes are made, you reimport your hands .. or two, we store every hand's complete handhistory in the database as well, and then when we detect that the layout isn't the same as what we expect, we basically do a re-import on the entire thing, but using the HH from the database versus the files. It really comes down to basically the same operation. I'm not a big fan of storing the entire HH in it's original form in the database, although I do know that PT does that, I don't know about others. If someone did do that, though, I'd seriously consider implementing an automatic database upgrade process.

Quote

10-31-2009 , 02:22 AM

#2096

ekdikeo

old hand

Join Date: Aug 2006 Posts: 1,364

Quote:

Originally Posted by p3rc4

Aight, thanks for pointing me in the right direction!

Edit: Read through the thread, and didn't find a solution, am I blind?

There was a bug in the distribution of matplotlib over something like 8 months, that caused GTK support in it to not work. I think this was fixed in the official releases around July or August, whenever it was that I managed to get graphing working in python 2.6 on Windows. If you're using a Mac, it might be possible that that build bug has not been fixed on Mac, or that the Mac version isn't built as frequently. You might try a few different releases of the matplotlib stuff.

Quote

10-31-2009 , 08:31 AM

#2097

Eleatic Stranger

journeyman

Join Date: Sep 2008 Posts: 292

I haven't posted for a while but have kept up with the Git repository, and it's about time I reported in to praise the developers for their efforts, in particular with regard to four features which I've made extensive use of:

1. The player stats window. I like the colour-coding, and the ability to sort the columns at will is very useful (I can find out what hands I've been blowing my money on). I've stopped using the HUD while playing, as it happens, but this function makes Fpdb still indispensable.

2 & 3. The graph and the session graphs. I know the graphing function has existed for a while but it was only recently that I installed the necessary libraries for it, and I wasn't disappointed. In one respect it is demonstrably superior to PT's graph: it doesn't mark off the x- and y-axes in ridiculous arbitrary "units" bearing some relationship to the total winnings or whatever (I have never understood why people tolerate this).

4. The alpha SQLite support. This database seems lightning-fast and already more or less works. Sorrow said earlier that those who wanted to test it should PM him first, but I decided to just go ahead and see what happened – sorry! I jury-rigged some of the SQL code as shown in the following Diff patch to get the player stats window to work (up to a point).

Code:

diff --git a/pyfpdb/SQL.py b/pyfpdb/SQL.py
index 3c25963..524e782 100644
--- a/pyfpdb/SQL.py
+++ b/pyfpdb/SQL.py
@@ -1895,9 +1895,9 @@ class Sql:
                 self.query['playerDetailedStats'] = """
                          select  <hgameTypeId>                                                          AS hgametypeid
                                 ,gt.base
-                                ,gt.category
+                                ,gt.category AS category
                                 ,upper(gt.limitType)                                                    AS limittype
-                                ,s.name
+                                ,s.name AS name
                                 ,min(gt.bigBlind)                                                       AS minbigblind
                                 ,max(gt.bigBlind)                                                       AS maxbigblind
                                 /*,<hcgametypeId>                                                       AS gtid*/
@@ -1939,7 +1939,7 @@ class Sql:
                                 ,100.0*avg((hp.totalProfit+hp.rake)/(gt.bigBlind+0.0))                  AS bb100xr
                                 ,avg((hp.totalProfit+hp.rake)/100.0)                                    AS profhndxr
                                 ,avg(h.seats+0.0)                                                       AS avgseats
-                                ,variance(hp.totalProfit/100.0)                                         AS variance
+                                ,0.0 AS variance
                           from HandsPlayers hp
                                inner join Hands h       on  (h.id = hp.handId)
                                inner join Gametypes gt  on  (gt.Id = h.gameTypeId)
@@ -1949,7 +1949,7 @@ class Sql:
                           and   h.seats <seats_test>
                           <flagtest>
                           <gtbigBlind_test>
-                          and   to_char(h.handStart, 'YYYY-MM-DD') <datestest>
+                          /*and   to_char(h.handStart, 'YYYY-MM-DD') <datestest>*/
                           group by hgameTypeId
                                   ,hp.playerId
                                   ,gt.base
@@ -1967,7 +1967,7 @@ class Sql:
                                                    when '0' then 'Y'
                                                    else 'Z'||<position>
                                    end
-                                  <orderbyhgameTypeId>
+                                  /*<orderbyhgameTypeId>*/
                                   ,upper(gt.limitType) desc
                                   ,maxbigblind desc
                                   ,s.name

Some part of this may interest the coders: the "gt.category AS category" appears to be necessary, for example. I've turned certain things off because they don't work in SQLite (e.g. variance – though this obviously can be calculated).

Many thanks to the developers for their hard work!

Quote

10-31-2009 , 10:52 AM

#2098

Eratosthenes

old hand

Join Date: Oct 2004 Posts: 1,535

Quote:

Originally Posted by Caysewell

I'm having problems with the HUD in PLO cash games. When the mucked cards are shown, the table freezes. This did not happen in NLHE cash games. Does anyone encounter something similar?

sigh

You mean the poker client freezes? The PokerStars, FTP or whatever window? What site is this? Do you know if its only that site? What version of fpdb are you using? What operating system? When you reply could you paste in the <game lines for holdem and omahahi? (same lines I pasted below)
thanks

Quote:

Also, how do I disable the mucked cards?

Open your HUD_config.xml file and change this:

Code:

  <game cols="3" db="fpdb" game_name="omahahi" rows="2" aux="mucked">
            <stat click="tog_decorate" col="0" popup="default" row="0" stat_name="vpip" tip="tip1"> </stat>
...

to this:

Code:

  <game cols="3" db="fpdb" game_name="omahahi" rows="2">
            <stat click="tog_decorate" col="0" popup="default" row="0" stat_name="vpip" tip="tip1"> </stat>
...

Quote

10-31-2009 , 11:52 AM

#2099

Eleatic Stranger

journeyman

Join Date: Sep 2008 Posts: 292

An update as to how SQLite is interacting (in my experience) with the other features I mentioned: The session graph doesn't work for as yet unknown reasons; I'll see if I can sort that out for myself.

When hacking the code for the player statistics I did the lazy thing and commented out the date-comparison code since I don't know how this is done in SQLite; but selection by date works perfectly (so far as I can tell) with graphing, so I'll see how it's being done there.

If any coder wants to send me experimental SQLite code (now or at any time) I would be happy to give it a try. In the meantime I'm glad to have switched MySQL off, as I had the impression it was slowing my system.

The main reason I think the SQLite support is a good thing is that it should eventually silence the frequent cries of "this is too complicated I can't get it to work" from newcomers. Even Pokertracker is a bugger to set up because it needs a stand-alone database; I tried it once and couldn't get it to work.