Open Side Menu Go to the Top

09-21-2011 , 06:28 AM
Quote:
Originally Posted by _dave_
I guess if you only do one project on one server, of course it makes sense to pay someone else for the job. but this heroku is ongoing cost. I guess that doesn't matter if you're above breakeven. but it kinda does, you'd be more above breakeven with the cheaper DIY setup. it really doesn't matter if you're making $$$ hand over fist.

I view it like an espresso machine though. if you only ever drink one, it is of course a huge waste of money to buy a $2K gaggia to make it and it'd be way better to just grab a standard $3 starbucks. but if you have 4 a day to aid with the coding, yeah you lost a 5x $100 hourly while you learned how to work it instead of coding, but after 2 years you're ~$6k richer. and you've been having superior coffee.
This is certainly reasonable - and if I were using Heroku I'd be planning to get off of it at some point to start to realize those savings. But there are lots of things that companies can do to save/make money. And it's silly to say that learning to do your sys admin stuff right from the start is definitely a priority over all of those other things.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
$25m Guaranteed WPM on CoinPoker
Join the action now
Daily Rewards • Splash Pots • CoinRaces
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
09-21-2011 , 08:09 AM
Changing the topic - does anyone know of good free poker datasets? I don't really care what it is so long as its sized somewhere between 10MB and 10GB and somewhat related to poker.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 09:46 AM
Quote:
Originally Posted by jjshabado
Changing the topic - does anyone know of good free poker datasets? I don't really care what it is so long as its sized somewhere between 10MB and 10GB and somewhat related to poker.
I run ******** and we datamine around 8 gigs a day. What do you need it for? PM me if you want or post on here. We like helping out developers / researchers.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 10:27 AM
Quote:
Originally Posted by nextgenneo
I run ******** and we datamine around 8 gigs a day. What do you need it for? PM me if you want or post on here. We like helping out developers / researchers.
I want to play around with a Pig/Hadoop tool we're building and since I like poker it seemed like a poker dataset would be more interesting for me to play with then most of the other free datasets online.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:27 AM
Quote:
Originally Posted by tyler_cracker
"why would you pay heroku to handle sysadmin tasks for you? set up a server, done, ez game" : real sysadmins :: "why would you pay a programmer to build the backend for you? set up an access database, done, ez game" : real developers
perfect
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:30 AM
Quote:
Originally Posted by jjshabado
I want to play around with a Pig/Hadoop tool we're building and since I like poker it seemed like a poker dataset would be more interesting for me to play with then most of the other free datasets online.
Is this like a generalizable version of that scrensaver thingy that use to be popular where your computer would analyze data looking for ET communication signals when you weren't using it?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:34 AM
Quote:
Originally Posted by gaming_mouse
Is this like a generalizable version of that scrensaver thingy that use to be popular where your computer would analyze data looking for ET communication signals when you weren't using it?
I'm not sure what you mean by "this". Do you mean hadoop?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:41 AM
Quote:
Originally Posted by gaming_mouse
why? the two skillsets are independent. why not just say, how can someone call themselves an expert in html/CSS when they can't setup an nginx server to serve the pages they create?
you really think there's no correlation between the skillsets of a developer and a sysadmin? There's common ground in the skills themselves, and also in the fact that people who are interested in one are more likely to have some affinity for the other (more than, say, your average truck driver).

Plus the more you understand about the whole setup, the better. Driving the delivery truck probably won't help you write better code, but being familiar with the system on which it's going to run definitely will.

All that said, I'm sure Heroku does make economic sense for a lot of companies. But you can't pretend one skill has absolutely nothing to do with the other.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:51 AM
shabby,

by "this" he means "your project with poker data". by "screensaver thingy" he means "seti@home".

hth,
tyler

Last edited by tyler_cracker; 09-21-2011 at 11:54 AM. Reason: "i deal with the goddamn customers so the engineers don't have to!"
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 11:55 AM
Quote:
Originally Posted by tyler_cracker
shabby,

by "this" he means "your project with poker data". by "screensaver thingy" he means "seti@home".

hth,
tyler
no, i meant "seti@home" and "hadoop or any of its subprojects"
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 12:01 PM
Quote:
Originally Posted by RoundTower
you really think there's no correlation between the skillsets of a developer and a sysadmin? There's common ground in the skills themselves, and also in the fact that people who are interested in one are more likely to have some affinity for the other (more than, say, your average truck driver).

Plus the more you understand about the whole setup, the better. Driving the delivery truck probably won't help you write better code, but being familiar with the system on which it's going to run definitely will.

All that said, I'm sure Heroku does make economic sense for a lot of companies. But you can't pretend one skill has absolutely nothing to do with the other.
i'm not saying there is no correlation, but neither skill implies the other logically, and the absence of either skill does not imply the absence of the other.

the vast majority of people who know as much as i do about programming and web development know way more about server admin. it's definitely a big knowledge gap for me and lately i've been really feeling the consequences. so i agree with you in that sense.

on the other hand, many server admin types, while they might know a bit of programming, are really not good at it imo, and make all sorts of sloppy mistakes.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 12:05 PM
Hadoop is basically an open source framework for supporting MapReduce jobs on distributed systems. With it you can pretty easily write some Java code to process a huge chunk of data on a distributed system of N nodes.

Pig is a layer on top of Hadoop and offers a simple programming language for writing data processing jobs which it then compiles into map reduce jobs that get run on Hadoop.

It's not really similar to seti@home - except for the fact that they're all dealing with distributed computations.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 12:09 PM
Quote:
Originally Posted by jjshabado
Hadoop is basically an open source framework for supporting MapReduce jobs on distributed systems. With it you can pretty easily write some Java code to process a huge chunk of data on a distributed system of N nodes.

Pig is a layer on top of Hadoop and offers a simple programming language for writing data processing jobs which it then compiles into map reduce jobs that get run on Hadoop.

It's not really similar to seti@home - except for the fact that they're all dealing with distributed computations.
could you use it to do parallel computing tasks like solving big poker abstractions, or does that require too much node to node communication?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 01:15 PM
Quote:
Originally Posted by jjshabado
I want to play around with a Pig/Hadoop tool we're building and since I like poker it seemed like a poker dataset would be more interesting for me to play with then most of the other free datasets online.
I am really interested in this myself and I am really interested in also doing some stuff with Mahout on top of that. Talk to me via PM or skype 'kaderbelbina' and we'll figure out if we could work on something like this together (I supply data / we both play around w/ it and have access to code / environments etc).

I also have about 5 computers doing nothing right now for a test cluster :-D
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 01:41 PM
Quote:
Originally Posted by gaming_mouse
could you use it to do parallel computing tasks like solving big poker abstractions, or does that require too much node to node communication?
It would most likely help, but it depends a lot on the specific problem.

If you're talking about something that takes in hundreds of thousands (or millions, or billions) of hand histories and boils that information down to something small (like a ranking of biggest money winners to biggest money losers) - then it would definitely help. That's basically the ideal situation for a MapReduce problem.

If you're talking about something that is much more related to pure computation (like simulating a hand match-up billions of times), the answer is a lot less clear. Hadoop would still probably help because it abstracts the problem of dealing with a cluster of computers - but like you said you might be paying a big price in terms of inter-node communication. It's surprising though how often a problem can be broken up in a way that works really well with Hadoop.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 09:43 PM
Quote:
Originally Posted by nextgenneo
I run ******** and we datamine around 8 gigs a day. What do you need it for? PM me if you want or post on here. We like helping out developers / researchers.
Thanks for helping me out!

I'm hoping to take a look at these tomorrow and maybe I'll start a thread where I give some examples of what I'm doing.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 10:10 PM
Quote:
Originally Posted by Shoe Lace
What's the difference between spending 2-3 hours on Heroku's site exploring their platform's docs and fooling around with it vs spending 2-3 hours on Google figuring out how to install something on linux?

In both cases you're spending 2-3 hours.

It's possible we just come from 2 different worlds. The world I live in does not support paying an extra $150/month to have an unproven / non-profit generating web site put online that requires a small staff to keep it updated.

For an unfunded start up $150/month is a lot of money. If it was an established company that's already making decent $ then maybe it wouldn't be a big deal.

Most non-technical startup founders are really really tight with their money. They might have a crummy job just barely making rent/bills. Maybe they bring in a partner to help front some $ for development costs. You think they will be happy when you tell them "oh yeah, from day 1 it's going to cost around $200/month to have your site hosted.".
*disclaimer* I am not a sysadmin. I'm a programmer by nature but also have a fairly good set of sysadmin skills

You are naively simplifying the task of an admin. Setting up a server properly isn't about popping an installation cd in the computer and then double clicking some .exe for the application server, then simply dragging and dropping your deployment to some directory.

On the flip side, do you think an administrator can google for 2-3hrs and start writing enterprise level applications?

If your company can't afford it, fine...that's your perogative to save money. but when
  • server gets hacked
  • server stops responding because disk is full and you didn't partition properly

See how many hours of googling it takes your team to fix it.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-21-2011 , 10:37 PM
I have enough experience with it that I'm not just randomly typing empty statements. I wouldn't call myself a full blown sys admin either but I've installed multiple distros of Linux, setup multiple web servers (not using Apache/PHP), actively develop in Linux and feel comfy enough that my inability to know every last detail about Linux isn't holding me back.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-22-2011 , 09:04 AM
Epic documentary some of you will love:
http://watchdocumentary.com/watch/co...d562b3a03.html

Follows netscape at their peak, going open source (Mozilla) and then selling to AOL. Had some classic lines in it: "AOL is for idiots" and had me lolling a lot from the endearing nature of how computers were only 10 years ago.

A*
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-22-2011 , 11:02 AM
Quote:
Originally Posted by Gullanian
Epic documentary some of you will love:
http://watchdocumentary.com/watch/co...d562b3a03.html

Follows netscape at their peak, going open source (Mozilla) and then selling to AOL. Had some classic lines in it: "AOL is for idiots" and had me lolling a lot from the endearing nature of how computers were only 10 years ago.

A*
Wow epic. Great quote about 11:50 in:

'This is a monk like existence. There are very few women in these societies. These are male societies. These are secret societies. They function very much like the Masons or some street gang.'
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-22-2011 , 11:06 AM
I loved the dude they couldn't find to fix bugs who had a bazillion cans of coke on his desk. And the scenes of families playing in the house with the man in the dark room in the background programming with a headset on. So great!

The coder from thousands of miles away doing open source contributions made me lol, when asked why he was doing it he just said "because the code is really bad and messy!" lololol what a great documentary
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-22-2011 , 11:51 AM
Haha yeah. That guy just sat around refactoring their code for free, what a hero. Absolutely awesome doc. Gonna make everyone watch it here at our startup.

Another one of my favorite quotes was 'Its almost like an addiciton, an adreneline rush, of going for perfection and then, as you see the results, you get the feedback to push harder'.

The irony was I've been up since 5am coding and watched that documentary at around 730am.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-23-2011 , 06:42 PM
09-24-2011 , 03:06 PM
I don't ever write many .bat commands for windows often, but can someone tell me if it's possible to:

- Connect to FTP
- Rename _app_offline.htm to app_offline.htm in the remote folder
- Upload by FTP a directory I specify ignoring folders/files I specify to ignore
- Delete app_offline.htm

In one set of commands?

Also, is it possible to publish a website into a local folder (usually done via VS2010) with a bat command thus saving me another click?

This would be super useful if it was possible but I don't know if it is.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
09-24-2011 , 03:17 PM
it's bound to be possible. no idea how on windows though

Last edited by _dave_; 09-24-2011 at 03:18 PM. Reason: if .bat fails (likely) AHK is bound to be able to do the VS2010 bit imo
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
$25m Guaranteed WPM on CoinPoker
Join the action now
Daily Rewards • Splash Pots • CoinRaces
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **

      
m