Open Side Menu Go to the Top
Register
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** ** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **

10-31-2013 , 02:46 PM
Quote:
Originally Posted by clowntable
My first working hypothesis would be that one of his coworkers is responsible for all of this and it's not nearly as sophisticated as he thinks
hahah that would be the ultimate troll.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 02:57 PM
Quote:
Originally Posted by jjshabado
Obligatory - "If that was 3 pages for you, you're worse than a person that puts a curly bracket on its own line"
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 04:05 PM
https://www5.harrisbank.com/HOB/reta...hobdecidelogon

hay guise guess what, when you disable right clicking by linking a separate javascript file, it doesn't actually make your banking site "secure".
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 04:22 PM
Quote:
Originally Posted by derada4
This is pretty mind-boggling for anyone who hasn't heard about it yet, a virus that can communicate to another computer by using high frequency sound waves through the microphone and speakers:

http://arstechnica.com/security/2013...jumps-airgaps/

That's sick.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 04:25 PM
Nexus 5 is out (and out of stock) http://www.google.com/nexus/5/
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 09:41 PM
Had a day long meeting with a Cloudera engineer ($400 an hour, we're in the wrong technology) and it turns out our production cluster was set up making the wrong choices at almost every decision point. Weeeeee!
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 09:45 PM
Cloudera is absurdly over priced. I still don't really get how in this day and age people still pay companies like that ridiculous amounts of money.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 09:58 PM
Quote:
Originally Posted by jjshabado
Cloudera is absurdly over priced. I still don't really get how in this day and age people still pay companies like that ridiculous amounts of money.
Larry Ellison is being forced to take a pay cut so I guess that's a good sign

http://www.bloomberg.com/news/2013-1...l-meeting.html
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 10:10 PM
wait wait wait

products provided by a company where larry ellison is involved are overpriced?

i am shocked. shocked.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 10:16 PM
Quote:
Originally Posted by jjshabado
Cloudera is absurdly over priced. I still don't really get how in this day and age people still pay companies like that ridiculous amounts of money.
It's like crack. The documentation and community is good enough to get you so far but not to next level so at a certain point you have to pay for the expertise you haven't got.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
10-31-2013 , 11:27 PM
Quote:
Originally Posted by kerowo
It's like crack. The documentation and community is good enough to get you so far but not to next level so at a certain point you have to pay for the expertise you haven't got.
In what way?

There are a number of companies out there that provide a lot for a lot cheaper. Granted, I'm biased given that I work at one of them...
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 06:42 AM
Quote:
Originally Posted by jjshabado
Cloudera is absurdly over priced. I still don't really get how in this day and age people still pay companies like that ridiculous amounts of money.
Quote:
Originally Posted by kerowo
Had a day long meeting with a Cloudera engineer ($400 an hour, we're in the wrong technology) and it turns out our production cluster was set up making the wrong choices at almost every decision point. Weeeeee!
.

?!
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 06:56 AM
C# / .NET experts,

I would be forever indebted to you if you can answer this SO question, which was posed by someone from a firm we outsource some things to, and is slowing down my development timeline. I know nothing about Microsoft server admin, which is what this involves:

http://stackoverflow.com/questions/1...ol-allow-heade

(and if you don't know the answer, an upvote would be appreciated on the chance it gets it some more attention)

Thanks guys!

EDIT: also, if you don't know the answer but have an idea where i could find someone who could help (i don't mind paying), that would be appreciated too.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 07:42 AM
Quote:
Originally Posted by jjshabado
In what way?

There are a number of companies out there that provide a lot for a lot cheaper. Granted, I'm biased given that I work at one of them...
I'm not entirely sure of the history, I'm new to the project and everyone that started the project no longer works for us. I don't know if we started with Cloudera or migrated to it at some point. Essentially our name node had been a data node in the past and was never cleaned up of old data. We're storing data on the / partition and used our standard RAID configuration of the discs combining several discs into a virtual bigger disc. Oh, and our file format is CSV and we're not using any compression. On the plus side, once we get the boxes rebuilt and configured properly we should see some big improvements in our run times...
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 08:27 AM
If you use the cloud and s3 you avoid almost all of those problems.

Obviously I don't know all of your companies specific details so I realize I could be way off base here. But the majority of companies in your situation would be able to keep their data on S3 without any real negatives (and some big positives) and you'd be able to spin up fresh hadoop clusters on hardware just as you need them. If you don't have any big jobs you can save a bunch of money not running the cluster and if you have a really big job you can spin up a larger cluster just for that job.

You save money on hardware costs, licensing costs, and consulting costs.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 09:02 AM
Obvious downside/negative of s3 is that it's a US based company (that is known to comply with authorities). It's becoming surprisingly relevant over here especially since companies that tend to need something involving hadoop are also the ones that often have somewhat sensitive data they are worried about (or at the very least a big quantity of data).

Which makes me wonder along the same lines...is there a good non-US github clone for private repos?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:07 AM
I don't have a good handle on our data but I think the cost of moving the data in and out is prohibitive, particularly when we already manage a **** ton of servers in house. I'm not sure if there are privacy concerns, but wouldn't be surprised. Regardless, I have very little input into the design decisions of the nodes, my responsibility is getting operational experience to be able to backup the guy who runs the production job stream.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:30 AM
Quote:
Originally Posted by kerowo
I don't have a good handle on our data but I think the cost of moving the data in and out is prohibitive, particularly when we already manage a **** ton of servers in house.
I actually doubt this is true, especially given all the other cost savings you have. Getting data into s3 is almost free and once your data and Hadoop cluster are both in AWS you can run jobs against your data at no cost and at a very minor performance hit (vs having your data in HDFS on your cluster).

Quote:
Originally Posted by kerowo
I'm not sure if there are privacy concerns, but wouldn't be surprised. Regardless, I have very little input into the design decisions of the nodes, my responsibility is getting operational experience to be able to backup the guy who runs the production job stream.
Fair enough, and I assumed that if you have a contract with Cloudera its a big enough company that any sort of significant change like moving data/servers to the cloud would be painful, long, and involve a lot of Management peeps.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:33 AM
Quote:
Originally Posted by gaming_mouse
C# / .NET experts,

I would be forever indebted to you if you can answer this SO question, which was posed by someone from a firm we outsource some things to, and is slowing down my development timeline. I know nothing about Microsoft server admin, which is what this involves:

http://stackoverflow.com/questions/1...ol-allow-heade

(and if you don't know the answer, an upvote would be appreciated on the chance it gets it some more attention)

Thanks guys!

EDIT: also, if you don't know the answer but have an idea where i could find someone who could help (i don't mind paying), that would be appreciated too.
Not an expert, but I had to deal with a bunch of these errors when I was at that C# place, and there was never a time it was an issue with the server config.

In particular, I wasted half a day chasing a "server config" error when in reality I simply did not know about if page not onload or some silly method like that.

Just saying because I found a ton of advice on SO that suggested server suggestions that would break security, which desrves a skeptical eye.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:42 AM
Quote:
Originally Posted by jjshabado
I actually doubt this is true, especially given all the other cost savings you have. Getting data into s3 is almost free and once your data and Hadoop cluster are both in AWS you can run jobs against your data at no cost and at a very minor performance hit (vs having your data in HDFS on your cluster).



Fair enough, and I assumed that if you have a contract with Cloudera its a big enough company that any sort of significant change like moving data/servers to the cloud would be painful, long, and involve a lot of Management peeps.
We're generating about 500k pages of pdfs a month that are being sent to a printer to give you an idea of data flow.

At the moment we've only paid Cloudera to come in and consult, we don't have a standing contract with them, we may go that way if business expands.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:46 AM
Even at 2 MB a page you're talking less than $100/month for storage costs.

Edit: Just to be clear, that's $100/month for each month of generated data.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:56 AM
Quote:
Originally Posted by gaming_mouse
C# / .NET experts,

I would be forever indebted to you if you can answer this SO question, which was posed by someone from a firm we outsource some things to, and is slowing down my development timeline. I know nothing about Microsoft server admin, which is what this involves:

http://stackoverflow.com/questions/1...ol-allow-heade

(and if you don't know the answer, an upvote would be appreciated on the chance it gets it some more attention)

Thanks guys!

EDIT: also, if you don't know the answer but have an idea where i could find someone who could help (i don't mind paying), that would be appreciated too.
If you specify what's getting sent in the OPTIONS request and what's being received, you may have a better chance of getting the answer. As it stands, it's not clear what in the chain is responsible.

There's also a typo - a single quote following x-user-session but I assume that's not in the actual code.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:56 AM
I thought you paid for getting data out more than for storage, the cluster is around 2TB of data to generate the above reports, which is still less than the cost of a server per month I suppose.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 10:59 AM
Quote:
Originally Posted by kerowo
I thought you paid for getting data out more than for storage, the cluster is around 2TB of data to generate the above reports, which is still less than the cost of a server per month I suppose.
You do - but not for retrieving data on a machine in AWS land.

So if you're running your Hadoop cluster in AWS you can access all of your data for free. If you're actually sending all of that data somewhere its like $240 to retrieve 2TB of data. Like you said though, still pales in comparison to other costs.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
11-01-2013 , 11:27 AM
Quote:
Originally Posted by clowntable
Obvious downside/negative of s3 is that it's a US based company (that is known to comply with authorities). It's becoming surprisingly relevant over here especially since companies that tend to need something involving hadoop are also the ones that often have somewhat sensitive data they are worried about (or at the very least a big quantity of data).
What do you mean by this? Do you mean comply with things like warrants/subpoenas or comply with things like NSA special requests?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote

      
m