Open Side Menu Go to the Top

06-26-2012 , 01:00 AM
Is this a GPU problem?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
$25m Guaranteed WPM on CoinPoker
Join the action now
Daily Rewards • Splash Pots • CoinRaces
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
06-26-2012 , 01:05 AM
Quote:
Originally Posted by Ryanb9
What is it that you are doing? we promise not to tell anyone. And I would say you have a pretty big problem if its taking that long.
Seriously, it really isn't that interesting. Honestly. You would be very disappointed (and bored to tears) if you watched them.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 01:05 AM
Quote:
Originally Posted by Chips Ahoy
Is this a GPU problem?
Is it? I honestly have no idea. I know very little about hardware. I'm a software guy.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 01:18 AM
Gotcha. If I were you, I would just look into what resources are being used when video is being converted. Is CPU maxed out? Are all your cores being used? Is memory maxed out?

I would guess that video conversion is probably way more CPU-intensive than anything else. And, if that's the case, you can see that immediately just by checking your resource usage.

If it's not that, it might be HD speed. I dunno if Amazon offers SSD data storage or what your budget is, but that or holding everything in RAM are the only real solution for HD-dependent run-times.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 01:36 AM
Quote:
Originally Posted by NoahSD
Gotcha. If I were you, I would just look into what resources are being used when video is being converted. Is CPU maxed out? Are all your cores being used? Is memory maxed out?

I would guess that video conversion is probably way more CPU-intensive than anything else. And, if that's the case, you can see that immediately just by checking your resource usage.

If it's not that, it might be HD speed. I dunno if Amazon offers SSD data storage or what your budget is, but that or holding everything in RAM are the only real solution for HD-dependent run-times.
Thanks man.

It seems to be the consensus answer that its a more CPU intensive process than memory intensive (i guess thats the term? whatever).

Unfortunately Amazon doesn't use SSD storage. That's actually one of the most common gripes about them.

They do, however, offer a a high CPU instance with proportionally more CPU resources than memory - it's got 7GB of memory and 20 EC2 units (8 virtual cores with 2.5 EC2 compute units each).

It isn't terribly expensive - a year long commitment is about $3400. I'm thinking about starting an instance just to do some benchmarking to see exactly how much quicker it works on that beast.

If anyone else has any advice I'd love to hear it.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 02:02 AM
You ignored my primary piece of advice. Just check the resource usage yourself while it's converting. On linux, this means running the "top" command. On Windows, it means opening task manager.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 02:42 AM
Quote:
Originally Posted by NoahSD
You ignored my primary piece of advice. Just check the resource usage yourself while it's converting. On linux, this means running the "top" command. On Windows, it means opening task manager.
Sorry, wasn't being clear. I'm definitely doing that first. I was just saying I'm also gonna play around with it a little bit just to see how well it compares.

I'm definitely all about going for the free (and simple) solution, particularly when it's coming out of my own business.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 05:46 AM
I've never used Amazon but you should be able to just ramp up the RAM quite easily right? That would probably be the easiest way for better performance in converting if you can fit the whole thing into memory. You say it's 7.5gb, try going to 16gb and see if it helps much. Also I think you want as many CPU cores as possible.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 08:35 AM
Figured it out.

By default, multi threading isn't enabled in ffmpeg. It just has to be enabled on the command line to take advantage of more than one CPU core.

Easy fix.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 09:50 AM
I have a database table of sports teams and their players. I want to create a web form that will dynamically generate based on user input. For example, the user will select a team, then the second part of the form will generate without refreshing, giving the user choices for the players of that team.

I assume I need to learn AJAX to create this. Correct? Since I need to interact with my database.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 10:41 AM
Quote:
Originally Posted by splashpot
I have a database table of sports teams and their players. I want to create a web form that will dynamically generate based on user input. For example, the user will select a team, then the second part of the form will generate without refreshing, giving the user choices for the players of that team.

I assume I need to learn AJAX to create this. Correct? Since I need to interact with my database.
Yep, but ajax isn't actually a programming language, though. It's more of a technique where you use javascript on the web page at the user's end to interact with the server without reloading the page.

There are basically going to be three parts to make it work: the web page/javascript on the client side, some sort of script on the server to handle the data coming from the user (commonly PHP or Python or Ruby), and of course the database where the data is stored.

If you're interested in learning about javascript/ajax, I'd recommend going through some javascript tutorials to get the basics down and then checking out jQuery. It's a very well developed, widely used javascript library that makes common tasks like ajax very easy.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 10:49 AM
Learn about graceful degradation. If you write the page first that works when AJAX is not available it will work for everyone (win).

Then when that's working, add another layer on top which will do fancy AJAX stuff.

This design pattern is really really good for lots of reasons.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 12:56 PM
Quote:
Originally Posted by sdturner02
I'm currently using ffmpeg on a dedicated Amazon EC2 Large instance (7.5GB memory, 4 EC2 computer units) running 64bit Linux.

ffmpeg does work well but it takes too long. I'm impatient, but more importantly, users are impatient. Right now it's taking several minutes to convert a video that's 4 or 5 minutes long.
Are you using the -thread n switch?

Edit: nevermind
Quote:
Originally Posted by sdturner02
Figured it out.

By default, multi threading isn't enabled in ffmpeg. It just has to be enabled on the command line to take advantage of more than one CPU core.

Easy fix.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 06:41 PM
just wanted to pop-in and say: Goddammit, I love Pig/Hadoop! what a joy to work with.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 07:00 PM
I'm sorry, Hadoop just sounds like hippie technology used by people with dirty feet.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 08:22 PM
i'd rather eat granola and work with Hadoop, than foie gras and Cosmos. what a cluster****.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 08:23 PM
I've had a hard time explaining some resume gaps recently. I'm currently unemployed, my last job was as a web communications analyst for nearly four years. Before that however...I was a pro poker player (gasp!) and a college dropout.

I've been skirting the issue, trying my best to close the gaps on the resume with projects I've worked on (even though it wasn't how I made my living).

Have any of you been truthful about your poker past in the world of tech job searches? Should I just come out and say it?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-26-2012 , 09:21 PM
Quote:
Originally Posted by MikeyObviously
I've had a hard time explaining some resume gaps recently. I'm currently unemployed, my last job was as a web communications analyst for nearly four years. Before that however...I was a pro poker player (gasp!) and a college dropout.

I've been skirting the issue, trying my best to close the gaps on the resume with projects I've worked on (even though it wasn't how I made my living).

Have any of you been truthful about your poker past in the world of tech job searches? Should I just come out and say it?
You did no consulting at all during that span?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 08:04 AM
Quote:
Originally Posted by MikeyObviously
I've had a hard time explaining some resume gaps recently. I'm currently unemployed, my last job was as a web communications analyst for nearly four years. Before that however...I was a pro poker player (gasp!) and a college dropout.

I've been skirting the issue, trying my best to close the gaps on the resume with projects I've worked on (even though it wasn't how I made my living).

Have any of you been truthful about your poker past in the world of tech job searches? Should I just come out and say it?
I have poker pro in my resume for the time where that way my main source of income. My assumption is a simple one, if people don't see how that could actually be an interesting skillset or at least try to understand it it's a workplace I don't want to be stuck at anyways. So it's actually a pretty good filter (if you feel you can pick and choose your employer and are not in "need work" mode).

Despite what the poker coaching industry and so forth want to tell you making a living from poker is pretty hard. You need a very solid mindset and understanding of variance vs your skill degrading. You need to be self motivated and constantly learn and improve. You need to understand how the long run works. You need an excellent analytical mindset.
All that is valuable.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 01:51 PM
man i just spend TWO DAYS trying to get a demo php app for a web api working. fv<kin thing was full of bugs, php syntax errors, etc. jesus christ.
  • inconsistent variable names $productID and $product_id
  • incorrectly using variable syntax when hes defined var as a constant instead
  • bad links across the project <a href="/billing.php"> seriously "/"
  • 'undefined constant' errors cause the guy didn't quote his strings

its like the guy just posted the project on github without ever testing whether it worked or even paying any attention to php error messages

at least now i'll learn how to use github and fork a project. these bastards should be paying me
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 03:11 PM
I'm looking for some ideas on the best way(s) to proceed with a website. I have a lot of data organized in excel files that I want to extract and display. What I'm looking for, I assume, is getting into database management.

Primarily I am looking to recreate the tables from excel to be displayed in a similar fashion. How do I take the cell information and transpose it to the site? This involves (again assuming here) converting the excel to some format (would love to avoid manual data entry) that some language/script will then turn into tables. Is there a way I can just convert to csv, upload, then get output? I can do the css/html for the output, my issue is I don't know the best way to get that output. In terms of size it is ~10 sheets, none being uniform, with anywhere from 20-500 cells of data per sheet.

I realize what I'm asking is very general but I have no experience in this area so I don't know what I should be learning. Any help is appreciated.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 03:49 PM
Do you need your website to stay in sync with any changes that happen in the spreadsheet? Is the data going to change at all?
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 04:41 PM
Anyone of you hired programmers have any thoughts on QA's? I might be getting a job as a QA for a software company which makes roster programmes. The office employs about 5 QA's and around 10 programmers. I am not very technical at all and know nothing about programming. Is this normally the case with QA's who you have dealt with or will I struggle to interact problems effectively with the programming team with no IT background?

(I think I worded this post awfully, sorry I'm very tired.)
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 04:59 PM
QA is more about being methodical and thorough than necessarily being able to read the code. It'd be good to pick up the architecture so you know where what you are seeing on the application is coming from, but I'd rather have someone who can narrow down the cause of a bug and document it than a wannabe dev.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
06-27-2012 , 05:03 PM
Quote:
Originally Posted by splashpot
Do you need your website to stay in sync with any changes that happen in the spreadsheet? Is the data going to change at all?
Yes, but that isn't a major concern at the moment. Eventually I would like it to be so that all I have to do is update the ss, upload/convert it on backend, it gets updated front end.
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** Quote
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **
$25m Guaranteed WPM on CoinPoker
Join the action now
Daily Rewards • Splash Pots • CoinRaces
** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **

      
m