** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD ** - Page 706 - Computer Technical Help

Two Plus Two Forums Other Topics Computer and Technical Help

** UnhandledExceptionEventHandler :: OFFICIAL LC / CHATTER THREAD **

Post Reply Subscribe

...

Page 706 of 1603

First

206 506 606 656 686 696 701 702 703 704 705 706 707 708 709 710 711 716 726 756 806 906 1206

Last

Page 706 of 1603

First

206 506 606 656 686 696 701 702 703 704 705 706 707 708 709 710 711 716 726 756 806 906 1206

Last

04-08-2015 , 12:15 AM

#17626

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

@jmakin Do you know about JavaFX, it is sort of the replacement for Swing and I didn't really know about it much till a month ago.

I'm not suggesting you do it in JavaFX because I would just do it in Swing if everyone is comfortable with it.

I would suggest checking javafx out, if you like writing java and plan to make complex applications with it. Benefits of javafx is that code tends to be shorter and cleaner to do things vs in swing.

Quote

$25m Guaranteed WPM on CoinPoker

Join the action now

Daily Rewards • Splash Pots • CoinRaces

04-08-2015 , 12:19 AM

#17627

jmakin

banned

Join Date: Jan 2008 Posts: 27,798

I'll check it out.

I've made several simple applications with swing so i'm pretty comfy with it but I doubt i'll be touching much code, they're not letting me in at all in that arena and tbh i'm fine with that as long as ****s getting done, which it seems like it finally is.

Quote

04-08-2015 , 12:27 AM

#17628

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Anyone with any web scraping experience know anything about sites blocking scrapers? Im trying to collect my credit card data, and im posting the login in what Im pretty sure is a functional manner, but it just returns a "This site is currently unavailable" message every time and the site is definitely available to a real user. No clue where to go from here tbh

Quote

04-08-2015 , 12:31 AM

#17629

iversonian

Carpal \'Tunnel

Join Date: Sep 2003 Posts: 21,447

step 1 what's your user agent?

Quote

04-08-2015 , 12:32 AM

#17630

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

Quote:

Originally Posted by jmakin

I watched most of these(check out link), I recommend them if you are like me and prefer watching videos sometimes.
Link: https://www.youtube.com/playlist?lis...YVy8EbTdpGbUIG

Quote:

Originally Posted by fluorescenthippo

Hey guys I'm looking to get into product management. Obv this is a dev forum but I think like a dev and definitely respect developers' opinions.

I have financial analyst and business analyst backgrounds and recently completed a web dev bootcamp for some technical experience. I'm thinking its prob best to become more well rounded in all the aspects a PM touches on first, since PM is pretty competitive. It seems like working at a startup as a "PM" / hustler / analyst is best for this. Thoughts?

Also if anyone wants to hook me up with an associate product management position I'll take that as well.

Am I reading this wrong or do you want to basically become a project manager for software or web development? I would think there is no chance of that happening unless you already in your career have 3-5 years in actual development of software.

Last edited by iosys; 04-08-2015 at 12:53 AM.

Quote

04-08-2015 , 12:35 AM

#17631

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Quote:

Originally Posted by iversonian

step 1 what's your user agent?

Well, thank you. That was rather easy eh?

Quote

04-08-2015 , 12:37 AM

#17632

suzzer99

Save the Cheerleader, Save the World

Join Date: Nov 2005 Posts: 101,163

I've never heard of scraping that involved a login and gathering credit card data.

I did some site scraping for a healthcare industry recruiter who had gotten access to professional websites like respiratory techs and stuff. A few of the sites ran the same software that would lock you out with more than 10 requests per minute. So I'd just make 9 requests, wait a minute, make 9 more. Always wanted to start that on Friday night when no one is around to look at the web logs.

Quote

04-08-2015 , 12:38 AM

#17633

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Its my credit card data. I want to write something that downloads new transactions for each of my cards every hour and send the info to my phone in widget form.

Quote

04-08-2015 , 12:39 AM

#17634

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

Quote:

Originally Posted by PJo336

Well, thank you. That was rather easy eh?

My sarcasm detection is on and I detect it.
I'm generally interested in web scraping, I've only made basic spiders to retrieve website files(pdfs mainly). I would think that he suggested creating a web agent that matches a real user and not a robot, so you don't get blocked instantly like browser details. Maybe that is common sense to you?

Quote

04-08-2015 , 12:42 AM

#17635

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Oh no, no sarcasm at all, sorry if it came off that way. I had the user agent commented out, and clearly wasnt paying enough attention. Finding the next page after login perfectly now

Quote

04-08-2015 , 12:43 AM

#17636

suzzer99

Save the Cheerleader, Save the World

Join Date: Nov 2005 Posts: 101,163

Quote:

Originally Posted by PJo336

Its my credit card data. I want to write something that downloads new transactions for each of my cards every hour and send the info to my phone in widget form.

Are you keeping track of your wife or kids or something?

There's definitely a security risk to keeping something as sensitive as a password to your credit card account in code. It gives me the willies.

Also how are you sending this potentially sensitive info. to your phone?

Quote

04-08-2015 , 12:46 AM

#17637

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

Yah you might want to encrypt the data that gets sent over by a text and then read it in by an app to be decrypted. I would bet money that there would be a demand for what suzzer is suggesting. Monitor finances of partner and kids with details all sent to your phone and displayed with graphs of their spending habits lol

Quote

04-08-2015 , 12:48 AM

#17638

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Well, I am using an encryption library, storing the password and username encrypted in a mongodb collection, so that should be fine. Im logging in and downloading a csv with all transactions, parsing them out, storing them to mongo, deleting the csv. Rinse repeat every x minutes.

Then a rest endpoint to serve the transaction data, which Ill make a phone app to query.

This is all theoretical, right now I just login and print the html of the first page.

Quote

04-08-2015 , 12:50 AM

#17639

suzzer99

Save the Cheerleader, Save the World

Join Date: Nov 2005 Posts: 101,163

Should work - except for the part where you go from scraping the first page to downloading a CSV. Does the CC provider offer that?

Quote

04-08-2015 , 12:53 AM

#17640

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Every site I plan to scrape has them yes. One of which is available on the initial landing page, the other will involve some "clicks". Mostly Im just hoping to not get myself into trouble with any banks

Quote

04-08-2015 , 12:55 AM

#17641

suzzer99

Save the Cheerleader, Save the World

Join Date: Nov 2005 Posts: 101,163

Is this something you're hoping to mass produce or just for personal use? Follow up question - is your wife a shopoholic?

Quote

04-08-2015 , 01:00 AM

#17642

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Initially its just for personal use, at least for proof of concept. I want it for me right now.

Follow up answer - I am a single man who spends too much money and currently has too much free time

Quote

04-08-2015 , 01:05 AM

#17643

suzzer99

Save the Cheerleader, Save the World

Join Date: Nov 2005 Posts: 101,163

So you're tracking yourself. Well good luck. I can't see much market in that. But tracking the wife, kids etc. is interesting.

Quote

04-08-2015 , 01:14 AM

#17644

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

What would be the difference if you have your wife/kids login information already? Theres plenty of self tracking apps, like Level. I just dont really feel like giving random apps all my bank account info and I want something completely customizable. Its also a good chance to look at Swift

Quote

04-08-2015 , 01:14 AM

#17645

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

Yah more interesting in tracking partner and kids than oneself.

I'm not married but do couples have banks that share a single account where the banks split their account into two identities. Like do withdraws show which couple by credit card number or name made the purchase?

Quote

04-08-2015 , 01:15 AM

#17646

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

I wish I had a marketable idea I was excited about

Id pour hours into a project on my own I actually cared about

Quote

04-08-2015 , 01:22 AM

#17647

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

I think what you're working on is really marketable. Not sure why it doesn't excite you.

Quote

04-08-2015 , 01:31 AM

#17648

Larry Legend

Celtic Pride

Join Date: Jul 2009 Posts: 42,243

Isn't this www.mint.com?

Quote

04-08-2015 , 01:39 AM

#17649

iosys

old hand

Join Date: Sep 2011 Posts: 1,753

Quote:

Originally Posted by Larry Legend

Isn't this www.mint.com?

There is so much more you could really build onto what they are doing.
I'm surprised really when I think how underdeveloped this field is compared to other software choice focuses. You could really build a lot of stuff onto it compared to just showing the data, which is what it looks like they are doing.

Sort of crazy that Mint is worth 140M lol and a app on phone that sends dick pics is worth billions.

Quote

04-08-2015 , 01:41 AM

#17650

PJo336

THRILLHOUSE!

Join Date: Mar 2007 Posts: 22,158

Quote:

Originally Posted by Larry Legend

Isn't this www.mint.com?

Yeah, theres a ton like this. Hence like suzzer said, its not marketable really in the sense that its already been taken to market 100 times. I just want a simple widget where I can put whatever I want on it.

The other side of it though, is that if I build a full fledged rest api to access the bank information, it could be marketed to other developers to use the data to do as they wish