haha you genius that's really good. That'll probably be involved in my load process. But I want to save the files in a format where you can click a page link and it takes you to the next page in the series of HTML pages, for easy reading. A little ambitious probably. There's probably a messy shell script solution for that too.

damn, when you give a URL with index*.html, if it's larger than the number of pages, the site just gives you the last page. No idea how to end that loop.

Theres a really filthy way to do it. Nvm

Parse out the page number and wait for it to repeat.

Totally understandable that your boss wants to know. Put yourself in his position. Pretty sure he won't be satisfied with your explanation.

I know little about Java and less about maven. A Google search reveals

Increasing Heap Size When Building with Maven

Quote:

1. Open your mvn.sh file and add the following line:
export MAVEN_OPTS=-Xmx512m
this will allow to specify java heap space based on your project needs.


How to increase Java Heap space for Maven on Windows
1. go to C:\apache-maven-2.2.1\bin
2. open your mvn.bat file and add the following line :
set MAVEN_OPTS=-Xmx512m
next time you run maven commands like mvn clean or mvn install it will use this heap size.
This article is in continuation of my earlier post on java heap 10 points on java heap space ....

Have you compared the amount of memory allocated to the heap with the builds that are working with what is allocated with MAVEN_OPTS?



I'm guessing you are probably correct but rooting the problem would go a long way in satisfying your boss and probably enhancing his opinion of your capabilities.

Wait wheres the nima drama? Main thread has been dead

No it’s very old drama. I almost had to sue him. Plus there’s a good chance of future drama. Just covering my bases.

Adios,

That’s one thing i havent tried. I tried setting the heap size with surefire-plugin but it didnt seem to be actually changing anything.

Say I have a webpage that works with this:

How do I

a) just test that in a new console? The stuff in the script tags loads (?) all the functions into the browser (I can do "whatever.api" in the console on that page to get a list of api functions) So, like go to any old page and get that api from console. (something like "var whatever = require("https://api.whatever.com")")

b) how do I use that api in node? - it's not available to npm install

Hopefully these questions make sense.

a) whatever (object) should be globally defined in the console on any page you load that script tag

b) uh copy and paste the js file into something, add module.exports = whatever at the bottom, require it in node?

You can use a tarball or a git url in npm dependencies (but not a straight JS file): https://docs.npmjs.com/files/package.json

If you really don't want to copy the file (IE - you want the code to always pick up updates) you can fetch it from within your node app.js and go from there. But keep in mind your node app (not just wherever you run npm install) will always need access to punch out to the internet - which probably isn't a problem for a small DIY app.

a) I do get that and can use the functions in the console on a page that was loaded that had that script tag. I think that's what you're saying. I was wondering if I could just go to console on say - Google - or 2p2 - or w/e - and I guess load the api from there.

b) Something like this has to work and I'll get it, but it's really effing hard (for me anyway). The js file has a bunch of window.*** and document.*** that it's generating, but won't work and I see it does a bunch of stuff to grab a bunch of other js files. I can see the requests and responses in the network traffic of the console.

Window isn't going to work in node - it's a browser construct. Why do you need this to run on the server-side and not in the browser?

Seems like that API thing is a dynamically generated script based on the parameters you send. So you're not gonna be able to run it on the server side. Is it open source?

I'm basically reverse-engineering a web page that takes user data, uses these functions and renders the page, only I don't know how I'm going to receive the data and it won't only be from web pages. I just need to receive the same data and functions, but my output is a pdf. My input could come from anywhere and my output could go to anywhere (it's the stream, not the file).

I don't know where my app will run, if it will be on a server of some kind or if someone will just run it as a script.

I just finished a similar project, but they had an npm package for that and I just had to install npm, require it and then I could call all the functions.

Maybe you can render the page in the browser and then use an HTML to PDF converter - programmatically.

Nope. That doesn't work so great - need too much customization in the PDF - and not part of the mission, and this is the paying gig, not my react/flask thing that's for me.

I'm starting to get it. I got all the javascript and made a bunch of separate files and put them in them with module.exports and there's a lot of rewriting, but I'm starting to get things that look like what I need. (at the moment I need this js to build urls that I can fetch things from the api with - and I know that works, I can grab the urls from the browser and do it).

It's so hard and taxing though. This is a pretty big site and there's not great documentation and it's really hard to jump in and figure stuff out and I barely know what I'm doing. It was the same starting the previous project and I try stuff for a while and it's like I just get overloaded/sleepy, come back and maybe do a little better...after a while I could somewhat predictably make progress. I think I'll be there soon with this one - soon like 5-10 more hours.

Not to be an ass (which means that this will surely be an ******* comment and i do know it going in) but how the hell did you get such a job paying like 3 times more than my hourlyy when you dont even know how to do it?

Also, how can i get such a job?

Someone who knows me has faith that I'll figure it out. I figured out the last project alright. And, I'm really putting in a lot more hours than I'm billing for now.

And this is a pretty hard project I think. The guy I'm working with/for who has been there a while is very busy and isn't sure how to do it or if it's really even possible and the people who wrote the api aren't there anymore.

But, like you're only making $20/hr programming? 'Cause I'm making $62 (though it's really less because I'm working extra).

And, I dunno, what's your skillset/speciality and where do you live?

weird flex to say you make $xx/hour but its less since you work more?

I didn't think I was flexing. The opposite really. I was thinking maybe he thought I was making more.

This is something people do a lot, it's not a flex, it's self preservation. If you are working on something that "should" take 40 hours and it takes you 80 you get to choose how much to charge for, and a lot of people choose "charge for 40" because they want to keep working the job.

Hopefully you grow into the job and 40 hours expected = 40 hours worked (or less) and you just consider it investment/education.

I remember when I took my first "real" job and I worked 60 hours/week because I wanted to convince the people I worked for I was "worth" it. I don't do that any more, but I don't have to, because I can produce in 20 hours what used to take me 60.

He’s giving away the hours he doesn’t bill to the project. Which is dumb because they hired him knowing he’d have to spend time figuring things out.

Sorta. Dude who hired me is not the owner and while he has faith in me, it's not without limit and he has expectations. I'm not donating time for the heck of it. At least for the first few months I want to make sure I'm delivering something reasonable in a reasonable time frame.

I think it'd be different in a regular permanent job, like you accept that people take a while to get on board and maybe a training period is normal. I'm sure in this spot I have to just put in some extra work for a little while.

This is a clear don't hate the playa hate the game kind of thing.

I'm not saying I'm a fan of it, but you're often faced with a choice:
* give up those hours now, but get fair hours in the future
* get paid for your time but lose the contract

this isn't limited to program jobs or really even to jobs. Things are not always fair, and you're often forced to choose. And sometimes, either way, you're wrong.



As a brief diversion let me relay a story a friend of mine told me. The numbers are approximate but close.

He started as a subcontractor working for IBM, I don't know doing what exactly. The contractor he worked for sort of dropped them and a new contractor came in, and interviewed them one by one. My friend was making 30k. The contractor asked what he was making and he said "55k" and the contractor didn't bat an eye. As he left the room he told the next guy "I told them I make 55k, and they didn't blink, you should do the same and tell the next guy" and that's what they did. So he started working a $30k job for $55k.

This made him think, am I really at the top of what I could get paid? So he started shopping around. He found his actual "title" or "level" which at IBM is an actual thing. He started calling contractors and saying "I'm a level X in department Y, how much will you pay to have me contract under you" and finally he found someone who was actually already an IBM employee but acting as a contractor on the side who would pay him $70k for the same job.

This means that for the job he was doing, the contractor was being paid enough for it to be worth their while to employ him at $70k - so they must have been paid more.

The moral here, if you want to call it that, is that it may seem set in stone how much you "can" or "should" make but the people who are paying you are way more likely to know the top number you can make, and it's in your best interest to find out what it is, and possibly, to try to achieve it

This story ends with him getting laid off perhaps a year later. I wonder if he'd have been laid off if he had stayed at the $30k level or $55k level. Like maybe those contractors could stay afloat because of their margins - they could take a haircut from IBM and still make money, but his contractor couldn't at $70k. Like maybe the job was paying $80k and the contractor was taking $10k and paying my friend $70k, but then IBM lowered the rate to $65k and any contractor paying over that had to fold. I really don't know.

(He was not the only person laid off, there were thousands in his cohort, it's just the way it is at IBM sometimes)