If/when we fix it I'll write up something but yeah. Still have some ideas to try tomorrow but I'm starting to think its not a problem in our application at all but a server thing or something to do with Docker. Right now we restart all 6 of our nodes every 2 hours rolling

The biggest surprise was when I realized our "server.js" express file was requiring express, http-proxy, and body-parser without them being dependencies in package.json! Which I wasn't even aware could happen. I was really hoping pinning them to a version of our app that worked (i.e. from checking out old version/looking at yarn.lock) but no luck.

~5-8 other engineers working on it for 2 days straight too. I thought the web was easy in 2018 -_-

This one is great for learning lambda, cognito, dynamo, API Gateway and some more stuff: https://www.udemy.com/aws-serverless...rn/v4/overview

I can't rave enough about this class.

How many requests/hour are causing this to happen, and have you narrowed it down to a particular request? By "restart our node" I'm guessing you mean your VM? I assume you've tried Dtrace?

As far as the dependencies the only thing I can think of is some other dependency pulled those in and your require statement is finding them there (which only started happened when npm flattened the dependencies). Although I can't imagine what would require express. Maybe a testing framework? I think super-agent might. Are you running npm install --production and do you have your devDependencies split out?

In my first real programming job we had the weirdest bug where every about once every couple weeks, one of the 4 servers would stop returning content for one of the reports. No error anywhere, just empty report. Once it got like that you had to reboot weblogic. Had to be some kind of rare deadlock or race condition. So it was basically impossible to replicate and anything you tried had a two week turnaround before you got feedback. We upgraded Weblogic, Java, Oracle. No help.

It bugged the **** out of me that we never figured it out. It was literally down to rewrite the entire backend as the only possible solution. After I left I talked to one of the devs a few years later. They said yeah - it's still doing it. Arrghghhhh. Hurts me just to think about now.

Maybe now with modern load-testing tools we could find a way to replicate it.

Awesome I'll check it out thanks.


We had the same thing with body parser, although that's built into express now so it's not needed anyways. Was weird. Guessing you are correct about super test being the culprit

ctrl-x-o seems to do this. Between that and ctrl-p there seems to be pretty much everything I'd want. Dunno, yet. I try to just ease into one new thing at a time here.

I can see people who don't like vi rolling their eyes, but the end result of being able to do tons without bringing your hands off the keyboard is worth it imo.

I really agree, and I actually kind of enjoy how Vim basically punishes you the second you reach for the mouse. I just feel like with modern tools, this is just as possible inside Vs code or intellij or something else, its just different shortcuts and the same time commitment to learn them, but it feels like less time in configuration tutorials

One of my guys may have figured it out tonight. Sounds like an event listener was being created inside of an event listener which would logically just add it to the stack. What's really weird is that it only started happening this week. I will do more testing tomorrow but looks like moving from node v8.11.3 to v8.12.0 did it fml. Of course have a whole other day of it tomorrow. Happy thanksgiving!

Yeah if a new event listener is being created every time an event is received, that could do it.

Events are great but use sparingly imo. The goto statement of the modern programming world.

For years all my millennial coworkers kept bugging me to get Venmo. What do you mean you don't have Venmo? No one uses Paypal anymore you old dinosaur.

So I finally get Venmo and 1) no two-factor authentication, 2) login with Facebook as the default option, really - for something wired to my bank account? and 3) this default settings gem:



What on earth is the possible use case for making all your payments visible to everyone on the internet? If I transfer money to someone and they don't change this default setting - is my information now public?

I mean I know millennials don't care about privacy - but what in the heck? Sure someone can drain my bank account in seconds, but let's go with the same security level and privacy settings as logging in to Spotify.

LOOOL Venmo. I tried to create a new account just to see what was public on my real account. I gave a fake phone # figuring they would just verify the email. I verified the email but then a modal popup to verify my phone number kept coming up that wouldn’t let me do anything.

So I opened Chrome web inspector, deleted the modal, and was able to fully navigate the site and close out the account through settings.

I'm gonna go ahead and delete my real account too after seeing this.

I had the idea of an app that is basically venmo like 6 years ago. Everyone said the security would be impossible and no one would use it. They were right on the first account

Eh I mean venmo is owned by PayPal so of course it's garbage.

"Paypal, for people who don't give a ****."

Amount of times I've had real money stolen from me through paypal and paypal adjacent services: twice

Venmo: 0

I'm gonna need to check your public payment history to verify that.

This seems like a rigged metric since PayPal has been around like 15 years. Also isn't venmo considered adjacent?

Perhaps I should’ve said something that uses PayPal, like eBay.

I don’t think with Venmo you need to touch PayPal at all.

Gotcha. What happened on PayPal? Anything you could avoid or was it like an ebay hack or something?

Also got scammed on PayPal and never on venmo and mark all transactions as private so no public info.

On paypal I sold a WoW account and the dude reversed it like 2 months later. Paypal put my account in the negative and after I disputed it they sided on his side because i couldn't provide a tracking id and he claimed i never sent the item and no amount of explanation or links worked.

I never paid paypal back tho I just stopped using it and it was on an email from when I was like 16 that I have no way of remembering and I think I read something about how they never went through it all the way to collect anyway unless it was a larger sum.

Then I never used it again so paypal scammed themselves really.

I sold $10,000 of everquest items through ebay and PayPal with no problems!

Have you ever checked to see if your payments still show up under the person you transferred to/from? Assuming they left the INSANE default setting on.

I never got "scammed" on paypal, but I did have an account frozen and the contents held for some time. I was never able to get that account to a usable state again. I did get the money back, but I wasn't really allowed back into it, so I couldn't unlink my bank account from it, and could not do direct bank transfers on my new paypal account until I got a new bank account. At the time this was rampant - they would freeze accounts regularly. I guess they thought I was laundering money or selling drugs or something. There was no where to appeal to.

I once lost a few hundred bucks via paypal/ebay, mostly my own fault. I bought a guitar, it didn't arrive, and after a long enough time I opened a ticket to get a refund. This prompted the seller to send me the/a guitar, and when I received it I closed the ticket. On closer inspection, it wasn't what I ordered, and I tried to re-open the issue, but it isn't permitted, once you close it, it was considered settled. And that's why I have a mexican stratocaster.

I sort of want to now just post all my online transactions to this thread, just to show how obnoxious/dumb a public payment feed would be.

On a semi-related note I got back into microprocessor stuff and circuit design, and I have been having a blast designing circuits. I have some CNC machines at home so I'm making my own boards, and being able to go from design to completed circuit in a really short period of time is great. I just bought a bunch of surface-mount components and I'm going to try my hand at that. If I can make it work I can make all my boards like 75% smaller.

On individual transfers you can choose if its private or not.

If they dont respect that if the other person has the setting then that's completely absurd. I'll try and test it.

I bet they do - but wouldn't be completely surprised if they don't.