Quote:
Originally Posted by Precept24
Sigs, Excel question. When you import from web, do the numbers auto-adjust from week to week when the PGA Tour website adjusts things on their end?
ha, i actually know the answer to this
if you used the "get external data" "from web" option then it'll look something like this image, the excel file will remember where it is and what it grabbed and if you hit the "refresh all" button at the top of the image appearing under the "formulas" tab it'll slowly but surely update it
just take a quick gander at the list and then hit refresh all - you won't be able to do anything with excel (not even with other sheets or separate windows) while it's updating the data so have something else to do during that time and then check back in after a few minutes and you should notice there are new data inputs and excel functions again as normal
i've heard good things about power query (why my tab has competing data pulling buttons) so I have that addon installed but never got into it because my end goal is to do it all through python eventually
the cleanup of the data can be a mess but I've found a neat solution, if it's something simple i just need to grab I make sure the data imports the right and I use my cleanup system on the left like this with some hockey data
here i keep the left static with each of those boxes being like this
this way i can update the data and yet always have a clean list to pull from to integrate just the parts i want
here is a bit more complex where I just copy paste the GIR import and then using a combination of fuzzy logic and vlookup mix it with my preweighed historical data to get a new look
pro tip - keep you data importation sheets as separate files and then copy paste them into your master workbook, excel doesn't scale well and when i had everything all in one place it would sometimes take 5 minutes to open a file or save an update to it
also, anytime you make any changes or tinker about save as a new version, with golf I'm now on 3.2 and hockey 6.3 - this will be invaluable because the more complex things get the more you'll forget about some of the underlying logics and in the process of fixing one thing you can break ten others so it's nice to always have clean versions to go back to either as a reference point for how it used to work before you broke it or just as a new place to start over after a recent failed experiment
also, if possible, create a spot to just keep notes, at the time it'll seem completely unnecessary but at the beginning of each new season for each sport it takes me forever to figure out how I originally set everything up and having notes reminding you where you pulled the data, that you need to do error checking for that bug that sometimes pops up in driving distance, etc etc
you feel like an idiot taking notes because it's so obvious but you'll forget it all later - this is my biggest leak is not documenting my thoughts and processes and way too much time is wasted trying to figure out what on earth I was trying to do with some code that's a year old and now broken and I don't even know what it's for anymore