Quote:
Originally Posted by Zurvan
It depends how you want the data.
If you're looking for specific data points from the page (ie, just title & image), then that belongs in a database.
A document store is a type of database. Instead of it being relational, it's a series of key/value pairs. Depending on which one you choose it could end up being schema-less.
That could be especially useful if you end up scraping a bunch of different sites. You could have a few functions, maybe each one scrapes a specific site but on the backend you don't have to worry that siteA doesn't have the same information as siteB. You just store it as is.