I want to create a JSON file of recipes from the Washington Post site: https://www.washingtonpost.com/news/voraciously/wp/category/dinner-in-minutes/
I entered the first few recipes manually but I obviously cannot do that for all of them.
Can someone tell me how I can automate this? I’ve heard of web-scraping but I thought that was illegal…?
Note: See my second post first.
I would scrape if necessary and if possible; some sites are better at thwarting scraping efforts than others.
As to the legality of it, if you’re not planning on using it for commercial use, it seems like there isn’t much of an issue. When it comes to legalities, however, the only way to be sure is to contact a lawyer. And, even then,…
Also, you can often find the data used for articles on such sites at GitHub.
Here’s WaPo’s GitHub: