Scraping and Automation in Python

Hey There!

Basically, I want to make a website that can scrape data from other websites without using an API in the same way that cURL in PHP scrapes data from other websites. I would like to know if it is possible to do this type of programming in Python . My final year project will be a Python project that focuses on automation and that I wish to do in Python.

Thanks.

Hi!

For a website that scrapes things using Python, I would recommend checking out Flask (For the website portion) and BeautifulSoup (for the scraping portion).

As for automation (by which I assume you mean completing tasks on a computer with Python), I have found PyAutoGUI to be a great library.

I hope this helps! Please feel free to message me about any questions that you might have.

Cheers!

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.