Creating a Web Crawler

When I need to scrape a website I use php and curl, old school but it works.