Python Script on WebCrawling Need Feedback

Code Feedback
1

Hello, I have been writing some python scripts and I would like to know how to improve the quality of my code thanks.
github . com/raajvamsy/Web-Crawler/blob/Web-Crawler/ WebCrawler.py