Greetings, while doing data mining with python, a python library or browser is used to bypass bot software such as cloudflare. While doing data mining, even though I always enter the correct xpath and the correct url, the data does not arrive. I am waiting for your answers.
By any chance are you using the “BeautifulSoup” for web scraping?
Beautiful Soup is a Python library for pulling data out of HTML and XML files. And it does not work with Javascript out of the box.
Therefore, for some web pages which were rendered through Javascript, “BeautifulSoup” is not the ideal library to use.
It might be also worth trying “scrapy” and/or “playwright”.
ı use seleniumstrong text
That is simply not enough information for us to be able to help you.
We recommend familiarizing yourself with how to ask a question on this forum. Specifically, you are more likely to get useful help, if you provide a helpful title and description:
