Hi all!
I am trying to download every CSV file on this site: CNMCData - Informe Trimestral
Each CSV is in a radio button inside a sub-page (not a different site) of that main page (I believe the term used to describe this type of site is ‘dynamic’). Example of location of one of the CSV files:
Problem:
When I run the following code in order to find patterns in the html so I can automate the process (such as each radio button having the same class so I can use Selenium to click it or something along those lines), only a small part of the html is retrieved:
Code:
What it retrieves:
What I can see using ‘right-click > inspect’ on the site:
As you can see, the ‘right-click > inspect’ html shown is much more extended (including <a>
tags to dynamically navigate the page).
How can I fetch ALL of the html, including those <a>
tags?
I believe the answer/problem may lie in this line of code (complete guess, have no clue really):
Thanks for your time
Jaime