Scrape table data from website python beautiful soup - Access all table entries [closed]

I tried to access the table data while scraping the FDA website.

https://www.fda.gov/inspections-compliance-enforcement-and-criminal-investigations/compliance-actions-and-activities/warning-letters

While scraping the above link, I am getting only 10 entries of the table. But there are around 2500 entries in the table. Inspected the website by using F12 key but that gives me 10 entries even after changing the "Show entries to 50"

I want to use Python beautiful Soup to access all the entries of the table. How can I do that?

Solution 1:

I'm not sure Beautiful Soup supports this, but you need to load the table rows by scrolling the page.
This can be done with Selenium:
Read the initially loaded data, scroll the page up, read the currently presented data and so on until the page bottom is presented.