Power Query Tricky Multiple Pages - Baseball Question

[cpadilla0024]

Hi,

I am prepping for fantasy baseball and hitting a wall with PQ'ing data from Fangraphs. I am only able to get the top 30. Even when I manually flip pages and try to go the multiple query route. Also when I select I want more on the same page, I get the same 30! It is driving me nuts. Site below:

2024 Projections - Depth Charts | FanGraphs Baseball

www.fangraphs.com

Is there a trick to this where I can go for it?

 

[alansidman]

 

[alansidman]

Or you may try this one

 

[cpadilla0024]

Just tried both. Unfortunately could not get it to work. This link is kind of weird. I am not getting a "start" reference. It is easy to link to the table but I only get the first 30 records. No matter what page I scroll to or how many records I request on the page. The url also does not change as I adjust.

Can you try extracting the top 500 records for this site?

 

[alansidman]

I believe the issue is that the software running the web site does not create a new URL for each page. This is not an excel issue but a web issue. However, I did notice a work around for the data scraping. There is a link in the upper right hand corner that allows you to download a .csv file. It brings in all 800+ players.

 

[cpadilla0024]

Ok. Just wanted to make sure if there was a workaround to linking to the web. I knew about the Export but wanted to try to dodge those manual steps (batters/starting pitchers/relief pitchers exports each time). But I think I have to do that. Thanks!

 

[surfdoc37]

I wonder if this was ever solved as I ran into a highly similar issue. In my case trying to get to "rest of season" projections which change daily and I'd like them to just automatically update.

Is there a way to automate the CSV link, without manually visiting the page, clicking it to export/download, then using PQ on the downloaded file?

 

[1upthedevil]

Just tried both. Unfortunately could not get it to work. This link is kind of weird. I am not getting a "start" reference. It is easy to link to the table but I only get the first 30 records. No matter what page I scroll to or how many records I request on the page. The url also does not change as I adjust.

Can you try extracting the top 500 records for this site?

How did you get the 30? I'm having trouble doing that!! Thanks