I cannot figure it out. I am trying to scrape a table from the website CapWages - NHL Salary Cap Data which will scrape the first 50 rows but because the website makes you click next page, it will not display the next ones. Normally, websites add to the url to advance the page...but this site does not do that...it just stays the same. I used to be able to just manipulate the advanced power query to add to the url but here I cannot figure out how to get the next pages.
currently I just have this...
I tried using python with beautifulsoup but encounter same problem.
If anyone knows or have suggestions, please let me know.
Thank you in advance.
currently I just have this...
Power Query:
let
Source = Web.Page(Web.Contents("https://capwages.com/players/active")),
Data0 = Source{0}[Data],
#"Changed Type" = Table.TransformColumnTypes(Data0,{{"PLAYERS", type text}, {"TEAM", type text}, {"POS", type text}, {"HAND", type text}, {"AGE", Int64.Type}, {"WEIGHT", type text}, {"HEIGHT", type text}, {"GP", Int64.Type}, {"TOI", type text}, {"G", Int64.Type}, {"A", Int64.Type}, {"PTS", Int64.Type}, {"GAA", type number}, {"SV%", type number}, {"CAP HIT", Currency.Type}, {"AAV", Currency.Type}, {"TERM", type text}, {"WAIVERS EXEMPT", type text}, {"BASE SALARY", Currency.Type}, {"SIGNING BONUS", Currency.Type}, {"PERF BONUS", Currency.Type}, {"TYPE", type text}})
in
#"Changed Type"
I tried using python with beautifulsoup but encounter same problem.
If anyone knows or have suggestions, please let me know.
Thank you in advance.