Return Data from 100 Web Queries

[p_schappert]

Hi! Having some trouble here...

Long story short, I have a list of URLs (approx. 100 of them) in Column A

The URLs are very similar, as are the web pages themselves.

I'm trying to scrape data from each URL--preferably returning the data in a single table/query in Excel.

I think I need to write a macro to cycle through each URL and return each query below the next, though I'm not sure that's the best solution...

Not really sure where to start.

Any help is MUCH appreciated!

Thanks!!

 

[p_schappert]

bump

 

[p_schappert]

bump

 

[brawnystaff]

Would be helpful if you could include some of the actual URLs, and examples of what data you are trying to extract..

 

[p_schappert]

Here you go:

Fantasy Football Statistics - - Week - Sort

I guess it would be the 2nd table (named "Table 0") on each page. Other than that, pretty standard stuff I do believe.

Thanks!

 

[brawnystaff]

Tough one since you are trying to import the entire table (as opposed one field per web address, which is what I typically do).

So far, the cleanest method I have found, if using Excel 2013 or 2016 is to use "Power Query" (called "Get an Transform" under the Data ribbon in Excel 2016) to import Table 0 into an Excel worksheet. However, you would need to copy and paste the web address each time.

Another method is to use the "Get External Data" controls under the Data ribbon, but requires some post-clean up afterwards to get rid of some data..

 

[brawnystaff]

Allright, was able to do some more research and found the answer in this video:

Learn Excel - Scrape Webpages Using Power Query - Podcast 2056 - YouTube

Have to follow it carefully, but it worked on your website..