Scrape Tables from Multiple URLs in single sheet

[Jasvindra]

How can i use the below code to scrap tables from multiple URLs and paste them one below other on single sheet

Sub GetCourseList()


Dim URL As String
Dim qt As QueryTable
Dim ws As Worksheet

Set ws = Worksheets.Add

URL = "https://www.wiseowl.co.uk/courses/"

Set qt = ws.QueryTables.Add( _
Connection:="URL;" & URL, _
Destination:=Range("A1"))

With qt
.RefreshOnFileOpen = True
.Name = "CoursesFromWiseOwl"
.FieldNames = True
.WebSelectionType = xlAllTables
.Refresh BackgroundQuery:=False
End With

End Sub

 

[DanteAmor]

Re: Scrap Tables from Multiple URLs in single sheet

Create a sheet with the name of "Urls", in column A from row 2 put each of the urls.

Sheet: Urls

	A
https://www.wiseowl.co.uk/courses/
https://www.wiseowl.co.uk/courses/

<colgroup><col style="width: 30px; font-weight: bold;"><col style="width: 253px;"></colgroup><tbody>
[TD="bgcolor: [URL=https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=CACACA]#CACACA[/URL] , align: center"]1[/TD]
[TD="bgcolor: [URL=https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=92D050]#92D050[/URL] , align: center"]Courses[/TD]

[TD="bgcolor: [URL=https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=CACACA]#CACACA[/URL] , align: center"]2[/TD]

[TD="bgcolor: [URL=https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=CACACA]#CACACA[/URL] , align: center"]3[/TD]

</tbody>

Create another sheet and name it "Destination" to put the list of courses

Try with this macro:

Sub GetCourseList()


    Dim wUrl As Range, URL As String
    Dim qt As QueryTable
    Dim ws1 As Worksheet, ws2 As Worksheet
    Dim u As Long
    
    Application.ScreenUpdating = False
    Application.DisplayAlerts = False
    
    Set ws1 = Sheets("Urls")
    Set ws2 = Sheets("Destination")
    
    ws2.Cells.Clear
    
    For Each wUrl In ws1.Range("A2", ws1.Range("A" & Rows.Count).End(xlUp))
        URL = wUrl.Value '"https://www.wiseowl.co.uk/courses/"
        u = ws2.Range("A" & Rows.Count).End(xlUp).Row + 2
        
        Set qt = ws2.QueryTables.Add( _
            Connection:="URL;" & URL, _
            Destination:=ws2.Range("A" & u))
        
        On Error Resume Next
        With qt
            .RefreshOnFileOpen = True
            .Name = "CoursesFromWiseOwl"
            .FieldNames = True
            .WebSelectionType = xlAllTables
            .Refresh BackgroundQuery:=False
        End With
        On Error GoTo 0
    Next
    
    MsgBox "End"
    
End Sub