Web Scrape

[mikeymay]

I have a routine that scrapes a website but occasionally the web address entered returns a 502 Bad Gateway page

How do I get the h1 text to test if I need to refresh the page or not?


TIA

 

[Rijnsent]

Can you post the relevant bit of your code, that makes it much easier to answer your question.

If I elaborate a bit on this example: VBA Web Scraping to Excel: The Complete Step-by-Step Guide for Beginners - 33rd Square , you could try a simple Instr to find if a 502 was returned.

Sub ScrapeWebsite()

Dim http As New MSXML2.XMLHTTP
http.Open "GET", "https://example.com"
http.send

Dim html As String
html = http.responseText

If InStr(html, "<h1>502") > 0 Then
    'Error page, do something..
End If

End Sub