Scrapping Amazon website with VBA to get the prices of all the sellers

[dorras]

Hello,
I am a beginner at VBA.
I am trying to retrieve the prices of all the sellers displayed on a product page on the Amazon website.
For now, I managed to create the below code which should open the web page and get the HTML code , but I get an error 462 "the remote server machine does not exist or is unavailable"
Could you please help me understanding why?

Sub InternetExplorerObject()

Dim IEObject As InternetExplorer


Set IEObject = New InternetExplorer
IEObject.Visible = True
    
IEObject.Navigate URL:="https://www.amazon.fr/dp/B084CQ41M2/?psc=1", Flags:=navOpenInNewWindow
    
Do While IEObject.Busy = True Or IEObject.ReadyState <> READYSTATE_COMPLETE
       
Application.Wait Now + TimeValue("00:00:01")
       
Loop
   
Debug.Print IEObject.LocationURL
    
   
    Dim IEDocument As HTMLDocument
    Set IEDocument = IEObject.Document
    
    'The simplest thing we can do is grab an element, and then the inner text.
    Debug.Print IEDocument.getElementById("header").innerText
    
  End Sub

 

[Marc L]

Hello,​

​

the error raises 'cause you are searching an Id which does not exist …​

 

[JEC]

Webscraping is not very reliable, since the page will probably change now and then. When it does, you have to rewrite your code.

 

[dorras]

Hello,​

​

the error raises 'cause you are searching an Id which does not exist …​

Hello Marc,

What do you mean by id which does exist. Which id in the cause does not exist ?

 

[Marc L]

Just check the codeline where the error occurs and compare with the webpage element you wanna grab …​

 

[dorras]

​

Just check the codeline where the error occurs and compare with the webpage element you wanna grab …​

Hello Marc,
When I try to run the code differently, I have an error "method of document object "webbrowser2 failed"

Sub InternetExplorerObject()



Dim IE As Object
Set IE = CreateObject("InternetExplorer.Application")

IE.Visible = True
    
IE.Navigate URL:="https://www.amazon.fr/dp/B084CQ41M2/?psc=1", Flags:=navOpenInNewWindow
    
Do While IE.Busy = True
       
Application.Wait Now + TimeValue("00:00:01")
       
Loop
   
Debug.Print IE.LocationURL
    
   
    Dim IEDocument As HTMLDocument
    Set IEDocument = IE.Document
    
    'The simplest thing we can do is grab an element, and then the inner text.
    Debug.Print IEDocument.getElementById("header").innerText
End Sub

 

[Marc L]

​

As it's still the same code so with the same error …​