I want to minimize this code. It takes a lot of time to do it. Is it? It is amazon data scraping code

[9518423044]

Sub ScrapeAmazonPrices()
    Dim ie As Object
    Dim html As Object
    Dim urls As Range
    Dim cell As Range
    Dim price As String
   
    ' Initialize Internet Explorer
    Set ie = CreateObject("InternetExplorer.Application")
    ie.Visible = False
   
    ' Set the range of URLs
    Set urls = ThisWorkbook.Sheets("Sheet1").Range("A1:A" & ThisWorkbook.Sheets("Sheet1").Cells(Rows.Count, 1).End(xlUp).Row)
   
    ' Loop through each URL
    For Each cell In urls
        If cell.Value <> "" Then
            ' Navigate to the URL
            ie.navigate cell.Value
            Do While ie.Busy Or ie.readyState <> 4: DoEvents: Loop
           
            ' Get the HTML document
            Set html = ie.document
           
            ' Extract the price
            On Error Resume Next
            price = html.getElementsByClassName("a-price-whole")(0).innerText
            On Error GoTo 0
           
            ' Write the price in the next column
            cell.Offset(0, 1).Value = price
        End If
    Next cell
   
    ' Quit Internet Explorer
    ie.Quit
    Set ie = Nothing
    Set html = Nothing
   
    MsgBox "Scraping Completed!"
End Sub

 

[Joe4]

Welcome to the Board!

Loops are notoriously slow in VBA. However, we may be able to speed up the code a little by temporarily disabling things like calculations, events, and screen updating while the code is running. See if this helps any.

Sub ScrapeAmazonPrices()
    Dim ie As Object
    Dim html As Object
    Dim urls As Range
    Dim cell As Range
    Dim price As String
   
    Application.EnableEvents = False
    Application.ScreenUpdating = False
    Application.Calculation = xlCalculationManual
   
    ' Initialize Internet Explorer
    Set ie = CreateObject("InternetExplorer.Application")
    ie.Visible = False
   
    ' Set the range of URLs
    Set urls = ThisWorkbook.Sheets("Sheet1").Range("A1:A" & ThisWorkbook.Sheets("Sheet1").Cells(Rows.Count, 1).End(xlUp).Row)
   
    ' Loop through each URL
    For Each cell In urls
        If cell.Value <> "" Then
            ' Navigate to the URL
            ie.navigate cell.Value
            Do While ie.Busy Or ie.readyState <> 4: DoEvents: Loop
           
            ' Get the HTML document
            Set html = ie.document
           
            ' Extract the price
            On Error Resume Next
            price = html.getElementsByClassName("a-price-whole")(0).innerText
            On Error GoTo 0
           
            ' Write the price in the next column
            cell.Offset(0, 1).Value = price
        End If
    Next cell
   
    ' Quit Internet Explorer
    ie.Quit
    Set ie = Nothing
    Set html = Nothing
   
    Application.Calculation = xlCalculationAutomatic
    Application.ScreenUpdating = True
    Application.EnableEvents = True
   
    MsgBox "Scraping Completed!"
    
End Sub

 

[9518423044]

Welcome to the Board!

Loops are notoriously slow in VBA. However, we may be able to speed up the code a little by temporarily disabling things like calculations, events, and screen updating while the code is running. See if this helps any.

Sub ScrapeAmazonPrices()
    Dim ie As Object
    Dim html As Object
    Dim urls As Range
    Dim cell As Range
    Dim price As String
  
    Application.EnableEvents = False
    Application.ScreenUpdating = False
    Application.Calculation = xlCalculationManual
  
    ' Initialize Internet Explorer
    Set ie = CreateObject("InternetExplorer.Application")
    ie.Visible = False
  
    ' Set the range of URLs
    Set urls = ThisWorkbook.Sheets("Sheet1").Range("A1:A" & ThisWorkbook.Sheets("Sheet1").Cells(Rows.Count, 1).End(xlUp).Row)
  
    ' Loop through each URL
    For Each cell In urls
        If cell.Value <> "" Then
            ' Navigate to the URL
            ie.navigate cell.Value
            Do While ie.Busy Or ie.readyState <> 4: DoEvents: Loop
          
            ' Get the HTML document
            Set html = ie.document
          
            ' Extract the price
            On Error Resume Next
            price = html.getElementsByClassName("a-price-whole")(0).innerText
            On Error GoTo 0
          
            ' Write the price in the next column
            cell.Offset(0, 1).Value = price
        End If
    Next cell
  
    ' Quit Internet Explorer
    ie.Quit
    Set ie = Nothing
    Set html = Nothing
  
    Application.Calculation = xlCalculationAutomatic
    Application.ScreenUpdating = True
    Application.EnableEvents = True
  
    MsgBox "Scraping Completed!"
   
End Sub

its not working any free tool for amazon data scaping? suggest me ,

 

[Joe4]

What do you mean it is not working?
Do you mean it is still working, but just not going any faster?

I did not add anything to the code that should stop it from working, if it was working originally (which your original message seems to imply).
I just adding some temporary setting adjustments to halt screen updating, calculations, and event procedure calling while the body of the code is running.

 

[9518423044]

What do you mean it is not working?
Do you mean it is still working, but just not going any faster?

I did not add anything to the code that should stop it from working, if it was working originally (which your original message seems to imply).
I just adding some temporary setting adjustments to halt screen updating, calculations, and event procedure calling while the body of the code is running.

I understand what you said and you are absolutely correct.

I am looking for a good tool for data scraping.

 

[Joe4]

I am looking for a good tool for data scraping.

I have zero experience with web scraping.
I would recommend doing a Google search on "Excel web scraping tool".
Here is the first thing that comes up, which looks promising: How to Scrape Website Data into Excel - 3 Methods | Octoparse
There are also many other posts which may be helpful.