Navigate to second page on webpage

[tiredofit]

How can I navigate to the second page of a webpage?


Suppose I want to go to the second page of the questions webpage on mrexcel:

    Dim IE As SHDocVw.InternetExplorer
    Set IE = New SHDocVw.InternetExplorer

    IE.Visible = True
    IE.navigate "https://www.mrexcel.com/forum/excel-questions/"

I right click on the 2, choose Inspect Element and see this:

<a title="Show results 21 to 40 of 3,150" href="https://www.mrexcel.com/forum/excel-questions/index2.html">2</a>

What can I do with this?


I tried:

IE.Document.queryselector("a title="Show results 21 to 40 of 3,150" href="https://www.mrexcel.com/forum/excel-questions/index2.html">2").Click

but it doesn't even compile.


Thanks

 

[John_w]

It depends on the web site. For MrExcel, directly:

IE.Navigate "https://www.mrexcel.com/forum/excel-questions/index2.html"

Or indirectly, loop through IE.Document.Links (each link is a HTMLAnchorElement) looking for the link with innerText="2", or href containing "index2", or title containing "Show results 21 to 40", etc, then:

foundLink.Click

 

[tiredofit]

It depends on the web site. For MrExcel, directly:

IE.Navigate "https://www.mrexcel.com/forum/excel-questions/index2.html"

Or indirectly, loop through IE.Document.Links (each link is a HTMLAnchorElement) looking for the link with innerText="2", or href containing "index2", or title containing "Show results 21 to 40", etc, then:

foundLink.Click

Thanks for the response.

What if I want every page?

Since I have no idea how many pages there are in total, I can't look for index2, index3, etc.

How would I loop through each one to extract the data?

 

[John_w]

Again, it depends on the web site. One way might be:

Dim page As Long
For page = 1 To 10
    IE.Navigate "http://www.site.com/index" & page & ".html"
    'Wait for page to load
    'Extract data
Next

Some sites have a 'Next Page' or similar link, so look for that using the method in my previous post, or getElementById, getElementsByClassName, etc., until the 'Next Page' link doesn't exist. Without knowing the URL I can't give specific code.

 

[John_w]

I tried to reply to your PM, but you've reached your message quota.

 

[tiredofit]

I tried to reply to your PM, but you've reached your message quota.

Have freed up some space, feel free to PM again, thanks.

 

[tiredofit]

I tried to reply to your PM, but you've reached your message quota.

Thanks, have got your reply.