Hi guys, I am newbie to html and web data scraping using vba. I have no problems getting data from a table on the webpage, but I bumped into two issues. On the webpage, it only shows one page of table data, at the bottom I can click page 2, 3 and NEXT. Using control+U to see the html codes, I can see all information are loaded and neatly organised as tr rows.
I assume ie.document can store all elements, as what I can see using control +U in Chrome. And when I try to retrieve the tr innertext by using getelementByTagName("tr"), vba just skipped all tr elements which is supposed to be on other pages of the table. Pardon me if I dont explain well, and I couldnt paste the link and html codes here as it may contain confidential information. I wonder if someone ever bumped into similar issues, and not much information can be found on Dr google.
Thank you in advance!
I assume ie.document can store all elements, as what I can see using control +U in Chrome. And when I try to retrieve the tr innertext by using getelementByTagName("tr"), vba just skipped all tr elements which is supposed to be on other pages of the table. Pardon me if I dont explain well, and I couldnt paste the link and html codes here as it may contain confidential information. I wonder if someone ever bumped into similar issues, and not much information can be found on Dr google.
Thank you in advance!
Code:
ieDoc = ieApp.Document
For Each HTMLRow In ieDoc.getElementsByTagName("tr")
Debug.print HTMLRow.innertext
