How can I get competitors e-commerce prices with PowerQuery?

[Skype]

Hello,

my situation is the following. For an e-commerce shop I want to monitor 4-5 competitor shops and their prices. Their prices come in different scales which are usually shown as tables.

1. Do you think it is possible to extract those data from all of their product sites and bring it to a neat table in powerquery.

2. prices are actually more complicated as there are additional features you can add. Those you select via drop down menues until you get the final price. Do you think it would also be possible to run all kind of quantitity and options calculation and extract the final price?

usually the shops run about 60.000 items with 8 different price scales and 10 options to chose.

How long do you think such queries would take and how would you compare this to a VBA macro solution?

Regards

 

[ImkeF]

Check out if you find sth useful in here: https://social.technet.microsoft.co...-api-looping-over-pagination?forum=powerquery

Sounds all doable, of course depends on the specific aspects. As long as the logig to extract the info is contained in the URL, you should be able to dynamically create the page adresses and then start the extraction from a table.