Power Query - import from folder and add to static table

bark01

Board Regular
Joined
Sep 6, 2006
Messages
135
Office Version
  1. 365
Platform
  1. Windows
I have a daily import report that i save to a folder and then use power query to append all the daily files and transform them. However I'm importing and transforming all the tables every time i need an update. The onyl change would be the newer files.

Is there any way to have power query only import and transform new tables and leave the data its already imported in the date table?

I might be thinking about this wrong way, mu other thought would be to have power query import new tables, transform them and save them as one static report and then have another query that combines all the static reports (no transformation necessary). Not sure how to go about designing that can power query in excel export to and save as a csv rather than an excel.

My current process works and ists just open excel model and click refresh, its just taking longer and longer to run. I don't want to adda lot of complexity to the day to day process but would like it to run end to end faster.
 

Excel Facts

Save Often
If you start asking yourself if now is a good time to save your Excel workbook, the answer is Yes
I might be thinking about this wrong way, mu other thought would be to have power query import new tables, transform them and save them as one static report and then have another query that combines all the static reports (no transformation necessary). Not sure how to go about designing that can power query in excel export to and save as a csv rather than an excel.

Unfortunately, this is the only solution I have found for this problem. I have 30-40k rows that I compile every day into a summary. Then I put the resulting file into a "Compiled" folder, sorted by date. Then I use an additional query to gather all the data from the summaries. It takes two steps, but is much faster in the end.
 
Upvote 0

Forum statistics

Threads
1,224,823
Messages
6,181,181
Members
453,022
Latest member
Mohamed Magdi Tawfiq Emam

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top