Hello All,
I have a question regarding the speed of loading data into Power Query.
Currently, I have a folder containing 10 .CSV files (each ~300MB in size). Loading this entire folder into Power Query is very convenient but after about the 2 millionth row the speed drops to the tune of ~2,000 rows/second and continues to get slower and slower until the files are completely loaded.
Understandably, having ~15 million rows to upload, this ends up taking hours.
Is there a better way to load files into a query, merge, and append them?
I have turned "Load to worksheet" off and am using "Load to data model".
Office 2013, 64-bit, 8GB RAM is the system I'm dealing with.
I have a question regarding the speed of loading data into Power Query.
Currently, I have a folder containing 10 .CSV files (each ~300MB in size). Loading this entire folder into Power Query is very convenient but after about the 2 millionth row the speed drops to the tune of ~2,000 rows/second and continues to get slower and slower until the files are completely loaded.
Understandably, having ~15 million rows to upload, this ends up taking hours.
Is there a better way to load files into a query, merge, and append them?
I have turned "Load to worksheet" off and am using "Load to data model".
Office 2013, 64-bit, 8GB RAM is the system I'm dealing with.
