sandwichgirl
New Member
- Joined
- Aug 13, 2007
- Messages
- 31
- Office Version
- 365
- Platform
- Windows
Hello
I receive a daily email with a file that contains our dispatch data by customer/product. I save each file down in a folder named by date so todays file is call 24112022.
I have a PQ that sources from the sharepoint folder the files are stored in to produce a big chunk of data that sits in a data model so I can pivot the details and trend our dispatches. At the end of this year i'll end up with 365 files and then I can merge them all into 1 table, but in the meantime i need a solution to the shear amount of data the query has to refresh each day which is approx 2800 rows and 8 columns.
What I am looking for is a way that when I refresh the data it doesn't have to refresh all the data as it takes a while - what would be the best solution?
I've considered chunking up the data to monthly/quarterly tables, but is there another way?
thanks
I receive a daily email with a file that contains our dispatch data by customer/product. I save each file down in a folder named by date so todays file is call 24112022.
I have a PQ that sources from the sharepoint folder the files are stored in to produce a big chunk of data that sits in a data model so I can pivot the details and trend our dispatches. At the end of this year i'll end up with 365 files and then I can merge them all into 1 table, but in the meantime i need a solution to the shear amount of data the query has to refresh each day which is approx 2800 rows and 8 columns.
What I am looking for is a way that when I refresh the data it doesn't have to refresh all the data as it takes a while - what would be the best solution?
I've considered chunking up the data to monthly/quarterly tables, but is there another way?
thanks
