Hi - I'm very new to G&T/Power BI.
I've managed to create a set of queries based on importing a file from a folder. This is currently YTD up to 8Nov19.
Each week the same file will be dropped in for the user to refresh all queries however, in case the period of data overlaps, I want to only ensure the new records are added and avoid having duplicates.
I want to account for these scenarios:
1) if they replace the original YTD file with later data than original (think this is fine as it is how it should work)
2) if they add in a new YTD file without removing the original (this shouldn't be added as would be dupes)
3) if they add a weekly file an then at end of month, add a monthly file, want to ensure it only adds the new records
Any ideas on best practice for this as I'm sure it's common scenario?
(I've already filtered to ensure only the correct file extensions are imported)
many thanks in advance
I've managed to create a set of queries based on importing a file from a folder. This is currently YTD up to 8Nov19.
Each week the same file will be dropped in for the user to refresh all queries however, in case the period of data overlaps, I want to only ensure the new records are added and avoid having duplicates.
I want to account for these scenarios:
1) if they replace the original YTD file with later data than original (think this is fine as it is how it should work)
2) if they add in a new YTD file without removing the original (this shouldn't be added as would be dupes)
3) if they add a weekly file an then at end of month, add a monthly file, want to ensure it only adds the new records
Any ideas on best practice for this as I'm sure it's common scenario?
(I've already filtered to ensure only the correct file extensions are imported)
many thanks in advance
