Power Query - changing entries and Big Data

Optimal

New Member
Joined
Aug 5, 2022
Messages
2
Office Version
  1. 2016
Platform
  1. Windows
Hello, everybody.

I have CSV files that upon opening have some irregular IDs' entries (all IDs should have 17 characters but after filtering them by the length I found some that had an irregular amount of characters - 14, 15, 18).
However, when I created a Power Query, suddenly all the IDs became normal and other odd calculations were fixed too (like time(duration) became normal instead of 0:00:00).

Question 1: Why IDs become normal (example "326DCA34ABA1FAHHD") in PowerQuery but are in the form of "8.28E+22" upon opening?
For example, row 1854 upon opening and 1853 in PQ changes. Maybe there is something very simple I am missing.

Question 2: I have multiple CSV files with hundreds of thousands of rows in each file, I need to repeat the same analysis steps for each one of them and create the same pivot tables, I do not need to combine those files in a single file. I could run the same VBA code for each one of them, but that would take a lot of time. I am just a beginner, so I am not sure whether or not I should use Data Models for that and use Power Pivot (but all 12 files exceed millions of rows limit anyway, create a connection to Power Bi, or what.

Just three of the first files have more than 2 million rows.

Any help would be greatly appreciated. :)
 

Attachments

  • inPQ.png
    inPQ.png
    34.3 KB · Views: 17
  • uponOpening.png
    uponOpening.png
    29.1 KB · Views: 18

Excel Facts

Difference between two dates
Secret function! Use =DATEDIF(A2,B2,"Y")&" years"&=DATEDIF(A2,B2,"YM")&" months"&=DATEDIF(A2,B2,"MD")&" days"

Forum statistics

Threads
1,224,818
Messages
6,181,152
Members
453,021
Latest member
Justyna P

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top