Power Query to combine multiple tables of unequal number of columns

[ProudLiberal]

I'm looking to combine 52 tables (weekly scrap reports from our ERP software) using PowerQuery. The column headers (see attached sample) are the scrap codes recorded during the week being reported. Therefore the number of columns in each table varies with what issues were found. I also have a summary table (with one dummy record) that has all available scrap code columns.

My approach was to use the summary table as the main starting point and merge the other 52 tables into that one. I've tried both Merge and Append without success.

Using Merge:
1) software wants me to "Select the same number of columns from both visible tables to continue", not practical with over 300 scrap codes in the master table (yes, that's way too many codes, but that's what's in the system)
2) this process only merges two tables at a time (I've got 52)

Using Append:
1) this process will merge multiple tables but only the first four columns

I downloaded PowerQuery today and don't have any experience using it. Any advice would be highly welcomed.

NOTICE: cross-posted on MSOfficeForums and ElsmarQualityforum

 

[sandy666]

You have XL 2019 so Power Query (Get&Transform) is built-in

• What is PowerQuery
• Getting started with PQ
• PowerQuery Help
• PowerQuery M reference
• PowerQuery add-in for XL 2010/2013, all above has PQ built-in
• General: Excel Help

 

[ProudLiberal]

I have PowerQuery but don't know how to accomplish the tasks I outlined.

 

[sandy666]

Post a link to the shared, representative example excel file with reflected structure and data type. Use OneDrive, GoogleDrive or any similar.

 

[bkjohn2016]

My first thought is to import your

summary table (with one dummy record)

and then append all your report files to that table...all the columns should align automatically.

But, could you elaborate on:

I'm looking to combine 52 tables

with respect to the file types please? Also, could you describe the process by which you receive the files please?

 

[peter789]

I would look at un-pivotting each table, then appending to combine them all, then re-pivot the data. The brute strength approach is to work with 52 queries. The neat way to accomplish it is by using a function, however that depends on your level of experience using Power Query and to a certain extent where the sources tables are stored.