Get and Transform - changing/finding value if blank

C

cmcreynolds

Active Member
Joined
May 21, 2015
Messages
295
Hello, I hope everyone is well. Long time, no post :)

I receive non-normalized data from our field staff who are in teams of 2. For our final analysis, we choose only the team lead (indicated in its own field/column as TL). However, on rare occasion, they leave their response blank and we need to consider the other team member's response.

The issue is there are 82 fields to consider (not my structure, btw). I could come up with an approach if there were only a handful of fields, but writing 82 IF statements would drive me quite bonkers.

I use Get and Transform to extract the data from various folders and I was hoping the solution could be used there. But I could only find a way to replace variables one column at a time.

Here's a short version of how the data is set up.

[TABLE="width: 500"]
<tbody>[TR]
[TD]SiteCode
[/TD]
[TD]TeamLead
[/TD]
[TD]Q1
[/TD]
[TD]Q2
[/TD]
[TD]Q3
[/TD]
[TD]Q4
[/TD]
[/TR]
[TR]
[TD]033
[/TD]
[TD]TL
[/TD]
[TD]1
[/TD]
[TD]2
[/TD]
[TD]3
[/TD]
[TD]5
[/TD]
[/TR]
[TR]
[TD]033
[/TD]
[TD]NL
[/TD]
[TD]1
[/TD]
[TD]2
[/TD]
[TD]3
[/TD]
[TD]5
[/TD]
[/TR]
[TR]
[TD]151
[/TD]
[TD]TL
[/TD]
[TD]99
[/TD]
[TD]2
[/TD]
[TD]4
[/TD]
[TD]4
[/TD]
[/TR]
[TR]
[TD]151
[/TD]
[TD]NL
[/TD]
[TD]1
[/TD]
[TD]2
[/TD]
[TD]3
[/TD]
[TD]3
[/TD]
[/TR]
[TR]
[TD]222
[/TD]
[TD]TL
[/TD]
[TD]4
[/TD]
[TD]99
[/TD]
[TD]1
[/TD]
[TD]1
[/TD]
[/TR]
[TR]
[TD]222
[/TD]
[TD]NL
[/TD]
[TD]2
[/TD]
[TD]4
[/TD]
[TD]2
[/TD]
[TD]3
[/TD]
[/TR]
[TR]
[TD]167
[/TD]
[TD]TL
[/TD]
[TD]99
[/TD]
[TD]0
[/TD]
[TD]99
[/TD]
[TD]99
[/TD]
[/TR]
[TR]
[TD]167
[/TD]
[TD]NL
[/TD]
[TD]1
[/TD]
[TD]3
[/TD]
[TD]2
[/TD]
[TD]2
[/TD]
[/TR]
</tbody>[/TABLE]


Basically, whenever a TL has a '99' we look at the NL's response. Example: For Q1, site 151, we would want a '1' in the final data set

Again, I have 82 fields to apply this to.

(I looked at 'Group By' and it seemed daunting, I was hoping there was functionality I was overlooking - either in PowerQuery or PowerPivot)

Thank you!
Clifton
 

Excel Facts

Whats the difference between CONCAT and CONCATENATE?
The newer CONCAT function can reference a range of cells. =CONCATENATE(A1,A2,A3,A4,A5) becomes =CONCAT(A1:A5)
Sort by date Sort by votes
Assuming data is in range Table1 including headers, you probably want to do something like this

Click on first two columns, right click choose "unpivot other columns"
Add a custom column that does what you need to do on the number field
Remove the value field
Click on Attribute Column, do Transform...Pivot and for value column use the new custom column


Code: 
let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Unpivoted Other Columns" = Table.UnpivotOtherColumns(Source, {"SiteCode", "TeamLead"}, "Attribute", "Value"),
    #"Added Custom" = Table.AddColumn(#"Unpivoted Other Columns", "Custom", each [Value]+1),
    #"Removed Columns" = Table.RemoveColumns(#"Added Custom",{"Value"}),
    #"Pivoted Column" = Table.Pivot(#"Removed Columns", List.Distinct(#"Removed Columns"[Attribute]), "Attribute", "Custom", List.Sum)
in
    #"Pivoted Column"
 
Upvote 0
I think the complexity is the custom column - the formula to check for '99', then go to the other entry.

horseyride said:
Assuming data is in range Table1 including headers, you probably want to do something like this

Click on first two columns, right click choose "unpivot other columns"
Add a custom column that does what you need to do on the number field
Remove the value field
Click on Attribute Column, do Transform...Pivot and for value column use the new custom column


Code: 
let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Unpivoted Other Columns" = Table.UnpivotOtherColumns(Source, {"SiteCode", "TeamLead"}, "Attribute", "Value"),
    #"Added Custom" = Table.AddColumn(#"Unpivoted Other Columns", "Custom", each [Value]+1),
    #"Removed Columns" = Table.RemoveColumns(#"Added Custom",{"Value"}),
    #"Pivoted Column" = Table.Pivot(#"Removed Columns", List.Distinct(#"Removed Columns"[Attribute]), "Attribute", "Custom", List.Sum)
in
    #"Pivoted Column"
Click to expand...
 
Upvote 0
I'll use the table from above as an example of the resulting data set

[TABLE="width: 500"]
<tbody>[TR]
[TD]SiteCode[/TD]
[TD]TeamLead(redundant in final)[/TD]
[TD]Q1[/TD]
[TD]Q2[/TD]
[TD]Q3[/TD]
[TD]Q4[/TD]
[/TR]
[TR]
[TD]033[/TD]
[TD]TL[/TD]
[TD]1[/TD]
[TD]2[/TD]
[TD]3[/TD]
[TD]5[/TD]
[/TR]
[TR]
[TD]151[/TD]
[TD]TL[/TD]
[TD]1[/TD]
[TD]2[/TD]
[TD]4[/TD]
[TD]4[/TD]
[/TR]
[TR]
[TD]222[/TD]
[TD]TL[/TD]
[TD]4[/TD]
[TD]4[/TD]
[TD]1[/TD]
[TD]1[/TD]
[/TR]
[TR]
[TD]167[/TD]
[TD]TL[/TD]
[TD]1[/TD]
[TD]0[/TD]
[TD]2[/TD]
[TD]2[/TD]
[/TR]
</tbody>[/TABLE]

Basically, a grouping with condition, I think?
 
Last edited:
Upvote 0
maybe try

Code: 
[SIZE=1]let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"SiteCode", type text}}),
    #"Filtered Rows1" = Table.SelectRows(#"Changed Type", each ([TeamLead] = "TL")),
    #"Added Index" = Table.AddIndexColumn(#"Filtered Rows1", "Index", 1, 1),
    #"Unpivoted Only Selected Columns" = Table.Unpivot(#"Added Index", {"Q1", "Q2", "Q3", "Q4"}, "Attribute", "Value"),
    #"Added Conditional Column" = Table.AddColumn(#"Unpivoted Only Selected Columns", "Custom", each if [Value] = 99 then [Value]-98 else [Value]),
    #"Removed Columns" = Table.RemoveColumns(#"Added Conditional Column",{"Value"}),
    #"Pivoted Column" = Table.Pivot(#"Removed Columns", List.Distinct(#"Removed Columns"[Attribute]), "Attribute", "Custom", List.Sum),
    #"Sorted Rows" = Table.Sort(#"Pivoted Column",{{"Index", Order.Ascending}}),
    #"Removed Columns1" = Table.RemoveColumns(#"Sorted Rows",{"Index"})
in
    #"Removed Columns1"[/SIZE]
 
Upvote 0
or just this

Code: 
[SIZE=1]let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"SiteCode", type text}}),
    #"Replaced Value" = Table.ReplaceValue(#"Changed Type",99,1,Replacer.ReplaceValue,{"Q1", "Q2", "Q3", "Q4"}),
    #"Filtered Rows" = Table.SelectRows(#"Replaced Value", each ([TeamLead] = "TL"))
in
    #"Filtered Rows"[/SIZE]
 
Upvote 0
Thank you very much, however I'm doing more than just replacing '99' with '1', I'm trying to replace it with what the NL had.
 
Upvote 0
so is that what you want?

[Table="width:, class:head"]
[tr=bgcolor:#FFFFFF][td=bgcolor:#5B9BD5]SiteCode[/td][td=bgcolor:#5B9BD5]TeamLead[/td][td=bgcolor:#5B9BD5]Q1[/td][td=bgcolor:#5B9BD5]Q2[/td][td=bgcolor:#5B9BD5]Q3[/td][td=bgcolor:#5B9BD5]Q4[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]033[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
1​
[/td][td=bgcolor:#DDEBF7]
2​
[/td][td=bgcolor:#DDEBF7]
3​
[/td][td=bgcolor:#DDEBF7]
5​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]033[/td][td]NL[/td][td]
1​
[/td][td]
2​
[/td][td]
3​
[/td][td]
5​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
151​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
99​
[/td][td=bgcolor:#DDEBF7]
2​
[/td][td=bgcolor:#DDEBF7]
4​
[/td][td=bgcolor:#DDEBF7]
4​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
151​
[/td][td]NL[/td][td]
1​
[/td][td]
2​
[/td][td]
3​
[/td][td]
3​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
222​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
4​
[/td][td=bgcolor:#DDEBF7]
99​
[/td][td=bgcolor:#DDEBF7]
1​
[/td][td=bgcolor:#DDEBF7]
1​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
222​
[/td][td]NL[/td][td]
2​
[/td][td]
4​
[/td][td]
2​
[/td][td]
3​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
167​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
99​
[/td][td=bgcolor:#DDEBF7]
0​
[/td][td=bgcolor:#DDEBF7]
99​
[/td][td=bgcolor:#DDEBF7]
99​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
167​
[/td][td]NL[/td][td]
1​
[/td][td]
3​
[/td][td]
2​
[/td][td]
2​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td][/td][td][/td][td][/td][td][/td][td][/td][td][/td][/tr]

[tr=bgcolor:#FFFFFF][td][/td][td][/td][td][/td][td][/td][td][/td][td][/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#5B9BD5]SiteCode[/td][td=bgcolor:#5B9BD5]TeamLead[/td][td=bgcolor:#5B9BD5]Q1[/td][td=bgcolor:#5B9BD5]Q2[/td][td=bgcolor:#5B9BD5]Q3[/td][td=bgcolor:#5B9BD5]Q4[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]033[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
1​
[/td][td=bgcolor:#DDEBF7]
2​
[/td][td=bgcolor:#DDEBF7]
3​
[/td][td=bgcolor:#DDEBF7]
5​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]033[/td][td]NL[/td][td]
1​
[/td][td]
2​
[/td][td]
3​
[/td][td]
5​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
151​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#FFFF00]
1​
[/td][td=bgcolor:#DDEBF7]
2​
[/td][td=bgcolor:#DDEBF7]
4​
[/td][td=bgcolor:#DDEBF7]
4​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
151​
[/td][td]NL[/td][td]
1​
[/td][td]
2​
[/td][td]
3​
[/td][td]
3​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
222​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#DDEBF7]
4​
[/td][td=bgcolor:#FFFF00]
4​
[/td][td=bgcolor:#DDEBF7]
1​
[/td][td=bgcolor:#DDEBF7]
1​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
222​
[/td][td]NL[/td][td]
2​
[/td][td]
4​
[/td][td]
2​
[/td][td]
3​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td=bgcolor:#DDEBF7]
167​
[/td][td=bgcolor:#DDEBF7]TL[/td][td=bgcolor:#FFFF00]
1​
[/td][td=bgcolor:#DDEBF7]
0​
[/td][td=bgcolor:#FFFF00]
2​
[/td][td=bgcolor:#FFFF00]
2​
[/td][/tr]

[tr=bgcolor:#FFFFFF][td]
167​
[/td][td]NL[/td][td]
1​
[/td][td]
3​
[/td][td]
2​
[/td][td]
2​
[/td][/tr]
[/table]

if yes I'll see what can I do
 
Upvote 0
You must log in or register to reply here.

Similar threads

K
  • Question Question
Help with looping through an entire lists in Power Query
Replies
2
Views
553
JGordon11
JGordon11
K
  • Solved
Power Query to transform data ready for pivot
2
Replies
19
Views
1K
kcmuppet
K
A
  • Solved
Power Query to arrange 8 Different Headers as two different columns
Replies
5
Views
307
ashish128
A
RICH937
  • Question Question
How to create Running Totals on multiple non-date values and conduct filtered analysis on the results. Which Power Tool is the more efficient choice?
Replies
3
Views
455
RICH937
RICH937
N
  • Question Question
Data Transformation using VBA like subtotal
Replies
1
Views
147
Domenic
D

Forum statistics

Threads
1,224,823
Messages
6,181,181
Members
453,022
Latest member
Mohamed Magdi Tawfiq Emam

Share this page

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top