Duplicate records in 2 large datasets; 270k rows and 116k rows excel 2016 mac isn't cooperating

MavF14

New Member
Joined
Jan 12, 2016
Messages
2
Hi all,
To give you an overview of what i'm trying to achieve.
We have 280k of registered users (last 2 years regs) and we have a subset of 116k users that have opted into our marketing etc (this covers a longer time period). We have a massive service change and have a desire to tailor our messaging to each set.
I am trying to combine the 2 lists without duplication, whilst retaining some indication of those that were duplicates.

The majority of the 116k records are in the 280k records. So my thinking is:


  1. That having them merged
  2. Duplicates removed
  3. Those that had a duplicate value are highlighted/identified in some way

As you can see, the overall aim of being able to identify who has opted in and who hasn't. just need to be able to have a combined data set which i can segment by marketing or no marketing with a filter.

The way the workbook is structured is CSV as follows: firstname, lastname, email address, dob, postal/zip code.
Sounds really easy but i have had no end of trouble with it... VBA macros not working, countif and more.
Last one i tried highlighted the duplicates but when i tried to filter, excel just hangs and i end up having to kill the process. Getting nowhere and i am running out of time to get the date uploaded to our email platform.
So please; any help or assistance you can provide would be appreciated.

Kind regards,
 

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top