+ Reply to Thread
Results 1 to 11 of 11

I need a way to compare two spreadsheet and then remove duplicates - massive data sets

  1. #1
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Exclamation I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    Hello,

    I am not versed in formulas but I know there has to be a way to make this easier. I have one Excel sheet with titled Leads and one titled Current Clients. I know there are current clients on my leads list but the leads list has over 50,000 lines and my current client list has about 14,00. The only columns that are the same are the names and email address. I need a way to compare, see the duplicates, and then remove the duplicates from the Leads list. I tried Conditional Formatting but b/c of the massive amount of data the file keeps freezing up on me. I believe VLOOKUP might be the answer but I don't know how to initiate the formula or if it would work since in this instance.

    I would love any help or advice I can get, thanks in advance!
    Please let me know if what I am trying to explain is not clear.

  2. #2
    Forum Expert p24leclerc's Avatar
    Join Date
    07-05-2010
    Location
    Québec
    MS-Off Ver
    Excel 2021
    Posts
    2,081

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    There is no formula to do this. You'll need a macro to achieve such a task.
    Can you supply us with a sample workbook with example of what you want to match and delete?
    You can place dummy data in this workbook if you need to. We are interested in your actual file structure and data type involved.
    Thanks
    Pierre Leclerc
    _______________________________________________________

    If you like the help you got,
    Click on the STAR "Add reputation" icon at the bottom.

  3. #3
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    My Apologies but I am having issues uploading the file but here is the break down:

    I have combined my current client list with leads list into one excel sheet. My leads list is on sheet one with the following columns:
    Company Name, Contact, Department, Titles, Email, Phone, Date Created

    The current client list has:
    Company Name, Contact, Email, Phone, Current Client - with Y/N as data

    I am not sure how to create a macro that would look for sheet two clients/emails to compare to sheet one's to make sure there are not duplicates.

    I hope this is semi clear for lack of excel file.
    Thank you again for taking the time to try and help!

  4. #4
    Forum Expert p24leclerc's Avatar
    Join Date
    07-05-2010
    Location
    Québec
    MS-Off Ver
    Excel 2021
    Posts
    2,081

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    If I usderstand well, a duplicate for you is if a current client is also in your Leads sheets. Right? That's why you want to delete it from the Leads list.

  5. #5
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    Yes! Sorry if my explanation was not helpful or convoluted.

  6. #6
    Forum Expert p24leclerc's Avatar
    Join Date
    07-05-2010
    Location
    Québec
    MS-Off Ver
    Excel 2021
    Posts
    2,081

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    try this macro:
    Please Login or Register  to view this content.

  7. #7
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    I think it must be user error on my side b/c I created the macro and ran it but I don't see any removal taking place. I searched for a client in my client sheet and found it in the leads list. I think with my inexperience, I must be implementing it wrong. Thank you for taking the time to create the macro.

    I created it, placed the code in the VBA and then placed the active cell on B1 and ran it, it processed it for a while but I don't see any difference, am I missing something?

  8. #8
    Forum Expert p24leclerc's Avatar
    Join Date
    07-05-2010
    Location
    Québec
    MS-Off Ver
    Excel 2021
    Posts
    2,081

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    Here is a workbook with some dummy data in Leads and Current Clients tabs.
    I created a copy of the Leads tab to keep data when you try the macro.
    See the 2 rows in the Leads tab taht are in YELLOW?
    Those are the ones that are duplicates from the Current Clients tab and they will be erased by the macro.
    When the macro ends, it returns to the Current Clients tab. You must change tab to Leads to see the modifications.
    At least, this is how I understand your problem.
    If it is not OK, let me know how you see it.
    Regards.
    Attached Files Attached Files

  9. #9
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    Thank you so much, I really appreciate the help. I'm sorry for the delay, work got in the way of work. I will try this and see how it goes. I can't thank you enough for taking the time to help me and for all the explanations!

  10. #10
    Registered User
    Join Date
    06-10-2013
    Location
    philippines
    MS-Off Ver
    Excel 2003
    Posts
    1

    Lightbulb Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    hello there! This help me in deleting duplicate spreadsheets hope this may help
    http://duplicatefilesdeleter.com/

  11. #11
    Registered User
    Join Date
    12-28-2012
    Location
    San Francisco, CA
    MS-Off Ver
    Excel 2007
    Posts
    8

    Re: I need a way to compare two spreadsheet and then remove duplicates - massive data sets

    Thank you so much for this, I will definitely check this out and my project seems to be never ending.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1