+ Reply to Thread
Results 1 to 10 of 10

Combining large sets of data

  1. #1
    Registered User
    Join Date
    10-02-2013
    Location
    Charlotte, NC
    MS-Off Ver
    Excel 2010
    Posts
    5

    Combining large sets of data

    I have a 2 million line file that is broken up into 5 files. Each is in a folder by itself. There are identical file/workbok names in each folder. I would like to know how to combine these files/workbooks without Excel overwriting, or not have to copy and paste into each file to create a singe file for each file/workbook name. Can you assist?

  2. #2
    Forum Expert daffodil11's Avatar
    Join Date
    07-11-2013
    Location
    Phoenixville, PA
    MS-Off Ver
    MS Office 2016
    Posts
    4,465

    Re: Combining large sets of data

    Is the data in each standardized? Are you just trying to copy all of the data in each into one continuous stream of rows?

  3. #3
    Registered User
    Join Date
    10-02-2013
    Location
    Charlotte, NC
    MS-Off Ver
    Excel 2010
    Posts
    5

    Re: Combining large sets of data

    thank you for responding so quickly.
    I have folder 1 that has workbook abc in it, and folder 2 has an abc file as well. I want to combine the abc's from these different folders to make one abc file. Thanks again.

  4. #4
    Forum Expert daffodil11's Avatar
    Join Date
    07-11-2013
    Location
    Phoenixville, PA
    MS-Off Ver
    MS Office 2016
    Posts
    4,465

    Re: Combining large sets of data

    I'm asking what they look like. Are you just trying to get the rows from workbook 2 under the rows in workbook 1, etc?

    I wrote a pretty tragic piece of VB that can take all Excel files in the same folder, copy all of their tabs into one workbook, and then it copies all of the worksheets into one worksheet of continuous rows.

    Would this be of assistance to you?

  5. #5
    Registered User
    Join Date
    10-02-2013
    Location
    Charlotte, NC
    MS-Off Ver
    Excel 2010
    Posts
    5

    Re: Combining large sets of data

    The macro I used did not make tabs. I just made workbooks in each folder. If I put them in tas, it would be over 250 tabs. I would like to just be able to have one folder with 250 files in the end. I hoe I am explaining this ok. Thanks again.

  6. #6
    Forum Expert daffodil11's Avatar
    Join Date
    07-11-2013
    Location
    Phoenixville, PA
    MS-Off Ver
    MS Office 2016
    Posts
    4,465

    Re: Combining large sets of data

    Ok, now I'm confused. In your first post you said you have 5 files and that you need them combined.

    In your last post you said you want to have 250 files when you are done. I thought you were trying to have less files when you combine the data, not more.

  7. #7
    Registered User
    Join Date
    10-02-2013
    Location
    Charlotte, NC
    MS-Off Ver
    Excel 2010
    Posts
    5

    Re: Combining large sets of data

    so, say I have this exact data in two separate folders. How can I combine one file into the other without overwriting or copying an pasting for a ton of files. Thanks.

    SVC 151670 S
    SVC 151670 S
    SVC 137333 S
    SVC 145701 S
    SVC 137333 S
    SVC 145701 S
    SVC 137662 S
    SVC 137461 S
    SVC 137696 S
    SVC 6001-2610 S

  8. #8
    Forum Expert daffodil11's Avatar
    Join Date
    07-11-2013
    Location
    Phoenixville, PA
    MS-Off Ver
    MS Office 2016
    Posts
    4,465

    Re: Combining large sets of data

    So if that's your data source, do you want the end result of 2 files to look like this?

    SVC 151670 S
    SVC 151670 S
    SVC 137333 S
    SVC 145701 S
    SVC 137333 S
    SVC 145701 S
    SVC 137662 S
    SVC 137461 S
    SVC 137696 S
    SVC 6001-2610 S
    SVC 151670 S
    SVC 151670 S
    SVC 137333 S
    SVC 145701 S
    SVC 137333 S
    SVC 145701 S
    SVC 137662 S
    SVC 137461 S
    SVC 137696 S
    SVC 6001-2610 S



    I found my code, which I put below. This pulls every file in a folder, and puts everything on just one page.

    Please Login or Register  to view this content.
    Last edited by daffodil11; 10-02-2013 at 12:27 PM.

  9. #9
    Registered User
    Join Date
    10-02-2013
    Location
    Charlotte, NC
    MS-Off Ver
    Excel 2010
    Posts
    5

    Re: Combining large sets of data

    Yes.The files are in different folders though. does that matter?

  10. #10
    Forum Expert daffodil11's Avatar
    Join Date
    07-11-2013
    Location
    Phoenixville, PA
    MS-Off Ver
    MS Office 2016
    Posts
    4,465

    Re: Combining large sets of data

    You could run it five times I suppose.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Excel 2007 : Comparing Large Data Sets?
    By amgstar in forum Excel General
    Replies: 0
    Last Post: 11-01-2011, 04:53 PM
  2. Combining two data sets
    By Teacher in forum Excel General
    Replies: 10
    Last Post: 09-11-2011, 12:11 PM
  3. interrogating large data sets
    By ruleworld in forum Excel General
    Replies: 1
    Last Post: 01-04-2011, 07:13 AM
  4. combining two data sets
    By pani_hcu in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 08-29-2009, 12:43 PM
  5. Combining two sets of data
    By chrmlr2 in forum Excel Formulas & Functions
    Replies: 9
    Last Post: 08-28-2009, 09:41 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1