Out of Memory Error

Hi,

I am reading in a csv file using the following code:

entire_file_string = CreateObject("Scripting.FileSystemObject").opentextfile(Input_pth, 1, False, 0).readall

The file i am reading in is rather large.....like 600,000 rows..........

I dont know why i am getting an out of memory error........any ideas on why? And what to do about it?

I have used this code in the past without any issues......but i guess there is always a first time.

i will review those things you mentioned. Really only the last two apply in my case.

'How to reallocate memory
'TO free memory is this just clearing arrays or is there more to it than that?


Also, i have done some research and found that the method i am using might have a "string limit".......
anyone have any thoughts on how i am reading in the file........perhaps there is a better method?

I can not explain in words. I know dates imported from text files some times give an error "out of memory". I am not sure the reason, but I suspect it might be excel treat these data as exceeding the text limits. I have my self come across this issue, but I do not understand the cause.

here is the declaration and code

Dim entire_file_string As String
entire_file_string = CreateObject("Scripting.FileSystemObject").opentextfile(Input_pth, 1, False, 0).readall

so variable is defined as a string

What do you do with the string? I'd suspect ADO, or just opening the file as a workbook, might be a better method of reading the data.

well, i read in the entire file into a string variable. then i split off each "line" of the file into an array (see code below)

Dim entire_file_string As String
'the entire contents of the file are stored in a string
'note this array created will be "0" based array ie...first element is designated as "0"
'

entire_file_string = CreateObject("Scripting.FileSystemObject").opentextfile(Input_pth, 1, False, 0).readall
'
'now split out each row of file so that its a single element of an array
'note this array created will be "0" based array ie...first element is designated as "0"
each_row_infile_array = Split(entire_file_string, vbCrLf)

And what do you do with the data after that?

If you use ADO you can extract a recordset from the CSV file, then either extract that into an array, or process it as needed. You can also do processing in the query you use to extract the data in the first place.