What is the perfect method to deal with Dat files?

prabha_friend

Prabhakaran Karuppaih
Local time
Today, 23:47
Joined
Mar 22, 2009
Messages
999
What is the perfect method to import data from Dat files with having more a than million rows.
 
what do you want to do with them?

how many rows do you need to import?
 
So, this is going to be a bit of a pain for you. The reason is that this file cannot be imported in any of the usual ways. The ONLY way is going to be very, very, very SLOW. I'm talking about importing ONE line at a time by means of using the old standby method of Open FileNameHere For Input As #1 and then iterating through the records.
 
I just thought of something else. If you have SQL Server available you could possibly use SQL Server Integrated Services (SSIS) to do the work, which would probably be faster. I don't know what the IO limits are for one of the workflow steps that would do the import but it might be possible.
 
How does the structure appear? How easy is it to distinguish when 1 record finished and another one starts? How many lines make up 1 record? Cany post a sample?
 

Users who are viewing this thread

Back
Top Bottom