Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Low level read-write optimization for very big file
Message
General information
Forum:
Visual FoxPro
Category:
Coding, syntax & commands
Title:
Low level read-write optimization for very big file
Miscellaneous
Thread ID:
00733923
Message ID:
00733923
Views:
60
(VFP 7 SP1 on Windows 2000 or Windows XP pro)

I have to perform 3 operation on a text file.

1 - read a line from a text file.
2 - perform some operations on the string.
3 - write the line in another file.

The text file was really big (950 mb).

The program run fast for the first ~50 mb but after that it start to slow down (crawl).
The computer have 1 gb of memory an 100 gb of available disk space.
From the task manager I can see that only around 200 mb was used during the operation.

What is the best way to open the files? buffered/unbuffered?
Flush when I reach a certain point in the file? every 10 mb?
How can I optimize the process to use all available memory and speed up the process? some sys() function to use?

TIA :-)
If we exchange an apple, we both get an apple.
But if we exchange an idea, we both get 2 ideas, cool...


Gérald Santerre
Independant programmer - internet or intranet stuff - always looking for contracts big or small :)
http://www.siteintranet.qc.ca
Next
Reply
Map
View

Click here to load this message in the networking platform