Information générale
Titre:
Adding Large Amounts of Data?
I am loading a large amount of data from a text file.
The data is APPENDed to a cursor and then that
cursor is SCANed and then INSERTed into one of
two tables. One of the fields is used in a lookup table.
The lookup process was initially a SEEK() and I
changed it to a SET RELATION. The two targe tables
have an integer primary key. I was using a stored
procedure to increment the PK, but am now just
incrementing a variable in an effort to speed things up.
The data being loaded from the temp cursor has about
750,000 records. I am using a custom progress bar
that tells me the estimated time lef to complete the task.
The first 10% of the data was loaded very fast and had
an estimated time to complete of 2 hours. The process
is now 28% complete and the estimated time is approaching
7 hours remaining.
Is there any tricks to get the same performance at the
beginning of the file as the rest of the file? Perhaps
something like FLUSHing the data? The two target tables
(added to via INSERT INTO) already had nearly 500,000
records each when the program started so it is not the
fact that the target tables where initially empty.
I am runnig this on a NT server using VFP 5.0.
Any ideas on how increase the speed?...
Suivant
Répondre
Voir le fil de ce thread
Voir le fil de ce thread à partir de ce message seulement
Voir tous les messages de ce thread
Voir tous les messages de ce thread à partir de ce message seulement