2.4 GHz, 1GB RAM, SCSI Raid 5 drives server holds both SQL and VFP tables.
Stored Procedure.
It's not the text to table that is taking the time, it's the processing of each text line. Basically we're rating each line of information based on several lookups into underlying rate tables. Due to defaults (if a rate record exists for an over-ride field value, use it; else use the record for a default field value) and best case matches we have to use four sequential SQL reads to get to the rate record actually required. All of this is in a single Stored Procedure.
No - a single PC is dedicated to processing all files as the come in.
The rate tables are normalized
For the tests, yes. In actual processing we start new tables every month.
Yes.