Hi Glenn,

>Mmmmm how about an aproach with SQL to get rid of dups like

select count(*), fld2,fld1,fld3... from tablefromcsv group by fld1,fld2,fld3... into table Finaltable

I tried several ways including SELECT DISTINCT and SELECT...GROUP BY. Whatever I tried was slower than INDEX ON...UNIQUE combined with COPY TO.

Perhaps you are able to find a faster way. You can download the test data generator from here: http://indot.net/dotnetprocontest07/datagenerator.zip

Run your tests with 500,000 records.

Markus