Plateforme Level Extreme
Abonnement
Profil corporatif
Produits & Services
Support
Légal
English
Best? way to process a huge result set over a network
Message
Information générale
Forum:
ASP.NET
Catégorie:
Autre
Versions des environnements
Environment:
C# 1.1
Database:
MS SQL Server
Divers
Thread ID:
00965818
Message ID:
00966547
Vues:
7
>David
> What types of operations are you performing on the data once it is on the client machine ?
>
>Are you using something like a Fill() method to fill your database.
>
>If so I might recommend using a data reader which will process through each record one at a time. Readers are one way mechanisms that only read forward. You do have access to each column of data via this mechanism but you cannot go backwards.
>
>We had some rather large SQL to XML exports to do and by using a data reader we were able to create a 1.1GB file in 5 minutes. We had comparable amounts of records and a very large record structure.
>
>Rodman

We are, deep in the bowels of our business object, using Fill().

I wondered if putting the file in a format that prevented a lot of swapping in and out of RAM would help the problem. By going through a file unidirectionally, I thought it might prevent a lot of swapping if the data was only handled in small chunks. Do you think this works because using a data reader requires less RAM swapping?

Any guess as to the size of a DataTable stored in virtual memory on hard disk compared to the same data as XML? I haven't a clue.

Thanks for your suggestion.
David S. Alexander
Kettley Publishing
20271 SW Birch Street, 2nd Floor
Newport Beach, CA 92660-1752
Précédent
Suivant
Répondre
Fil
Voir

Click here to load this message in the networking platform