Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Best? way to process a huge result set over a network
Message
 
 
To
30/11/2004 15:08:32
General information
Forum:
ASP.NET
Category:
Other
Environment versions
Environment:
C# 1.1
Database:
MS SQL Server
Miscellaneous
Thread ID:
00965818
Message ID:
00965845
Views:
11
Hi David,

I got a few questions and few suggestions:

Do you need to run the report on the client machine? Thats a huge report...300000 records.
I was thinking that you may be able to run the process on the server, dump the data into a report table and , when its done, send the formatted data to the client, ready for the report. It still wont be very fast but definately faster then running the whole show on the client.

As far as serializing a dataset as big as the one you are sending to client, .net serialization performance will degrade big time. I suggest you take a look at a Microsoft freebie called DataSetSurrogate (search msdn for) that does a better serialization of large datasets. This, along with compressing and streaming the dataset would work perfectly. You can use Xceed for compressing and streaming ( Thanks Dave Foderick for the pointer:)

Im currently working on a smart client app that downloads data(datasets) and I can load 600000 records very fast( via remoting). I m using DataSetSurrogate, Xceed for compression and streaming and remoting.

As Thomas Ganss suggested, msde might be another option here for dumping those 300000 records and processing the report on the client.

Hope it helps,

Vlad
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform