Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
How to process Hundreds of millions records in ms sql
Message
General information
Forum:
Microsoft SQL Server
Category:
Database management
Miscellaneous
Thread ID:
01507091
Message ID:
01507109
Views:
106
Hi Doron,

The following statement "This way the log file stays small and whenever a new process starts, the new batch will reuse the same log file space and it will not grow" from your article is misleading. It's only true if database is in Simple recovery mode or it's in Full recover mode and log backup is done between batches. And even then another transaction may prevent reusing previous batch log space.

>
>I added another important part into this article, which helps to debug bad records in ms sql tables. It will show you how to process hundreds of GB of data in less than an hour and keeps the log file small while not choking your hard disk.
>
>See this article:
>http://www.dfarber.com/computer-consulting-blog/2011/1/14/processing-hundreds-of-millions-records-got-much-easier.aspx
>
--sb--
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform