Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Asynchronous Object Execution
Message
General information
Forum:
Visual FoxPro
Category:
Classes - VCX
Title:
Asynchronous Object Execution
Environment versions
Visual FoxPro:
VFP 9
OS:
Windows XP SP2
Network:
Windows 2000 Server
Database:
Visual FoxPro
Miscellaneous
Thread ID:
01008669
Message ID:
01008669
Views:
74
I've created a class to milk information from a website.

This class uses XMLHTTP to grab some HTML from the website. The HTML is then parsed using REGEX.

The website in quesition is dynamic in that I need to send sequential requests for each individual HTML-stream. I need to call the page about 100000-times to grab the pertinent data, so obviously the biggest bottleneck to this class's performance is the lag-time for the HTML to stream back. Since I am retreiving and processing the retuened HTML sequentially, I only have one HTTP session running at a time.

Would someone please suggest the best way to execute multiple instances of this class asynchronously? Ideally, I'd like to just blast the web-server with as many requests as possible, and I'm even considering redistribution of the load to other client machines that would in turn submit their resulting data to my server. Right now, it takes about 11-hours to process the data I need, and I figure with the above method, I could reduce this processing time to minutes.
John MR Fitzgerald
Order Inc.
Next
Reply
Map
View

Click here to load this message in the networking platform