Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
URL follow
Message
From
21/11/2010 03:35:37
 
 
To
20/11/2010 17:43:50
General information
Forum:
Visual FoxPro
Category:
Coding, syntax & commands
Title:
Miscellaneous
Thread ID:
01489932
Message ID:
01489969
Views:
60
>>>Is there VFP code available that will navigate to all the sub-links under a primary URL? And, perhaps even follow links outside the URL?
>>
>>Does this help:
>>
>>Crawler Download #9894
>
>
>It's close :) Does the download come with source code?

Seems you want a crawling/extracting robot - if you are working from a home line, I recommend going back to automating IE, as many of your problems are more than halfway eliminated by the already parsed state of the page through the IE DOM. For this specific UC you should iterate the links-collection, which can be handled as a zero based array from vfp. As I consturcted quite a few of those in IE4 times I know what a dev-time saver the object model can be. The limiting factor during runtime will probably always be the internet connection or the server if you start parallel processes on multicore machines, even if parsing/rendering in IE takes more time than dedicated code.

regards

thomas
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform