Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
VFP Spider
Message
From
15/06/2004 11:41:02
 
 
To
15/06/2004 11:30:31
General information
Forum:
Visual FoxPro
Category:
Internet applications
Title:
Miscellaneous
Thread ID:
00913846
Message ID:
00913910
Views:
22
>Hi Michel. I would like to develop a VFP app which takes a "target" website homepage url and downloads the starting homepage. Then analyzes the html for hyperlinks to other pages within the same site, and then re-iterate the process looking for more and more pages on the same website. I would optionally store the html text depending on whether I found it interesting or not.
>
>So I'm guessing I would start with creating an IE object. Downld the first page and extract the links or search for "href" commands or some such. Then follow those links for more pages within the same site.
>
>Any suggestions or sample code like this?

What I done similar to that was to crawl from a FAT and take all the pages with ASP extension. But, in your case, you need to do it across the net.
Michel Fournier
Level Extreme Inc.
Designer, architect, owner of the Level Extreme Platform
Subscribe to the site at https://www.levelextreme.com/Home/DataEntry?Activator=55&NoStore=303
Subscription benefits https://www.levelextreme.com/Home/ViewPage?Activator=7&ID=52
Previous
Reply
Map
View

Click here to load this message in the networking platform