Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
VFP Spider
Message
From
15/06/2004 11:30:31
 
 
To
15/06/2004 11:07:41
General information
Forum:
Visual FoxPro
Category:
Internet applications
Title:
Miscellaneous
Thread ID:
00913846
Message ID:
00913903
Views:
15
>>Hi All. I need to build a basic website spider in VFP. Does anyone have any suggestions or sample code to get some ideas flowing? All ideas, thoughts, suggestions, money orders welcome.
>
>Could you elaborate more on the goals you wish to reach?

Hi Michel. I would like to develop a VFP app which takes a "target" website homepage url and downloads the starting homepage. Then analyzes the html for hyperlinks to other pages within the same site, and then re-iterate the process looking for more and more pages on the same website. I would optionally store the html text depending on whether I found it interesting or not.

So I'm guessing I would start with creating an IE object. Downld the first page and extract the links or search for "href" commands or some such. Then follow those links for more pages within the same site.

Any suggestions or sample code like this?
In the End, we will remember not the words of our enemies, but the silence of our friends - Martin Luther King, Jr.
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform