With the help of some skilled VFP coders on the UT, I am having some fun with a web bot.
I had success by splitting it into two parts. The first, using a homepage URL retrieved the sub URLs from the href HTML in the a home page
The second part used the (saved in a table) URLs to navigate to the pages and retreive the text.
Now I am having trouble merging the concept into one piece of code. Here's what's happening:
I use this segment of code to get the href URLS
o = CREATEOBJECT("InternetExplorer.Application")
o.VISIBLE=.F.
o.NAVIGATE(lcURL)
FOR EACH loLink IN o.DOCUMENT.Links
lcURL = [ ] + loLink.Href + [ ]
o.NAVIGATE(lcURL)
* I want to navigate to each lcURL as it is retreived, process the text and then navigate to the next href lcURL
* until the website's href URLs have been processed, then move on to the next homepage and process its href URLs
ENDFOR && below a lot of filtering code etc.
Is there a solution for this or should I collect all the href URLs from all the sites into a table and then proceed with return visits to collect text?
I ain't skeert of nuttin eh?
Yikes! What was that?