The vfpwebcrawler already does this at http://vfpwebcrawler.codeplex.com. Calvin Hsia wrote the very efficient algorithm that uses IE. Right now it crawls over the MSDN Blogs. Just change the URL to something else and modify the vfp code accordingly.