I think you'll find a product that will do this at www.copernic.com

>Hello,
>
>I just received a request to build a browser that automatically searches 75 selected medical web sites for research publications. Basically, the application would need to find the publication section of each web site, and then display each publication title it found, the date of the publication, the agency that created the publication, the category of the publication, the URL where the publication title is located, etc. All of this information is listed somewhere in the web page. The application would search by the keywords that the user inputs. This application does not need to store results in a database, but only needs to be accessible to world wide users via the web. **Although, they did mention that it would be nice if the application could have an option to display new additions only (which may require a database or some kind of log within a cookie).
>
>Now, I know that I could build a Visual FoxPro application that interfaces with Internet Explorer to do such a thing. Yes, there would be many logistical issues that I would need to solve, but it could at least be attempted in VFP.
>
>However, I'm wondering if there is an easier way to do this. I'm not sure that having world wide users download a VFP application is the most efficent way to go (especially since it's unlikely that anything needs to be stored in a database). Does anyone know of any client side scripting languages (to run within the browser) that could accomplish such a task, and if so, which language(s) and how would I go about it? Would a .net type implementation make more sense? (not that I know much of anything about how to begin a building a .net application).
>
>At this point, I'm just trying to find out more about this, before I make a decision of whether to go any further with this prospective client. Any ideas, recommendations, or advice would be much appreciated.
>
>Dave