Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Visits from MS crawler using regular agent string
Message
General information
Forum:
Visual FoxPro
Category:
Other
Miscellaneous
Thread ID:
01259810
Message ID:
01259929
Views:
14
It's probably not an official crawler but some spam crawler trying to get email addresses or finding places to spam with POST links.

Also note that IE has the option to offline pages - which actually can let plain old users crawl a site and pick up content.

+++ Rick ---

>Not VFP related; an observation
>
>Last several weeks an MS crawler is hitting my website coming from ip range of 65.55.165.10 to approx. 65.55.165.125.
>
>An interesting thing that the agent parameter is a regular one:
>Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322)
>supposedly pointing at an average web user.
>
>A typical query string look like this:
>http://search.live.com/results.aspx?q=functions&mrt=en-us&FORM=LIVSOP
>
>The robot's searches are mostly too general and repetitive: functions, foxpro, using, process, windows, registry, connections, language, socket and so on.
+++ Rick ---

West Wind Technologies
Maui, Hawaii

west-wind.com/
West Wind Message Board
Rick's Web Log
Markdown Monster
---
Making waves on the Web

Where do you want to surf today?
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform