Plateforme Level Extreme
Abonnement
Profil corporatif
Produits & Services
Support
Légal
English
Visits from MS crawler using regular agent string
Message
Information générale
Forum:
Visual FoxPro
Catégorie:
Autre
Divers
Thread ID:
01259810
Message ID:
01259929
Vues:
13
It's probably not an official crawler but some spam crawler trying to get email addresses or finding places to spam with POST links.

Also note that IE has the option to offline pages - which actually can let plain old users crawl a site and pick up content.

+++ Rick ---

>Not VFP related; an observation
>
>Last several weeks an MS crawler is hitting my website coming from ip range of 65.55.165.10 to approx. 65.55.165.125.
>
>An interesting thing that the agent parameter is a regular one:
>Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322)
>supposedly pointing at an average web user.
>
>A typical query string look like this:
>http://search.live.com/results.aspx?q=functions&mrt=en-us&FORM=LIVSOP
>
>The robot's searches are mostly too general and repetitive: functions, foxpro, using, process, windows, registry, connections, language, socket and so on.
+++ Rick ---

West Wind Technologies
Maui, Hawaii

west-wind.com/
West Wind Message Board
Rick's Web Log
Markdown Monster
---
Making waves on the Web

Where do you want to surf today?
Précédent
Suivant
Répondre
Fil
Voir

Click here to load this message in the networking platform