Information générale
Titre:
Suggestion.pl, web log
I check our server's web log everyday and noticed the following pattern.
crawl24-public.alexa.com - - [04/Feb/2005:04:04:35 -0500]
"GET /robots.txt HTTP/1.0" 200 31 "-" "ia_archiver"
crawl24-public.alexa.com - - [04/Feb/2005:04:04:36 -0500]
"GET /cgi-bin/suggestion.pl HTTP/1.0" 404 215 "-" "ia_archiver"
That is, a crawler looks for a robots.txt first, then looks for a suggestion.pl
I know what is robots.txt but I'm curious to know what does this suggestion.pl do.
If anyone knows how to create a suggestion.pl, please let me know. Thank you.
(I have three years of coding experience in Perl.)
Répondre
Voir le fil de ce thread
Voir le fil de ce thread à partir de ce message seulement
Voir tous les messages de ce thread
Voir tous les messages de ce thread à partir de ce message seulement