General information
Title:
Suggestion.pl, web log
I check our server's web log everyday and noticed the following pattern.
crawl24-public.alexa.com - - [04/Feb/2005:04:04:35 -0500]
"GET /robots.txt HTTP/1.0" 200 31 "-" "ia_archiver"
crawl24-public.alexa.com - - [04/Feb/2005:04:04:36 -0500]
"GET /cgi-bin/suggestion.pl HTTP/1.0" 404 215 "-" "ia_archiver"
That is, a crawler looks for a robots.txt first, then looks for a suggestion.pl
I know what is robots.txt but I'm curious to know what does this suggestion.pl do.
If anyone knows how to create a suggestion.pl, please let me know. Thank you.
(I have three years of coding experience in Perl.)
Reply
View the map of this thread
View the map of this thread starting from this message only
View all messages of this thread
View all messages of this thread starting from this message only