Found this in my server log, what is it?

Bleep

Diamond Member
Oct 9, 1999
3,972
0
0
Looking through my server log and found this, anyone know what it is?
216.239.46.23 - - [13/Mar/2002:00:11:41 -0600] "GET /robots.txt HTTP/1.0" 404 270
216.239.46.23 - - [13/Mar/2002:00:11:41 -0600] "GET / HTTP/1.0" 200 3165
also found this in my error log
[Wed Mar 13 00:11:41 2002] [error] [client 216.239.46.23] File does not exist: c:/program files/apache group/apache/htdocs/prsc/robots.txt

Bleep
 

MikeD83

Member
Mar 4, 2002
33
0
0
That is Google trying to index your page. Check out google.com to find out more info on the file Robots.txt. Basicly, it defines some rules for web bots to use while indexing your site for a search engine.
- Mike