Googlebot hitting my SetiQ? WTF

[CADsortaGUY]

IP Address: 216.239.46.105
Location: Unknown
Network: Unknown

Registrant:
Google Inc (GOOGLEBOT-DOM)
2400 E. Bayshore Parkway
Mountain View, CA 94043
US


I've had these hits more and more lately. Anyone have a clue what might be going on. One line in my log says "Http: 216.239.46.27 robots.txt" 😛 robot.text on my SetiQ!? 😛 There are many IPs that end up as "Google-bots" when I do tracert or use NeoTrace and the IPs always start with 216.239.46.XXX ANy thoughts?

Just curious 😀

CADkindaGUY

 

[Poof]

I have alot of those...

Some are crawlers or spiders... Some are infected machines! 😛

 

[IndyJaws]

It looks like a Google bot going around and trying to index web pages. Since your SetiQueue is published on the web, I guess it's a candidate?

 

[Eponymous]

You haven't picked a standard Web port for your proxy?

For example:

80
443

Or have someone else list your machine on someones webpage like say here?

It looks like a crawler has picked it out and gone and added it to their database.

Probably can now do a google search and you will show up.

 

[CADsortaGUY]

yea!😛 I was just curious more than anything. That "robot.txt" request just got me wondering "WTF!" outloud😛

Thanks

 

[Russ]

Yes, it is Google's spider. The robot.txt request is nothing to worry about. This is a file you can place on your server to tell spiders and crawlers not to index you. The good engines always look for it before they add the site.

Russ, NCNE