Anyone know of a gO0glebot?

[dds14u]

I just checked out the visitor statistics to my website and I saw a gO0glebot type thing.

What is g00gle doing these days...they're scaring me.

 

[robothouse77]

Originally posted by: dds14u
=
What is g00gle doing these days...they're scaring me.

if you ask me, they are doing WAY too much (bum bum BUMMMMM!)

 

[revnja]

It's a spider bot that's indexing your page. If you don't want google indexing your page, google info on 'robots.txt'

 

[dds14u]

Originally posted by: adambooth
It's a spider bot that's indexing your page. If you don't want google indexing your page, google info on 'robots.txt'

Indexing meaning adding my site to their search engine?

 

[revnja]

Originally posted by: dds14u

Originally posted by: adambooth
It's a spider bot that's indexing your page. If you don't want google indexing your page, google info on 'robots.txt'

Indexing meaning adding my site to their search engine?

Something like that, yeah. Google 'robots.txt'. The first result has some good info.

 

[aplefka]

I thought that they didn't have to pay attention to the robots.txt if they didn't want to. Wasn't there a lawsuit over some medical site that countersued the Archive after evidence that came from a page from 1996 made them lose a different lawsuit? I remember reading in the article (or at least I think I do) that they didn't have to pay attention to the robots.txt necessarily?

 

[revnja]

Either way, googling robots.txt should at least give him an idea of what it is. If you're intent on hiding things, a good idea would be to not put them on the internet in the first place 😉

 

[dds14u]

Originally posted by: aplefka
I thought that they didn't have to pay attention to the robots.txt if they didn't want to. Wasn't there a lawsuit over some medical site that countersued the Archive after evidence that came from a page from 1996 made them lose a different lawsuit? I remember reading in the article (or at least I think I do) that they didn't have to pay attention to the robots.txt necessarily?

What do you meant they don't haev to pay attention to robots.txt?



On another note I'm just paranoid about google and bots...and g00glbOts...well that's just even worse.

 

[DaveSimmons]

As long as your real name isn't Sarah Connor you'll be fine :roll:

The robots.txt is your friend