Internet activity

IBMJunkman

Senior member
May 7, 2015
579
159
116
GoDaddy says my website has 7% robot devices accessing it. Don’t know if that activity includes robots that pay attention to my robots.txt file.

This makes me wonder. How much of the overall internet activity is robots, spiders, etc? And now with, I assume, AI looking for stuff to learn.
 

Jon-T

Senior member
Jun 5, 2011
459
265
136
One of the latest reports says 47%.

Checking another forum I visit which displays users online there are presently 6 obvious bots logged in and 30 apparently organic critters browsing the site. Though some of the organics may be stealth bots

The bots are going to fetch every page while the organic meat bags will only go after those of interest.