Slow response today ? and 502 and other errors ?

Page 4 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

amenx

Diamond Member
Dec 17, 2004
4,605
2,924
136
The admin of another forum I visit (Guru3d) was complaining about aggressive AI crawlers, scrapers:

"Over the past few weeks, the website is really taking a beating. The servers keep overloading as AI bots, crawlers, and scrapers hit us harder than ever. They completely ignore the normal rules in robots.txt, and the old trick of blocking specific IP ranges doesn’t work anymore. These bots pop up from random IPs— not in tens, not in hundreds, not in thousands, but in tens of thousands at the same time — and they just keep hammering the site.

Last week we decided we can’t keep running like this, so we activated Cloudflare. We’re watching closely where the traffic spikes come from and enabling robot challenges where needed..."
 
  • Like
Reactions: dr1337 and CParsons

CParsons

Staff member
Dec 4, 2019
43
83
91
Whoever fixed it, thanks for fixing it! 👍
You're welcome! Apologies for the inconvenience and down time to all. That said, while we're still testing things out, I believe we have found a problem that has been dragging the site down for a long while. I don't want to say "WE FOUND IT, ALL OUR PROBLEMS ARE SOLVED!".. but let's just say things are looking grand atm.
 

BoomerD

No Lifer
Feb 26, 2006
66,575
14,975
146
You're welcome! Apologies for the inconvenience and down time to all. That said, while we're still testing things out, I believe we have found a problem that has been dragging the site down for a long while. I don't want to say "WE FOUND IT, ALL OUR PROBLEMS ARE SOLVED!".. but let's just say things are looking grand atm.
Thanks to your web wizards. Between this site being FUBAR’D…well, temporarily, it seems, and picking up a Reddit ban…I was afraid I might have to actually DO something. Thankfully, both have been resolved…for now.
 

WelshBloke

Lifer
Jan 12, 2005
33,394
11,537
136
Thanks to your web wizards. Between this site being FUBAR’D…well, temporarily, it seems, and picking up a Reddit ban…I was afraid I might have to actually DO something. Thankfully, both have been resolved…for now.
You! Banned from Reddit!

I'm shocked! Shocked!

Well not that shocked tbh!
 
  • Like
Reactions: Ken g6

GodisanAtheist

Diamond Member
Nov 16, 2006
8,467
9,881
136
You! Banned from Reddit!

I'm shocked! Shocked!

Well not that shocked tbh!

- Reddit will ban people for the tamest shit nowadays. Its where nonsense like "Unalived" and "Graped" is coming from to talk about deeply serious topics.

But that's a discussion for elsewhere.

Signed,
Someone who also got banned from Reddit and is not entirely sure why.
 
  • Like
Reactions: cytg111

cytg111

Lifer
Mar 17, 2008
26,662
15,967
136
Thanks to your web wizards. Between this site being FUBAR’D…well, temporarily, it seems, and picking up a Reddit ban…I was afraid I might have to actually DO something. Thankfully, both have been resolved…for now.
Reddit is a cesspool full of edge lords - the nastiest of creatures that somehow manages to weave around the TOS and carry favor with admins ... so when you actually call them an asshole they will report you and you get the pit. Its such dishonest shit.
 

BoomerD

No Lifer
Feb 26, 2006
66,575
14,975
146
Reddit is a cesspool full of edge lords - the nastiest of creatures that somehow manages to weave around the TOS and carry favor with admins ... so when you actually call them an asshole they will report you and you get the pit. Its such dishonest shit.
Supposedly, I got hit by a ban bot…I appealed and the ban was reversed.
 

KLin

Lifer
Feb 29, 2000
30,734
936
126
Well, didn't take long for the scrapers and bots to come back. Slowed down a lot now.

nvm, back to fast. Dunno what's going on LoL
 

pcslookout

Lifer
Mar 18, 2007
11,964
158
106
The admin of another forum I visit (Guru3d) was complaining about aggressive AI crawlers, scrapers:

"Over the past few weeks, the website is really taking a beating. The servers keep overloading as AI bots, crawlers, and scrapers hit us harder than ever. They completely ignore the normal rules in robots.txt, and the old trick of blocking specific IP ranges doesn’t work anymore. These bots pop up from random IPs— not in tens, not in hundreds, not in thousands, but in tens of thousands at the same time — and they just keep hammering the site.

Last week we decided we can’t keep running like this, so we activated Cloudflare. We’re watching closely where the traffic spikes come from and enabling robot challenges where needed..."

Here is the source where all of those come from
 
  • Like
Reactions: dr1337

lxskllr

No Lifer
Nov 30, 2004
60,677
11,039
126
- Reddit will ban people for the tamest shit nowadays. Its where nonsense like "Unalived" and "Graped" is coming from to talk about deeply serious topics.

But that's a discussion for elsewhere.

Signed,
Someone who also got banned from Reddit and is not entirely sure why.
I don't do reddit. During the api fiasco, I overwrote all my comments, and deleted my account. Lemmy fills my desire for a bit on mindless surfing well enough.
 
  • Like
Reactions: GodisanAtheist