Forum is being scraped again

Page 8 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Ken g6

Programming Moderator, Elite Member
Moderator
Dec 11, 1999
16,619
4,534
75
Seems a bit better now. I don't know if it's improved, or just the load is lower this time of day.
 
Jul 27, 2020
25,998
17,945
146
Who forgot to feed the hamsters?
They were more likely getting trampled by traffic. I think a lot of lurkers have subscribed to a lot of threads and it's taking a serious toll on the site having to notify them all. As a developer, I would seek out the more recent members who have subscribed to a lot of threads in different sections. Those could be bots.
 

Red Squirrel

No Lifer
May 24, 2003
70,151
13,565
126
www.anyf.ca
Seems to be happening every evening now. Some kind of new cron job got added maybe? Might also be worth running an optimize on the database, some process might be making a table very slow over time and it's just starting to be an issue now.
 

DrMrLordX

Lifer
Apr 27, 2000
22,695
12,643
136
On the plus side it looks like the forums are working fine now, which is much better than it was 1-2 days ago. Thanks to whoever sorted that out. Until the next time it slows to a crawl.
 
  • Like
Reactions: Jimminy and iRONic

BoomerD

No Lifer
Feb 26, 2006
65,898
14,296
146
Yeah, it's definitely dragging again. I can get pages to load...IF I'm patient and wait for them.
 

DrMrLordX

Lifer
Apr 27, 2000
22,695
12,643
136
It seems to be getting worse and worse as the moments drag on.

edit: and just like that, the problem is gone.
 
Last edited:
  • Like
Reactions: cytg111

BoomerD

No Lifer
Feb 26, 2006
65,898
14,296
146
It seems to be getting worse and worse as the moments drag on.

edit: and just like that, the problem is gone.
intermittent for me. One page will load fast...the next one hangs and takes more than a minute to load.