Error 508: Resource limit reached

[Perturbee]

Hi,

Sadly the last few days we've been overrun by AI scrapers. Facebook (Meta.ai), Claude, and some other AI scrapers (Bytedance/TikTok too) had started to aggressively dig through the forum for training data. While I am not against training AI to give useful answers when people ask it about SFP, I really am against is that they bombard the site with scrapers and cause the site to lock up because it can't handle all the requests. It took me a while to identify the sources of these insane amount of requests, but yesterday I found something useful and implemented it. Now these scrapers only get the access denied page and hopefully that will cause them to avoid the site in the future.

For now it seems that the trick is enough to free up enough resources for everyone to use the site again. If it crops up again, please let us know. I can't check the site's availability 24/7, I can only check the graphs and logs afterwards. When you report it, please include the time and your time-zone (so I can convert it to the server time) or convert it to UTC as that's more anonymous.

Thanks for your help in advance!

[lollipop369]

Glad you found a solution so we can continue to enjoy this site of knowledge!