Forum being down/AI crawlers.
Posted: Fri Aug 22, 2025 9:03 am
Found this very interesting.
This is the bit that really annoys me.
This is the bit that really annoys me.
How can any reputable company do this? Creating work for website admins and taking sites down? It's terrible.In the face of bots riding roughshod over polite opt-outs like robots.txt directives,