2025-01-07 UTC
# 
petermolnar https://www.businessinsider.com/openai-anthropic-ai-ignore-rule-scraping-web-contect-robotstxt - yeah. I was wondering why my server load suddenly started alerting. Self hosted git (forgejo) and a*hole AI scrapers are not a great combination.