• #dev 2025-07-01
  • Prev
    Next
  • #indieweb
  • #dev
  • #wordpress
  • #meta
  • #stream
  • #microformats
  • #known
  • #events
#dev ≡
  • ←
  • →
2025-07-01 UTC
# 18:10
[manton]
I think most legitimate AI crawlers do respect robots.txt. Of course, there will be rogue bots that don’t.