• #dev 2023-10-29
  • Prev
    Next
  • #indieweb
  • #dev
  • #wordpress
  • #meta
  • #stream
  • #microformats
  • #known
  • #events
#dev ≡
  • ←
  • →
2023-10-29 UTC
# 10:21
sgreger Are there any opinions/precedence re respecting robots.txt when polling several thousand URLs (from my own content) to check for their existence?