• #indieweb 2014-10-02
  • Prev
    Next
  • #indieweb
  • #dev
  • #wordpress
  • #meta
  • #stream
  • #microformats
  • #known
  • #events
#indieweb ≡
  • ←
  • →
2014-10-02 UTC
# 20:37
reedstrm I'd think the correct approach for them would be to archive the WHOIS data for domains as well, and only honor robots.txt if the ownership matched.