• #dev 2022-02-13
  • Prev
    Next
  • #indieweb
  • #dev
  • #wordpress
  • #meta
  • #stream
  • #microformats
  • #known
  • #events
#dev ≡
  • ←
  • →
2022-02-13 UTC
# 13:59
capjamesg[d]
There are a lot of exclusions (i.e. non-200 URLs, non-HTML documents) but generally if you have a HTML file on your site that is not blocked by robots.txt or noindexed, it will be crawled.