2021-09-23 UTC
# capjamesg[d] voxpelli To recrawl, I am going to: (i) check all active RSS / Atom / mf2 h-feeds and crawl new articles; (ii) look at pages that were recently added to a sitemap using the lastmod attribute (if none is present, pages will be crawled anyway); (iii) check if the homepage was crawled in the last three weeks and if it was not, order a full recrawl.