#indieweb 2019-07-12

2019-07-12 UTC

sknebel well, my understanding was that if a page is blocked in robots.txt but linked elsewhere, search engines will pick it up and just not show any content to it, but e.g. match on words in the ur