2025-10-24 UTC
# 
[artlung] the distinction is to what it makes available to _the public_ and whether there's an archival value to the content. here's one post on that. https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/