2023-06-02 UTC
# 
[schmarty] i wonder how many ai training sets blatantly contain material that is marked as denied by robots.txt or noindex. a "new" spec without some kind of enforcement weight doesn't feel particularly useful given we already have tools.