tantekq+ just to give a personal user anecdote example using robots.txt to block bots from my blog for its first two years felt "good enough" and then afterwards I changed how/what I posted. would like per-post robots.txt controls. might just implement this in my own CMS.
