2014-10-24 UTC
# 
tantek____ Perhaps the robots.txt blocking problem is good motivation for always using a specific non-generic subdomain as it is unlikely that a later domain re-user would setup the same subdomains, and robots.txt from the main domain does not apply to subdomains.