2019-05-09 UTC
# 
@voxpelli Though: Remember that this is the Googlebot and we shouldn’t assume that competing crawlers are able to reach the same advanced level.
Crawlers are an important part of the web and should remain easy to build.
A reason why the web should stay “curlable”: https://indieweb.org/curlable (twitter.com/_/status/1126374728812441600)