2021-05-18 UTC
# 
[snarfed] hrm doesn’t really make sense to me. discovery and representing smaller sites sounds like great goals to me, but orthogonal to limiting indexing per site. if you only index 500 pages from a big site, you have no idea if you got a representative sample, and you often won’t have relevant pages for a given query at all