2023-06-15 UTC
# 
bkil Soni: I could still mostly repeat myself from the last conversation. You would need to work on your idea a bit more to see its weaknesses and then perhaps blog about it. The size of an index is usually in the same ball park as the data itself. Thus, all participating indexers would need to refetch (="crawl") the content index of everyone else that is even less efficient than recrawling only the modified or new pages based on a site map or atom feed.