#Soniwell, publ does its own indexing mostly while avoiding crawlers. it has a lot more data about the files and their contents than a crawler has access to. basically it's cheaper for publ to figure out what changed than for an external system to do so.