2021-10-06 UTC
# 
capjamesg[d] I have a blocklist.txt file to which I can manually add domains. This gives protection against reindexing a website that has been removed. Individual pages are harder to trace but I can imagine a feasible, non-performance-drag way to implement a system to prevent blocklisted URLs from being reindexed.