2020-10-27 UTC
# 
@voxpelli Great research into functionality like this.
When I’ve built similar functions it has prompted me to do two things:
1. Create a library that makes it easy to be polite about the fetching: https://github.com/voxpelli/node-fetch-politely
2. Push for the “curlability” of sites: https://indieweb.org/curlability (twitter.com/_/status/1321027598210768896)