2020-10-27 UTC
# Great research into functionality like this.
When I’ve built similar functions it has prompted me to do two things:
1. Create a library that makes it easy to be polite about the fetching: https://github.com/voxpelli/node-fetch-politely
2. Push for the “curlability” of sites: https://indieweb.org/curlability ( twitter.com/_/status/1321027598210768896)