#dev 2022-08-18

2022-08-18 UTC
jkphl, nertzy, gxt, gRegorLove__, jonnybarnes, vilhalmer, gRegorLove_, tetov-irc, tbbrown, alex11, jacky, petermolnar and jjuran joined the channel
#
[snarfed]
looked more at universal Reddit backfeed. submissions alone total 453G to download 😐 https://files.pushshift.io/reddit/submissions/
#
jacky
sheeeeesh
#
[snarfed]
wish there were dumps of only link-based submissions
jacky joined the channel
#
[snarfed]
still doable
#
[tantek]
snarfed, are you throttling your crawler / API caller so you don't get blocked?
#
[snarfed]
It's using their Firebase-based API, https://github.com/HackerNews/API , so no, I'm not
jacky joined the channel
#
Loqi
[HackerNews] API: Documentation and Samples for the Official HN API
#
[snarfed]
And I'm running it inside GCP so they're more likely to trust the client IPs 😎
#
[snarfed]
(not much though)
#
[snarfed]
what other big link sharing silos should I/we consider? Digg, Delicious, Pinboard...? I don't live in these places much, you all will know better than me
#
[snarfed]
also, some stats for doing reddit ongoing, ie streaming the firehose: average ~12qps submissions, 76qps comments (estimated from https://www.redditinc.com/blog/reddits-2020-year-in-review ). doable!
#
thehedgeh0gtheyt
you could pull from lobste.rs, which is pretty likely to have a lot of links to webmentioned blogs.
jacky joined the channel
#
[aciccarello]
I think lobste.rs already sends webmentions natively https://indieweb.org/Webmention#Lobsters
#
thehedgeh0gtheyt
wow, I didn't even realize that! That's really cool.
jacky, petermolnar, [chrisaldrich], vilhalmer and geoffo joined the channel
#
GWG
[snarfed]: Pinboard is easy enough and I have gotten asked for it
jacky joined the channel
#
[snarfed]
GWG: asked for...POSSE support?
#
[snarfed]
and I assume you mean easy enough to POSSE? topic here is universal backfeed via historical data dumps and/or firehose
jonnybarnes joined the channel
#
GWG
[snarfed]: I wrote posse into syndication links in 90 minutes. The Api should allow for backfeed.
jacky joined the channel
#
GWG
Never mind, don't see it
gRegorLove_ and jacky joined the channel
#
capjamesg
[Jamie_Tanna] Could you help me with a Golang issue?
#
capjamesg
I have a goroutine that keeps hanging. I'm using wait groups.
#
capjamesg
Oh hey it's working!
jacky joined the channel
#
capjamesg
I now have a script to notify me if any of my web services go down.
#
capjamesg
doosboox next on the list is to restore the static site webring.
jacky joined the channel
#
capjamesg
I think this is maybe a ProtonMail thing but I got this SMTP error earlier: "Error: transaction failed, blame it on the weather:"
tbbrown and barnaby joined the channel
#
GWG
Need good short name for trust level display of responses.
superkuh joined the channel
#
[snarfed]
"trust"?
#
[marksuth]
trustiness?
#
aaronpk
oh yay he published it
#
Loqi
does a happy dance!
tetov-irc joined the channel
#
Loqi
[gRegorLove] #19 Add support for IndieAuth metadata endpoint
#
[schmarty]
Time to cut a release? :star-struck:
#
gRegor
Think so, unless anyone else would like to test it out first
nertzy joined the channel