#dev 2021-09-15
2021-09-15 UTC
# 
SamWilson[m] Is anyone here using Overland on Android? I'm trying to implement a receiver for it and am running into a problem: https://github.com/OpenHumans/Overland_android/issues/16
# SamWilson[m] do you have it setting a token correctly? I can't figure out how to tell the app what auth token to send
# SamWilson[m] ah cool. I guess I'll do that then! makes sense, even if it's a little less secure (I think)
# SamWilson[m] yeah I could prob just install Compass, but it seems reasonably easy to implement so I'm trying to build it into my own thing
# SamWilson[m] I've got a map of posts at https://samwilson.id.au/map and want to add squiggly lines too :-p
[jeremycherfas] joined the channel
# SamWilson[m] Ruxton: what, really?! that's great!
# SamWilson[m] that must make about four aussies :-P
# SamWilson[m] Ruxton: sometimes, at spacecubed, but nothing lately. Is there an indieweb one?
# SamWilson[m] hmm that's a shame. I'd be interested in coming to something.
# SamWilson[m] what's your URL by the way?
tetov-irc, [calumryan], hendursaga and shoesNsocks joined the channel
# 
@edent ↩️ I'm still working out how best to do semantic Webmentions back to my blog. But, in the meantime, here are all the papers which have cited my work: https://shkspr.mobi/blog/citations/ (twitter.com/_/status/1438127118777466886)
# 
capjamesg[d] !tell skenebel I have managed to figure out the solution to the concurrent.futures issue.
# capjamesg[d] My code is not as clean as I would like but it (almost!) works as expected.
# capjamesg[d] And I had no idea how much quicker multi-processing was.
# capjamesg[d] I could feasibly crawl 100,000 pages per day if every domain was valid on the list.
# 
[schmarty] concurrency++ concurrency++
# [schmarty] 😉
# capjamesg[d] concurrency++
# [schmarty] Hahaha perfect
# capjamesg[d] (every domain on the list to crawl is not valid so actual numbers will be lower)
# capjamesg[d] One thing I have learned so far is that the web is a really messy place.
# capjamesg[d] In terms of use of standards, URL structures, redirects, and general what I would call webmaster hygiene.
[grantcodes] joined the channel
# 
[grantcodes] [aaronpk] re "configure a particular channel to show only the latest post from each subscription" - I tried doing this as a micropub "middleware" for a map view of most recent locations, but never really got it consistently working.
angelo, justache, Seirdy and jamietanna joined the channel
# 
jamietanna GWG sorry I missed a few messages, I don't have a good IRC interface at the moment so just scrolling back through chat. for now
# jamietanna !tell snarfed sorry - there were some changes to my Kubernetes cluster, and for some reason the authentication to the secrets management stuff (to retrieve my Micropub refresh token) has failed, I'll try and nudge it
# jamietanna GWG there was one about phrasing of auth on token introspection - I'd say something like "the issuing of client credentials to access this endpoint is out of scope of this specification", or something - then it makes it so people read it as "I should do it"
# jamietanna there was also about hinting re refresh_token - not sure what you're thinking re hints? Just like, what to do / how to structure it?
# jamietanna Or interesting things, like always issue a fresh RT?
# jamietanna It's not, but it's something a few servers are doing nowadays - aaronpk may be aware of if it's been talked about standardising?
# capjamesg[d] [KevinMarks] Is there any good documentation on threading in Python that you think is worth a read?
# capjamesg[d] I could read the robots.txt / sitemap.xml resources for a couple of sites at once and then use concurrent.futures thread pool to create threads for each site. That way I could have five threads working on five sites.
# capjamesg[d] The trouble is that there isn't an easy way to terminate a thread I don't think.
# capjamesg[d] sknebel can maybe help out here.
# capjamesg[d] So maybe there's something I should be doing at a higher level.
# jamietanna GWG but the risk is you've then got a - potentially infinitely - long lived refresh token and if that gets leaked, you have a bad time
# jamietanna Ah I've not looked much at token hinting
# jamietanna Yeah I'd say that if your tokens can be revoked (/ expire) then you should always return a fresh refresh token, and revoke the old one
# 
[KevinMarks] I used to use Twisted for this https://twistedmatrix.com/trac/
# [KevinMarks] I found this talk useful, though I have used the coroutines stuff more than the threads or processes stuff http://dabeaz.com/coroutines/
# jamietanna GWG it appears to be on OAuth 2.1:
# jamietanna > Refresh tokens for public clients must either be sender-constrained or one-time use
# capjamesg[d] [KevinMarks] thanks for sharing! I’ll check out that post.
# capjamesg[d] Angelo I haven’t. Any recommended place to start? I couldn’t find a good getting started page in their docs.
# jamietanna Yeah I'll get some comments on there tomorrow
shoesNsocks, maxwelljoslyn[d], tetov-irc and hans1963[d] joined the channel