#dev 2022-09-11

2022-09-11 UTC
#
[tantek]4 what is long polling
#
Loqi Long-polling is a common technique to create a push-like experience through polling by having the poll request wait for an item when there are none ready, rather than return an empty response https://indieweb.org/long-polling
#
[tantek]4 aside, re: interesting people tweeting (e.g. who work for typically very closed/secretive companies), when it's interesting like that, I highly recommend web.archive.org/save
#
[tantek]4 you never know when you might just be preserving history
#
[tantek]4 (that would be an interesting thing to annotate links with in posts, not
#
[tantek]4 just an alternative link to the Internet Archive version, but some ⭐ or some other indicator if you were the first to archive it)
corlaez and jacky joined the channel
#
corlaez The long polling is most likely the trigger for the lighthouse hang
#
corlaez I have also had issues with a websocket as well (at least with a localhost server)
#
corlaez Am I the only one using Kotlin or the JVM in general for it's (indie web) site?
#
corlaez Kotlin has a nice HTML DSL library, usually used for server side rendering but it works great for static generation templates
#
corlaez https://github.com/kotlin/kotlinx.html#stream
#
Loqi [Kotlin] kotlinx.html: Kotlin DSL for HTML
#
corlaez yeah that one! It's what I am using for corlaez.com by the way how do I link to my page
#
corlaez my user doesn't have a website link or photo
jacky joined the channel
#
corlaez added myself here https://indieweb.org/chat-names#Nicknames
#
angelo corlaez i just added your site to indieweb.rocks; anyone can add an IndieWeb-friendly site just by searching for it
#
angelo it's still very much under construction.. i should probably be more explicit about that
#
angelo and i just realized that lighthouse is the same *exact* tech that chrome browser uses.. and that 11ty is using for their "leaderboards" https://www.11ty.dev/speedlify/
#
angelo i want to do similar but with an emphasis on indiemark score at https://indieweb.rocks/featured
#
Loqi IndieWeb.rocks
#
corlaez cool, ty
jacky, [tonz], s[_] and tetov-irc joined the channel
#
capjamesg angelo I know someone who has been using Farcaster so that encouraged me to dig deeper.
#
capjamesg angelo I have a crawl limit at 15k for all sites.
#
capjamesg You can exclude items from IndieWeb search using the "indieweb-search" user agent.
jacky joined the channel
#
capjamesg IndieWeb Search just got a fresh coat of paint: https://indieweb-search.jamesg.blog/
#
capjamesg There are only 78690 documents indexed so we're missing out a bit on relevance right now :)
jacky and neceve joined the channel
#
angelo capjamesg what's the average number of pages per domain and what text from the page do you store?
angelo, jacky, geoffo and mro joined the channel
#
capjamesg I don' thave the number of average pages per domain because I limit crawls to 15,000.
#
capjamesg s/don' t/don't
#
capjamesg I store all text on the page, in two forms: 1. raw HTML; 2. all of the words on the page.
aaronpk joined the channel
#
jacky does anyone have a indieauth endpoint that supports the device authorization flow (when you have to enter a code to continue signing in)?
#
jacky I'm curious about making a client for this in godot (been learning more about gamedev and really got sucked into it)
jacky joined the channel
#
capjamesg I have Okta Verify support for mine?
#
capjamesg But I only support accepting a notification, not the 6 digit code entry.
#
jacky hmm gotcha
#
jacky might need to experiment with this
geoffo, jacky and [schmarty] joined the channel
#
[schmarty] jacky: i built an indieauth client proxy that does device flow: https://glitch.com/edit/#!/veil-mirror?path=README.md%3A1%3A0
#
[schmarty] so your device client starts a request to the proxy, which runs you through a regular indieauth flow, then returns the resulting info to the device client when done.
#
[schmarty] possibly only tangentially related to your ask 😅
#
jacky ooh this is good tbh
#
jacky (less work for me)
#
jacky building-blocks++
#
Loqi building-blocks has 1 karma over the last year
geoffo, jacky, alex11 and jamietanna joined the channel
#
jamietanna capjamesg do you use the `(e|p)-summary` for posts in the IndieWeb Search? Looks like my week notes don't show them, but could be I've messed up markup somewhere?
#
capjamesg It looks for a p-summary.
#
capjamesg The order goes: meta/twitter desc, p-summary, first sentence in e-content, first sentence after h1, first sentence after h2.
#
jamietanna Hmm that's weird, it seems to be ignoring my p-content (e-summary in some places) and going straight to e-content ? i.e. https://php.microformats.io/?url=https://www.jvt.me/week-notes/2022/35/
#
Loqi [Jamie Tanna] Week Notes 22#35
#
capjamesg I'll take a look.
#
capjamesg At the code that is. It looks like I didn't use an mf2 parser for that bit (the logic is older than most of the other code).
#
capjamesg I know the title logic isn't working properly either.
#
capjamesg I found this bug quite funny: https://indieweb-search.jamesg.blog/results?query=h-review
#
capjamesg [tantek] ^
#
capjamesg I have no idea how that happened but I'll fix it.
jacky joined the channel
#
[tantek]4 capjamesg, presumably from indexing microformats.org 🙂
#
[tantek]4 I would expect very few actual h-reviews to have "h-review" in their visible text
#
aaronpk well this is new, Redis is freaking out on me
#
aaronpk my apps are all getting this back from redis "LOADING Redis is loading the dataset in memory"
#
capjamesg I got a few 500s from webmention.io earlier aaronpk.
#
capjamesg When sending a webmention that is.
#
aaronpk yeah a lot of stuff uses redis
#
aaronpk oh i see... something is causing it to restart like every minute
#
aaronpk aha "Redis can't set maximum open files to 10032 because of OS error: Operation not permitted."
nertzy joined the channel
#
aaronpk it appears my redis dataset has gotten too large and now it gets killed by the OS when it tries to start
#
aaronpk oops apparently i did something in march that isn't cleaning up its redis usage https://i.imgur.com/BlSEa3i.png
#
aaronpk usually i use it only for ephemeral stuff
#
aaronpk now what was i doing in march...
#
[schmarty] haha wow that climb!
#
aaronpk apparently there are tools for analyzing the redis rdb dump file that it saves
#
aaronpk i just need to figure out which app is running wild
#
capjamesg 172,674 pages indexed in the last 28 or so hours.
#
aaronpk it's something wrong with aperture
#
aaronpk there are 4958269 items in a queue
#
capjamesg Oof.
#
capjamesg I see that a lot of blogs to which I am subscribed in Aperture have 0 posts listed aaronpk.
#
capjamesg I know some of these authors have published in the last 48 hours.
#
aaronpk interesting
#
capjamesg jvt.me posts for instance aren't showing up but I'm subscribed to his mf2 feed.
#
aaronpk maybe it's as simple as the background worker just hasn't been running 😮
tetov-irc and [tw2113_Slack_] joined the channel
#
aaronpk weirdly rebooting the whole server seems to have fixed it. but it's going through the queue veeeery slowly and i'm tempted to just wipe the whole thing
#
jacky is pro-nuking the queue
jacky joined the channel
#
angelo cirious what jobs are in the queue?
#
aaronpk mostly things like downloading local copies of images
#
corlaez TIL Loqi is a bot. He passed the Turing test today
#
corlaez earlier when I thought his readable text for my URL was a reply to a previous message. smh
#
corlaez Loqi++
#
Loqi Loqi has 3 karma in this channel over the last year (28 in all channels)