#dev 2023-12-06

2023-12-06 UTC
[tw2113] joined the channel
#
lockywolf
Can someone criticize my "requirements analysis for a good feed reader"? https://lockywolf.net/2023-12-05_how-to-make-a-good-feed-reader.d/index.html
#
s​tarrwulfe
Here's an example of how I'd like CraftDocs to be the CMS for my site...
#
IWDiscord
<s​tarrwulfe#0>
[KevinMarks], geoffo, AramZS, CRISPR and jeremycherfas joined the channel
#
[snarfed]
lockywolf user req'ts for feed readers are infamously broad and disjoint, ie there are multiple types of users who want drastically different things from a feed reader. an ex Google Reader PM did a famous deep postmortem years ago on this. it's probably more or less impossible to come up with a single list of comprehensive req'ts
#
lockywolf
[snarfed]: 🤷, well, yeah, but (1) this is why we have lisp and dynamic languages, which can be customized by the user, (2) aiming at a certain group with consistent requirements is still possible
#
lockywolf
[snarfed]: do you remember any keywords from that post-mortem I can listen to?
#
lockywolf
*I can find on Google
geoffo joined the channel
#
[snarfed]
sadly no
#
[snarfed]
and wow yeah "write your own code to change the app" is definitely one approach, but it only works for a veeeery limited audience 😆
AramZS joined the channel
#
aaronpk
Yeah wow the language some software is written in has basically nothing to do with the usability of it in practice
#
[0x3b0b]
You know, I can remember thinking about what I'd like in a feed reader on a few occasions, and never getting anywhere with it. I think what it boils down to is that the itches I have with using the RSS/Atom support built into my email client (currently Vivaldi), and (these days) the inbox of my Microblogpub instance, are insufficient to motivate meaningful effort put toward any of the improvements I might like.
AramZS joined the channel
#
lockywolf
aaronpk: I am an Emacs user :)
#
lockywolf
I have _a lot_ of hooks in my ~/.emacs.d/
#
lockywolf
it is true that you can patch almost all open source software to run your functions whenever needed
[Jo], oodani, Guest6 and barnaby joined the channel
#
[Murray]
@lockywolf an interesting list for sure, definitely some stuff in there I wouldn't consider necessary features _for me_ (such as the address book and sharing), and probably missing a couple I'd require "table stakes" (again, for me): easy annotation and customisable export formats (a bonus if keyboard shortcuts also tie into this)
#
[Murray]
Rather than try to explain exactly what I mean, I'd say take a look at the feature set of Readwise's "Reader" app, which is the closest thing I've found to what I want, and the current reader that I use. I'd love it to do some things differently, and there's features in there I'll never use (funnily, the Readwise integration is probably top of that list) but it's "close enough" for now
#
lockywolf
"Readerwise Reader"?
#
lockywolf
found it
#
lockywolf
does look like people who are doing it know what they are doing
#
lockywolf
doesn't seem to be self-hosted though
#
[Murray]
No, I don't believe so, but to me that's a feature if you will 😄 I do not want that hassle
#
lockywolf
[Murray]: nice suggestion, thank you
#
[Murray]
no worries. One of the nicer aspects is that there are automated export options to other, more open tools like Obsidian. Personally I export to Markdown, then import to my own site, but I'm considering setting up some automated path just for a backup
#
lockywolf
well, I am mostly interested in importing from other sources
geoffo, [pfefferle] and AramZS joined the channel
#
aaronpk
anyone tried this before? https://chyrplite.net/
#
aaronpk
"An ultra-lightweight blogging engine, written in PHP"
#
aaronpk
i'm gonna do a trial run with it to see how i like it, but then I might start filing issues for indieauth and micropub :D
#
[schmarty]
i look forward to peeking at the codebase. i'm coming back around to my project from last year to port all my lil hackathon micropub projects from glitch to PHP to make a common PHP-indieweb-micropub-thing framework or project template. i've muddled through using it on a handful of things and generally am able to make stuff work, but it's still not nearly intuitive, haha.
#
aaronpk
i just really want to be able to spin up a blog without a lot of fuss
#
aaronpk
but then i also want it to have features like tags, micropub, etc
#
aaronpk
and then things quickly spiral out of control and i've rebuilt wordpress
#
GWG
aaronpk: Even WordPress is out of control
#
[schmarty]
wordpress has rebuilt wordpress
#
GWG
[schmarty]: That makes me the squatter who is refusing to sell out after the rest of the neighborhood has sold out to urban redevelopment? Like the couple in Batteries Not Included?
#
[schmarty]
dang i love that movie
#
GWG
We need a Carlos, I guess
[snarfed] joined the channel
#
[snarfed]
hey [manton] does http://micro.blog use a service to poll and import RSS feeds? or do you do that polling yourself?
[manton] joined the channel
#
[manton]
[snarfed] I do the polling myself.
#
[snarfed]
wow, ok!
rocto and geoffo joined the channel
#
[KevinMarks]
Are monocle/aperture under a lot of load today? I'm seeing lag when I click a topic
#
aaronpk
i've been getting traffic alerts
#
aaronpk
i haven't looked into it much
#
[KevinMarks]
Clicking a monocle topic takes ~30 seconds to switch to the new page and ~3 minutes to load the post content and show the "read more" bar
#
aaronpk
weird, it's not doing that for me
[jamietanna] joined the channel
#
[jamietanna]
Yeah I've been seeing that too in the last couple of hours, via IndiePass
#
[KevinMarks]
I can try it on desktop and run a trace, this was mobile on WiFi
#
aaronpk
oh wow the cpu is holding steady at 50%, that usually doesn't happen
#
aaronpk
nevermind apparently that's exactly the average
#
[manton]
[snarfed] If you’re curious, as a coincidence I actually just made a little diagram of http://Micro.blog’s architecture… The three “app server” boxes handle both web traffic for the platform and also background tasks. They are always polling RSS feeds. Usually it tries to poll a feed every few minutes, unless there are errors or other problems in which case it backs off. There are a couple quirks and optimizations but nothing too f
#
Loqi
[preview] [Manton Reece] Made a little architecture diagram for Micro.blog that reflects the recent server upgrades. A couple simplifications but it’s pretty close to how things work.
#
aaronpk
i really need to improve my back-off logic for feeds that are erroring
#
[manton]
Mine isn’t too clever. I think it basically just slows down, checking maybe once an hour. And in extreme cases once a day for weird things that look broken.
#
[manton]
Like “HTTP gone” I think it doesn’t completely stop checking.
#
[snarfed]
thanks [manton]! really useful to hear. roughly how many feeds total are you polling right now?
#
aaronpk
fwiw i'm polling about 7000 feeds right now
[nsmsn] joined the channel
#
[manton]
[snarfed] Hmm, I’m not totally sure… Looking… There are over a million feeds in the database (for some reason!) but it’s checking a much smaller number. There are records for feeds of Mastodon accounts and other things that aren’t polled. It avoids polling the Micro.blog-hosted feeds because it knows when those change. Looks like roughly 55k are the type of feed that it tries to poll regularly. That might be off but it’s in the b
#
[manton]
http://Micro.blog feeds are still downloaded, but only when a blog post is published so I don’t count that as polling.
#
[manton]
In other words, create new blog post → download the feed → mark the feed as not needing to be polled again until something else changes.
#
[snarfed]
polling 55k feeds every few min is a lot! something like 200qps of feed fetching and processing, phew
#
[snarfed]
I'm guessing you maybe have more frequency tiers that are slower
#
[tantek]
anyone using CSS grid on. your website, e.g. home page? add yourself to https://indieweb.org/grid#IndieWeb_Examples
#
[manton]
[snarfed] Yeah, I don’t have a good sense of the different tiers without scripting some kind of report… Each feed basically keeps track of how often the polling interval is and when the next download should approximately be.
jjuran joined the channel
#
[snarfed]
thanks! good inspiration for me to maybe do that polling in BF myself instead of finding a Superfeedr replacement
#
gRegor
what is chirp?
#
Loqi
It looks like we don't have a page for "chirp" yet. Would you like to create it? (Or just say "chirp is ____", a sentence describing the term)
#
gRegor
Hm I thought we had that
#
gRegor
what is perch
#
Loqi
Perch Runway is a content management system with a monthly license fee, built on PHP and MySQL. It was formerly offered in two flavors with Perch being for smaller sites and Perch Runway for sites which have large collections of content https://indieweb.org/Perch
#
gRegor
Maybe that was it
#
gRegor
Similar letters, different order xD
#
gRegor
haha, no, I'm thinking of a PHP CMS
jjuran and geoffo joined the channel