#dev 2019-04-02

2019-04-02 UTC
jonnybarnes, [kevinmarks], KartikPrabhu, snarfed and [ketudb] joined the channel
jonnybarnes, [tantek] and [chrisaldrich] joined the channel
#
[chrisaldrich]
Thanks [jgmac1106] I bookmarked that last week to hack on a bit with their notify repo that Jon had pointed me too.
#
[chrisaldrich]
I ought to just read through their entire blog history...
[schmarty], mblaney1, snarfed, jonnybarnes, gRegorLove, mblaney, [tantek], tbbrown, gRegorLove_ and fluffy joined the channel
#
fluffy
snarfed: well you got me to join ;)
#
fluffy
brb, gonna use a proper client rather than the web chat
#
snarfed
lol hi fluffy
#
fluffy
blah, couldn't figure out how to get colloquy to connect :P
#
fluffy
I used to live on IRC. Oh well!
#
fluffy
I'm also assuming that this nickname is registered and I'm going to get kicked relatively shortly.
#
fluffy
Anyway! Back to the conversation from github.
#
fluffy
So, to me it seems like the big problem is an impedance mismatch between ActivityPub (which is, at least from my POV, mostly just "here's a big blob of text") and my heterogenous long-form content website, which has structure like title, intro, body text, etc.
cweiske joined the channel
#
fluffy
What I'd like out of this is the ability to simply specify what things map to what in the ActivityPub item stream, ideally with the ability to provide optional stuff to pave over some of the bigger UX issues.
#
fluffy
Like, CW text is probably the wrong mental model for it, but like, APub doesn't seem particularly suited to long-form text in general, and CW text is just the generic approach taken by a bunch of Mastodon instances.
#
snarfed
AS2 definitely has those fields and structure, eg content, summary, and name
#
jalcine
IIRC CW is a hijacking/unintended use of the subject field in AS2
#
fluffy
Okay, interesting. What does Mastodon do with them? Or is that a gigantic It Depends™?
#
snarfed
and bridgy fed (via granary) maps mf2 to AS2 pretty unsurprisingly
#
snarfed
fluffy: as mentioned, mastodon abuses summary into its CW UI
#
snarfed
details in the links i posted in the github issue
#
fluffy
Ah, I should probably actually read those links. :)
#
fluffy
Okay, so what does Mastodon do with the subject/title field?
#
snarfed
nothing...i think?
#
fluffy
Incidentally, as a result of this experiment I am adding actual summary functionality to Publ, and this has been the impetus for me to finally fix the microformats in my templates, which was clearly wrong on my end.
#
snarfed
re bridgy fed's mf2 => AS2 mapping, it uses granary, which has a comprehensive test suite (ie examples): https://github.com/snarfed/granary/tree/master/granary/tests/testdata
#
fluffy
ok cool, that'll be a great resource for me to at least see what other people expect out of the fields.
#
fluffy
also, neat, mastodon doesn't seem to be able to talk to publ.beesbuzz.biz via fed.brid.gy because it's not SSL-enabled (because I'm running it on Heroku free tier)
#
fluffy
I could just move that site to my own dang server, but I like having at least one thing hosted on heroku for the sake of ensuring that works.
#
snarfed
heh, let me walk that back a bit, those examples are just granary's test suite for the mappings i made up. they're not necessarily "official" in any way. just pretty mature and battle tested over time
#
fluffy
Yeah I'm not expecting them to be official, but sticking to someone else's convention is better than making up my own from whole cloth as I'd been doing before.
#
fluffy
A lot of my involvement in this has been very "Ready, fire, aim" :)
#
snarfed
aka iterating
#
fluffy
I wasn't really familiar with IndieWeb at all before I started implementing Publ, and I just had my own notions of how to modernize web publishing based on how things were in 2003. :)
#
fluffy
And I'm very grateful that there's already an ecosystem of people who have been working on the hard parts of it, and that it just happened to work well with the model I was going with.
#
snarfed
heh yup, lots of us came up with our own half baked versions of indieweb before we found it
#
snarfed
fluffy++
#
Loqi
fluffy has 2 karma over the last year
#
fluffy
like going into it I knew I'd be integrating with PubSubHubBub because I didn't know it had changed names, and I wasn't expecting Webmention to be a thing *at all* but I'm glad it is and it's learned a lot of lessons from pingback.
#
fluffy
And developing Pushl as a Publ companion has been great since it also works with a lot of other stuff. Because I love things being modular and UNIXy.
#
jalcine
same :)
#
fluffy
Anyway. I'm glad to be able to support ActivityPub but not having to implement that support myself, since when I started work on Publ the most frequent question I got was "are you going to support ActivityPub?" which I'm doing sort of begrudgingly because I still think there's a pretty big impedance mismatch for what I'm trying to do.
#
snarfed
heh. glad to help!
#
fluffy
Also the whole /.well-known thing makes me cringe. :P I'm very much team "<link rel> and things can be published statically"
#
jalcine
fluffy: omg same
#
jalcine
lol like that's been the biggest thing me trying to make a desktop client for AS2 stuff
#
jalcine
I have to make so many requests _just_ to get a profile
#
fluffy
yeah, and I'm also not a fan of how following works in ActivityPub; having to be aware of everyone following, and sending out a notification, and dealing with failures when they disappear. WebSub is great because it's an optional extension, and it specifies how to handle failures, and how to deal with backfilling during a client outage.
#
fluffy
(thankfully fed.brid.gy handles that stuff for me!)
#
fluffy
and I mean it's not like I'm implementing my own WebSub hub either, but superfeedr was way easier to integrate ;)
#
fluffy
not to mention adding WebSub support to Feed-On-Feeds.
#
cweiske
re well-known: Its big plus is that it does not put a HTML parser requirement into software
#
cweiske
as opposed to rel links
#
fluffy
That's fair. But I still like supporting the use case of people who don't have the know-how/ability/access to getting their own domain and hosting thereof.
ingoogni and snarfed joined the channel
#
fluffy
Which is probably quixotic on my part because nearly everything gives everyone their own personal subdomain at this point.
#
fluffy
huh, that's quite a lot more diversity than I was aware of.
#
fluffy
I guess it's nice that you don't have to declare the <link rel> on every page where it might need to be looked up, too. But on the other hand it feels a *lot* like favicon.ico to me :P
#
cweiske
well, you can define your own favicon url via a <link>
#
fluffy
Well yeah, but my point is that favicon.ico is to me the canonical example of an ad-hoc standard that's taken way too long to get rid of.
#
cweiske
what is bad with the favicon rule?
#
Loqi
It looks like we don't have a page for "bad with the favicon rule" yet. Would you like to create it? (Or just say "bad with the favicon rule is ____", a sentence describing the term)
#
fluffy
Mostly that browsers look it up and generate a lot of 404 traffic unnecessarily, and that it's stuck to a proprietary content-type.
#
fluffy
I mean I know browsers will happily accept icons in other formats other than Windows application icons, but still.
#
fluffy
I have a lot of curmudgeonly opinions, apparently :)
snarfed, jonnybarnes, [fluffy], [Rose] and [tantek] joined the channel
#
[tantek]
you're in good company fluffy++
#
Loqi
fluffy has 3 karma over the last year
#
[tantek]
stay skeptical
[Zegnat], gRegorLove, [Rose], mblaney1, jonnybarnes, jeremych_, [kevinmarks] and swentel joined the channel
#
[kevinmarks]
I'm a big fan of you writing out your thoughts on this stuff on your blog in longform, fluffy. I am realising how much I have lost since I gave into the tweet length approach
#
Loqi
[kevinmarks]: [tantek] left you a message 5 days, 4 hours ago: the marginalia page needs your help. It still shows / uses the ## syntax of Fragmentions - could you update it to the latest best practice for Fragmentions (and update any Marginalia implementation documentation accordingly — assuming your implementations support the single # syntax) https://indieweb.org/marginalia Thanks!
[jgmac1106], EmreSokullu, ingoogni and [Rose] joined the channel
#
Loqi
swentel: GWG left you a message 5 days, 17 hours ago: Explain this indiepush thing to me?
#
Loqi
How does it work? Login with IndieAuth on this site to create an account Open settings in Indigenous app and look for 'Push notifications' Use the API token on your account page to send a push notification manually Services integrating with thi...
#
swentel
coming soon
#
swentel
testing it at the moment
barpthewire joined the channel
#
jalcine
swentel: sick!
#
swentel
could be a nice addition in wordpress webmention plugin
#
swentel
or even in aperture
#
GWG
swentel: It uses MQTT?
#
swentel
GWG, yes
#
Zegnat
swentel: is this something that must be hosted by you, or could anyone host the push endpoint?
#
GWG
So, Indigenous is now an MQTT broker?
#
GWG
It is subscribing to topics from one, excuse me?
#
swentel
GWG, well, I use the pushy to register the device, the site stores the token. Anyone can send a push notifiation then, and I forward it to pushy
#
swentel
Zegnat, the official build yes. You're free to to compile the app yourself with a custom endpoint of course :)
#
Zegnat
Hmmmmmm
#
swentel
I could probably make this configurable in indigenous
#
swentel
like, use this existing service or so
#
swentel
might be an option
#
GWG
swentel: I am asking because I run an MQTT broker.
#
GWG
It's how I control some devices.
#
Zegnat
My site sending me push notifications is a more attractive reason for me to install Indigenous than feed reading. Not going to lie :P
#
GWG
I use Indigenous for the Micropub more than the Sub.
#
GWG
Hoping to change that someday.
#
swentel
well, you can send any type of push notification atm, I don't really care there :)
#
Zegnat
would run his entire life based on notifications, but doesn’t really like existing solutions for it
#
swentel
to be fair, this feature I guess is more for non technical people, especially if cms plugins integrate with it.
#
GWG
swentel: What are you imagining WordPress would integrate it to do?
#
swentel
GWG, e.g. when a webmention comes in, send a notification. That's what the Drupal plugin allows you to configure now (since webmentions are send to the internal microsub channel)
#
swentel
s/internal/internal notification
#
Zegnat
Replies to homepage, that look like they may be DMs, could trigger notifications.
#
GWG
I'll make a note
#
GWG
Working on rewriting webmention functionality, so need to finish that before new features
#
swentel
also, not sure whether to run my own MQTT broker.
#
swentel
the feature is also entirely optional, you need to explicitely register the device, I don't do it automatically
#
swentel
only when the device is registered, the pushy listeners start
#
GWG
swentel, if you want to test something with a broker, I have one and can test it for you
#
swentel
GWG, what software do you run ? Does it have an SDK ?
#
GWG
Mosquito
#
GWG
MQTT is a standard, so no SDK
#
swentel
hehe ok, I'll look around a bit to see if there are some android libraries to see if can register to custom endpoints and receive messages too
#
swentel
that would be nice indeed
#
Jeremycherfas
Does it matter if I have two 'u-listen-of' in one h-entry? They are identical.
#
GWG
Might confuse consumers
#
Jeremycherfas
Tricky one. OK, I'll get rid of one.
[jgmac1106] joined the channel
#
Jeremycherfas
All done. Stream and individual listen posts now have correct mf2 (I think).
#
swentel
GWG, thinking about this some more. Would I able to 'register' my device on your broker by sending a call to an endpoint ?
#
GWG
Not exactly. You have to subscribe
#
GWG
Read up on MQTT
#
swentel
well, reading a bit yes, and seeing sub / pub.
#
swentel
just wondering how it would work
#
swentel
or what I'd have to write :)
#
GWG
swentel, I bet there is a library
#
swentel
oh yes
#
Loqi
[eclipse] paho.mqtt.android: MQTT Android
#
swentel
yeah, was looking at that
EmreSokullu joined the channel
#
swentel
looks like I only need a server uri, that's it
#
swentel
eclipse runs a test server, so I can test with that
#
GWG
swentel, mine uses ssl and a username and password
#
GWG
I could do some crazy things with MQTT
#
swentel
ok, will ping you if I have something to test with
#
GWG
I also need to write scripts to get my data between services
#
GWG
So I am not running redundant services
[jgmac1106], eli_oat, [kenbauer], [kimberlyhirsh], snarfed, [tantek], [kevinmarks] and [schmarty] joined the channel
iasai, tbbrown, gRegorLove, jonnybarnes, [kimberlyhirsh], eli_oat and callMeBaby joined the channel
#
GWG
I need a script that receives a post and makes a post of the same data in a different format
#
GWG
Trying to figure out how to secure such a thing
jonnybarnes, snarfed, [jgmac1106], [jeffperry], [chrisaldrich], PatrickMNiedziel, leg, NotFBI, [kenbauer], doubleloop and [ketudb] joined the channel
#
doubleloop
I'm thinking about how to best add new people that I want to follow via Microsub
#
doubleloop
At first I was thinking of making a browser plugin that would interact directly with the Microsub API (https://indieweb.org/Microsub-spec#Following)
#
doubleloop
But then I thought I'd probably want to do it via mobile too
#
doubleloop
So was thinking that it might be better to use Micropub to create follow posts (https://indieweb.org/follow), and then have my server do the Microsub API call
#
doubleloop
With that though I'm not sure how I'd choose which channel to send the follow to
#
doubleloop
Any thoughts about it? The only client I've seen for following a feed so far is in Indigenous, that acts directly against the Microsub API
#
snarfed
hmm, tying follow/unfollow posts to microsub subscriptions definitely is interesting
ingoogni and [cleverdevil] joined the channel
#
doubleloop
What got me thinking about it was I have an additional and (possibly?) niche use-case to simply subscribing to a feed, in that I like to use Microsub to follow individuals on Twitter, going via granary
#
doubleloop
So I wanted to make something that would just take a Twitter handle and do the finagling behind the scenes for me
[kenbauer] joined the channel
#
doubleloop
Given the extra logic for that (if it's a Twitter user, do this extra stuff, which also involves my twitter access token for granary...) it feels like it makes sense to have that on the server
snarfed joined the channel
#
doubleloop
And then it'd be nice to tie that in to doing a follow post, so it could all be triggered from any Micropub client that allows me to do a follow post
snarfed, swentel, EmreSokullu, [eddie] and EmreSoku_ joined the channel
#
Loqi
doubleloop has 1 karma in this channel over the last year (4 in all channels)
#
snarfed
doubleloop++
#
snarfed
agreed
#
snarfed
i'd also recommend managing your twitter following in a twitter list, and then subscribing to that list via granary just once, instead of each user's granary feed separately
#
snarfed
lighter in a few ways and easier to add/remove individual people
#
doubleloop
snarfed: I do kind of like managing the follows in Microsub, partly so I can put differently themed Twitter accounts in different channels, and also partly a bit philosophically/stubbornly I want to try to avoid using Twitter as my list management tool.. (I mention it a little in my post)
#
snarfed
heh, understood
#
snarfed
you can do multiple lists for themes, but understood
#
doubleloop
Though oh yeah on the first point I guess I could have multiple lists in Twitter that match the channels in Microsub
#
snarfed
in the past, when people have done this and subscribed to enough individual users, eg hundreds or more, we've eventually asked them to switch to a list, because fetching a feed per followee doesn't scale and gets too heavy
#
snarfed
but you can see
#
doubleloop
Oh, got you, yes I can see it would be heavier on granary
#
snarfed
and the microsub server
#
snarfed
n feeds vs 1
#
doubleloop
In that case I'd be totally happy to use Twitter lists
#
snarfed
thanks! and sorry for making you need twitter more
#
doubleloop
Re: the Microsub server, I guess the same issue would hold regardless of the feed type? e.g. if I ever subscribed to >100s individual feeds, I should start thinking about either paying someone for hosting me (if that's an option), or hosting myself
#
doubleloop
>100s indieweb sites I mean
#
doubleloop
snarfed: thanks for making me need it less, with all the various awesome tools!
#
doubleloop
And I guess really if I have a philosophical issue with Twitter it'd be more useful to address it at source and help persuade the people I want to follow that they should move to indieweb..
#
snarfed
doubleloop: welcome!
#
snarfed
and re 100s of feeds, yes, but we'll generally be more open to scaling ourselves if those are all web sites than if they're twitter users :P
#
KartikPrabhu
if someone wants a rabbit hole reading : https://htmlparser.info/
#
snarfed
demurs
#
GWG
Evening
[eddie] joined the channel
#
[eddie]
Ugh.... DreamHost’s platform is down
#
[eddie]
Which means my website, my reader, etc is all down too
[asuh] joined the channel
#
[asuh]
[eddie] where did you see that?
snarfed joined the channel
#
[asuh]
ohhh DreamCompute
#
GWG
Hello, [Eddie]
#
doubleloop
Is export/import currently a thing with Microsub? Say I build up lots of subscriptions in Aperture, but then decide I'd like to move to Yarns. Would it be a case of scripting it?
#
GWG
doubleloop, not yet
[jgmac1106] joined the channel
#
[eddie]
Hey GWG 👋
#
GWG
[eddie]: I have a question for you
#
GWG
How have you customized Compass since you started using it?
#
GWG
I see some PRs
#
[eddie]
doubleloop: you could use the CLI Microsub client Ek to export/import OPML files between servers https://github.com/pstuifzand/ekster/blob/master/README.md#ek
#
[eddie]
GWG I have customized a little bit. All the customization I’ve put back into PRs though. No hidden customization
#
GWG
Any external script interaction?
#
GWG
And what are you storing?
KartikPrabhu joined the channel
#
GWG
I see aaronpk stores weather
#
GWG
Any extra parameters
snarfed, EmreSokullu and [ketudb] joined the channel
#
[eddie]
I don’t Store anything extra. All extra stuff is in my website itself
#
[eddie]
I haven’t done anything extra in that regard really
[cleverdevil] joined the channel
#
GWG
Oka
[tantek] joined the channel
#
[tantek]
KartikPrabhu interesting link. The author has been involved in WHATWG / HTML spec work for years so they're a good source.
#
[tantek]
I clicked around and found lots of TODO - it's definitely a WIP
#
[tantek]
In particular lots TODO in https://htmlparser.info/microsyntaxes - I was particularly looking forward to his time and date microsyntaxes summary only to find ... it's missing (not even a TODO about it!) so I imagine there's still lots of work for this be a "ready to read and use book"
#
KartikPrabhu
yeah it is WIP, but that is one advantage of publishing a wook
#
KartikPrabhu
wook = web book (I think adactio made that word up)
#
[tantek]
I see where that is going and I'm not going to fall for that Ackbar.
mblaney and EmreSokullu joined the channel
#
mblaney
interesting Microsub discussion, doubleloop I have tried to do something similar with my twitter feed.
EmreSokullu joined the channel
#
mblaney
I use https://twitter-atom.appspot.com/ to subscribe to the whole feed, and then my reader (dobrado) allows setting the channel based on author.
#
mblaney
so it's like twitter lists but I can manage it within my own reader
#
mblaney
one other thought: Microsub doesn't really need export/import. A Microsub client could let you specify a second server, and then use the API to read your follow list from one server and subscribe on the other.
gRegorLove joined the channel