#dev 2023-05-20

2023-05-20 UTC
gregsplace joined the channel; gregsplace left the channel
#
bkil
According to your experience, how do web search indexers tokenize URLs on a given page? Can they also index each word within it? For example, in PostgreSQL full text search used by Synapse, the indexer fails to pick up words within a URL, despite making the URL itself searchable in a limited way.
bterry and gRegor joined the channel
#
gRegor
Hm, the wikipedia rel-me isn't showing up for me even after a while adding it to my preferences https://en.wikipedia.org/wiki/User:GregorLove
#
vladimyr
if anyone decides to play with bluesky using remote vm/container solutions save yourself some time and avoid stackblitz and codesandbox
#
vladimyr
former doesn't have safe way to store secrets and leaving your (app) password inside code is a bad idea, latter instantiates microVMs inside network range blocked by bluesky aka you won't be able to create session
#
vladimyr
github codespaces seems to work
[marksuth], oodani, petermolnar, sivoais, gregsplace and geoffo joined the channel; petermolnar and gregsplace left the channel
#
[schmarty]
capjamesg: this example from the mf2.link wiki page is throwing a 'cannot read properties of undefined (reading 'display_name') error: https://mf2.link/mastodon?url=https://indieweb.social/@capjamesg/110326728064487846%20and%20https://mf2.link/mastodon?url=https://toot.cafe/@calumryan/110355115177267160
nsmsn, geoffo and [TMichelleMoore] joined the channel
#
[KevinMarks]
[snarfed] if I open a http://granary.io link in chrome, it looks like the feed has mojibake in, but fetching it with curl looks right - any idea why chrome is not seeing the encoding? https://granary.io/url?input=html&output=rss&url=https://bsky.link/feed?user=manton.org
#
[KevinMarks]
you're returning `'*content-type*: application/rss+xml'` - should that be `'*content-type*: application/rss+xml; charset=utf-8'`
#
[snarfed]
hmm! maybe? I don't know, do you?
#
[snarfed]
I'm not really familiar with how chrome renders RSS either
#
[KevinMarks]
right, I think chrome uses default encoding, which is win 1252
bterry joined the channel
#
[snarfed]
confirmed, that fixes it
#
[KevinMarks]
there used to be a pref for this, which is now hidden
#
[snarfed]
thanks for the catch! deploying now
#
[snarfed]
I'll add charset to all emitted content types except the JSON ones, since afaik JSON is ASCII with \u escapes, right?
#
[KevinMarks]
JSON is utf8 by default
#
[snarfed]
huh, really? what's with the \u escape sequences then?
#
[snarfed]
I guess if something overrides the utf8 default and uses a different encoding
#
[KevinMarks]
you can do that as an alternative afaik
#
[snarfed]
I-JSON, interesting
#
[snarfed]
right, ok
#
[snarfed]
deployed, granary RSS looks ok in chrome now. thanks again!
#
vladimyr
This is what you get by including ^ transform https://interconnected.org/home/feed
#
[snarfed]
I guess? granary is a developer tool, not really a user facing app/UX
#
vladimyr
Um, yes and no, depends on end user flow 🙃
#
vladimyr
They might simply leverage autodiscovery but they also might try to preview feed first and then manually copy url into their reader
#
[snarfed]
I'd take a step back and say, I'm glad some people find granary useful for generating custom feeds to put into their readers, but it's not a use case I personally plan to support or maintain too deeply
#
[snarfed]
I've found that it works better for everyone involved to make dedicated services for that instead, eg https://bluesky-atom.appspot.com/
#
vladimyr
Fair enough 👍 I also think that shoud be user agent's responsibility. IMHO Vivaldi does it right https://vivaldi.com/features/feed-reader/#productbox-2-2
#
[KevinMarks]
the usecase of someone else's posts as a feed is not supported by bluesky-atom though
#
[snarfed]
and also one I want to discourage, at least in granary, since it doesn't scale. I found that many people subscribed to hundreds or even thousands of individual twitter users' feeds via granary, so the request fanout got ugly fast
#
[KevinMarks]
ah, so that's a warning for bsky.link
#
[KevinMarks]
would it be OK to link to https://bluesky-atom.appspot.com/ if thery're looking for that usecase?
#
[snarfed]
fortunately the easy fix is to leave the following fan-in to bsky itself and use eg https://bluesky-atom.appspot.com/ to serve a single timeline feed per consuming user
#
[KevinMarks]
maybe I should send a PR to http://bsky.app to add mf2 to their static pages
Aidhan joined the channel
#
vladimyr
That fanout issue could be solved by rotating between selfhosted instances
#
vladimyr
Although I'm not quite sure how tolerant today's rss readers are when it comes to rotating feed source 🤔
#
[snarfed]
eh, the scaling itself wasn't too bad, it was more Twitter API concerns
#
vladimyr
I guess it is better for me stop that thought experiment before I accidentally step into DW's territory 🙃
#
[snarfed]
and again the mismatch between dev tool vs end user expectations. I'm fine with caching aggressively and doing other things to scale more easily in end user services like https://bluesky-atom.appspot.com/ , but those often confuse developers, so I don't necessarily want them in granray
#
vladimyr
Wonder how long will nitter last...
#
[snarfed]
it uses the unofficial graphql API, so at least the current API apocalypse won't affect it
#
[snarfed]
(if/when that ever actually happens)
#
vladimyr
I had a crazy shower thought of attaching mastodon api to nitter
#
Aidhan
curious, can you elaborate on this apocalypse?
#
vladimyr
It would be readonly ofc but in theory it could enable unified timeline in multiaccount masto clients
#
Aidhan
thanks
#
Aidhan
interesting
#
vladimyr
Technically something like that could be done for bluesky too, headless masto api to bsky api adapter running somewhere on the server
#
vladimyr
Preferably selfhosted
#
vladimyr
With r/w support
#
[KevinMarks]
Revive silo.pub for bsky and mastodon?
#
Loqi
[preview] [videah] SkyBridge: A work in progress bridge/proxy that lets you use Mastodon apps with Bluesky.
#
vladimyr
TBH I don't know what silopub is/was but I guess it's the same thing with masto api swapped with micropub?
#
vladimyr
[snarfed]: wow, exactly!
#
vladimyr
Too bad my dartlang foo is nonexistent
#
vladimyr
And https://github.com/Treeki/BirdBridge cited as inspiration that does same thing for Twitter
#
Loqi
[preview] [Treeki] BirdBridge: shoving a twitter API-shaped peg into a mastodon API-shaped hole
geoffo joined the channel
#
[snarfed]
nice! sadly the twitter api apocalypse will kill that for most people
geoffo and eitilt joined the channel
#
vladimyr
They might switch to readonly mode leveraging graphql api
#
[snarfed]
graphql API maybe, it's a huge switch from the real API though. and tweeting is still doable on the free normal API, only reads are paid
#
capjamesg
[schmarty] Thanks for reporting! I have a few outstanding tasks on mf2.link; will push a fix tomorro!
#
capjamesg
*tomorrow!
KMF joined the channel
#
capjamesg
[tantek] I'm still waiting to hear from you if you had any feature requests for mf2.link :)
#
vladimyr
capjamesg: which version of node does bsky.link run on?
#
capjamesg
The latest I believe.
#
capjamesg
Never mind.
#
capjamesg
v16.15.1
cdravcte, bret and bterry joined the channel
#
[tantek]
capjamesg I replied when you asked!
#
[tantek]
Make http://mf2.link/URL work without needing any query params by auto-detecting Mastodon profile vs permalink vs BlueSky profile vs BlueSky permalink