#dev 2023-11-05

2023-11-05 UTC
miklb joined the channel
IWSlackGateway, [aaronpk], [jacky], [KevinMarks], [schmarty], [fluffy], miklb, tbbrown, [snarfed], gRegor, gerben and [tantek] joined the channel
#
[tantek]
link-preview << simple design example of preview image showing some text content of the preview: https://jakelazaroff.com/words/web-components-will-outlive-your-javascript-framework/
#
Loqi
ok, I added "simple design example of preview image showing some text content of the preview: https://jakelazaroff.com/words/web-components-will-outlive-your-javascript-framework/" to the "See Also" section of /link-preview https://indieweb.org/wiki/index.php?diff=90399&oldid=89135
#
[tantek]
what is a preview card
#
Loqi
It looks like we don't have a page for "preview card" yet. Would you like to create it? (Or just say "preview card is ____", a sentence describing the term)
#
[tantek]
preview card is /link-preview
gRegor, gRegorLove_, sebbu, geoffo, [pfefferle], neceve, barnaby, barnabywalters and [KevinMarks] joined the channel
#
aaronpk
well this sucks, apparently webmention.io hasn't been able to store emoji in webmentions since about august, which is ironically when I pushed out a fix to make it accept emoji in URLs
#
aaronpk
or maybe they are stored correctly but not getting retrieved correctly??
#
aaronpk
i am storing the content as a blob type in the DB, which I thought would avoid all this charset nonsense
barnaby and barnabywalters joined the channel
#
[schmarty]
charset--
#
Loqi
charset has -1 karma over the last year
geoffo, barnaby and [jacky] joined the channel
#
[jacky]
[fluffy] https://garagehq.deuxfleurs.fr/documentation/design/goals/ for self hosting files though this still requires setup
#
[fluffy]
Thanks. I’m not clear on what exactly they’re offering though, and it looks like you still need to be savvy enough with AWS to set up your own S3 storage or the like? What I’m looking for is a service which does all that for you and is just a simple “drag and drop files here, we charge you a bulk storage rate” thing.
#
[fluffy]
like think of the old-fashioned `~/public_html` directories that ISPs used to offer, but as a separate paid service.
#
[fluffy]
(but cheaper because it’s just static files, no PHP or whatever)
#
[fluffy]
y’know. `public_html` for the serverless era.
#
[fluffy]
the fact garage starts out with “here’s how to deploy a single-node server for your usage” means it’s not that.
AramZS joined the channel
#
[fluffy]
The whole point to this exercise is I’m trying to find out where to point people to for simple static file hosting, when they have no interest in running (or paying for) a server or learning how to set up cloudfront or whatever, without me becoming the pillar of the community by running such a thing for others. I don’t want to be responsible for keeping other peoples’ files alive.
#
Zegnat
Scanning through it, it looks like garage is what you can run if you want to run S3-like buckets on your own server. But still means all the admintax for buckets exists
#
Zegnat
I really like https://neocities.org/ as a "public_html" system.
#
[fluffy]
yeah, unfortunately they limit the kinds of content you can upload :(
#
[fluffy]
my specific use case is for people to be able to host their Bandcrash players, which means HTML + MP3 files.
#
[fluffy]
to be embedded by an <iframe>
#
[fluffy]
Where this specifically came up was on one of my music production Discords, a few people were like “I’d love to use this but I use Wix” and looking into it Wix doesn’t let you just upload a content directory to get passively iframed either.
#
[fluffy]
For now my top recommendation has been to just use http://itch.io as the content store (which is also convenient with Bandcrash, which already directly supports itch’s upload tool) and then using itch’s iframe embedder, which adds a little itch branding but is otherwise free.
#
[fluffy]
Which also has some other advantages, like, hey, now they also have instant “buy this album” functionality.
#
Zegnat
Mm, yeah, I would not off-hand know of a good place to store mp3 files. But I will keep it in mind in case I run into something
#
[fluffy]
Yeah, specifically it needs to be able to store mp3+html+js+css, in a single directory with good old-fashioned relative path addressing.
#
[fluffy]
which is to say, a `public_html` directory :P
#
[fluffy]
AWS Cloudfront would be perfect if it weren’t for the rather challenging initial setup and the lack of built-in web-based upload tooling. People shouldn’t have to learn to be a backend web developer to post their music online.
#
Zegnat
Yeah, AWS is not for that, IMO
#
[fluffy]
(or their static websites)
#
Zegnat
I am not sure if it has been made easier to host flat files on backblaze now. Been a few years since I looked into that.
#
[fluffy]
another recommendation that keeps coming up is Github Pages but there you have a pretty strict storage limit and they highly prioritize using Jekyll for the build, which again gets into “become developer” territory
#
[KevinMarks]
I have use http://archive.org, but that needs you to pick a CC license, which is OK for podcasts but trickier for music
#
[fluffy]
yeah but also http://archive.org doesn’t fit the use case of hosting a bandcrash player, there it’s just like, you’re stuck with http://archive.org’s player which, frankly, sucks. and also isn’t iframe-embeddable I don’t think?
#
Zegnat
Backblaze used to have the whole "free bandwidth" between them and Cloudflare, so you signed up at Cloudflare, pointed it at the address for your B2 storage, and tada: file server. But I would have to look at it again to see if that is still an option these days. And not sure how _easy_ it actually was to setup
#
[fluffy]
yeah cloudflare CDN would be a reasonable choice if it weren’t for their politics making it a non-starter for a lot of people
#
[KevinMarks]
Archive is hot linkable so you can use <audio> tags or point a player at mp3 urls
#
[fluffy]
right but then you still need to host the player somewhere, and also you need to know how to configure the player to use http://archive.org URLs
#
[fluffy]
the point to bandcrash is that it generates a fully self-contained directory you can just plop somewhere
#
[KevinMarks]
Yeah, it's annoying. I wish html had a declarative <playlist> but last time they tried it became SMIL which was too messy
#
[fluffy]
yeah having proper playlist support in html5 would also be nice but I don’t see how that solves anything other than making parts of the player simpler
#
[KevinMarks]
Funnily enough thanks to HLS there's a lot of built-in support for m3u8, but the tooling is still a pain
#
[fluffy]
like there’s still an HTML file that references it all and needs to know how to link to the files etc.
barnaby joined the channel
#
sknebel
I guess in many cases you could probabl get away with random web hosting (all packages I've seen recently have some kind of web uploader), but technically using it primarily to embed in other sites is probably against the TOS in most cases :/
#
sknebel
even if you put up an alibi "these are my albums" overview homepage
#
[fluffy]
yeah, but also random web hosting tends to be (relatively) expensive and offers things other than static file hosting, which has more downsides like, oh, now you have to worry about CPU contention and overselling
#
[fluffy]
which isn’t a nonissue on static hosting stuff but it’s less of one
#
[fluffy]
like the CDN-with-object-storage approach means you have very lightweight fronting stuff that’s easily distributed and conceivably is able to charge a very cheap bulk storage+bandwidth rate, like most musicians’ stuff stored/served by cloudfront+S3 would cost less than 5 cents a month
#
[fluffy]
and wouldn’t go down or turn into a malware site because someone’s wordpress blog got hacked
#
sknebel
putting a static page on a normal webhosting package also doesnt get hacked easily. and the rest, yeah, its a tradeoff. but traditional webhosting is the "make it easy to put up some files without dev stuff" product category
#
[fluffy]
most musicians I know who aren’t webhosting savvy would probably be fine with like, oh $1/year for forever storage of my album files? that I can just drag-and-drop to upload? Amazing!
#
Zegnat
Backblaze B2 seems to still give you the first 10GB of storage for free. So it might be interesting to check out their public buckets. They have a bunch of ways to do uploads IIRC. I am just not sure what the links will look like without putting a CDN infront. Would require testing.
#
[fluffy]
does B2 have a no-tools method of uploading? I thought everything still was going through an inscrutable API with nerdy commandline tools
#
sknebel
I guess since you have the generator frontend you could put support for S3-style uploads into that too
#
[fluffy]
Yeah but I don’t want to have to deal with the myriad of object storage things or dealing with API keys or whatever
#
Zegnat
I believe B2 has always had an in-browser upload, where you browse the files you have
#
[fluffy]
for the http://itch.io case I outsource it to their own butler tool which is easy enough to connect to
#
[fluffy]
hm, I’ll have to look again then. I use B2 for my NAS backup, but last I was aware, while downloading is easy from the web, I didn’t find any easy upload thing
#
[fluffy]
okay I must have missed that
#
Zegnat
I think I have previously used Cyberduck to just drag and drop files to B2
#
[fluffy]
Ooh, I haven’t heard of that tool. That might be worth looking into then, thanks
#
Zegnat
Works for S3 too
#
[fluffy]
if the B2 public bucket API is anything like S3’s then it *should* be fine for the actual hosting side of things, although B2 really wants to be behind a CDN since it’s not really intended for direct file serving, IIRC
#
Zegnat
Yes, when I looked at it a couple years ago they had a lot of focus on putting Cloudfront in front of it. But I do not think that is actually necessary? Unless you want specific things like custom domain names.
#
[fluffy]
oh and yeah that screenshot is from their “serve your files using Cloudflare CDN” page, which is nice if you’re not opposed to Cloudflare
#
Zegnat
And even then, you could probably use any CDN?
#
[fluffy]
yeah it’s just that the CDNs I’ve looked into that aren’t Cloudflare tend to get expensive (both in terms of money and admin tax) due to high monthly minimums since they’re targeting enterprise customers.
#
[fluffy]
ah, bunny is a CDN that’s come up in these conversations a lot too. I think they have a $1/month minimum which is still a lot for this use case (considering the bulk rates of what it actually costs the providers) but that’s much easier to swallow.
[Caleb_Hearth] joined the channel
#
Zegnat
I just happen to know of Bunny because I have looked into them for work, as they are EU based. There might be simpler / cheaper ones.
#
[fluffy]
so far I haven’t seen anyone simpler or cheaper than Bunny, except Cloudflare, which is again, politically charged for a lot of folks.
#
Zegnat
It is also not 100% clear to me if B2 forces you to put a CDN in front of it, or if that would only be the case if you want to move on to your own domain. At that point, it might be worth the $12/month charge as sort of a "branding" cost?
#
Zegnat
sSorry 12/year
#
[fluffy]
I am pretty sure nobody cares about the branding of their iframe backing storage :P
#
[fluffy]
at least nobody in the space I’m targeting
#
[fluffy]
I should experiment with B2 since I already have an account for other purposes.
#
Zegnat
Then they might not even need the CDN in front of B2? Guess it depends on how much download data B2 is willing to give you for free
#
[fluffy]
I hadn’t considered using them in a CDN-less way because of the supposed performance issues with it but yeah it might be fine
#
Zegnat
An a completely different note: has anyone here consumed YouTube Atom feeds? I am wondering if there is a way to instruct YT in the URL to give me a specific locale
barnaby joined the channel
#
Zegnat
Works for me
#
[fluffy]
Doesn’t look like there’s a way to have it map the directory itself to index.html but that’s not a big deal
#
Zegnat
Blob storage thing, probably does not actually do a "directory" that way *shrug*
#
Zegnat
What you really need to figure out is if you end up getting charged for download everytime someone plays one of the mp3 files.
#
Zegnat
Or if download up to some amount is straight up free.
#
[fluffy]
yeah pricing is definitely a concern on this 😕
#
Zegnat
(One of the things about the Cloudflare set-up was their bandwidth alliance thing, where you explicitly never got charged for download.)
#
Zegnat
From the sign-up page, first 10GB of B2 are free? So unless you do some really fancy uncompressed music, you can put a bunch of MP3 files up for free.
#
[fluffy]
right and also the point to a CDN is to frontload the transfer onto edge nodes that can keep the files “hot” in a place where bandwidth is cheaper to begin with, so even if you do have to pay initial transfer out of the object store you don’t have to pay it very often
#
[fluffy]
yeah the storage is definitely feasible for most, and their bulk rate after the 10GB minimum is also lovely. transfer is the concern here.
#
[fluffy]
looks like egress is “free*” but that’s one big asterisk
#
[fluffy]
and in particular the limit is just 3x your storage size, which means only three people can listen to the album in a month 😛
#
[fluffy]
I’m not finding what the overage egress rate is, or what happens if you go over
#
[fluffy]
they don’t have any direct pricing for egress and their pricing calculator assumes multiple TB per month, but reading between the lines it looks like they charge $72/TB/year for storage and $84/TB/year for egress, which is absolutely fine.
#
[fluffy]
yeah this looks like a great approach, I’ll definitely document this for Bandcrash. Thanks zegnat++
#
Loqi
zegnat has 5 karma in this channel over the last year (15 in all channels)
#
Zegnat
Nice!
#
Zegnat
When I looked at them a couple years ago it was to have a place to put materials for D&D. Which felt like a close enough use-case to yours, it was just the public_html :P
tbbrown joined the channel
angelo, geoffo and barnaby joined the channel
#
[fluffy]
Anyway I’ve documented the use of B2 at https://bandcrash.readthedocs.io/en/latest/player.html although those instructions should probably go into their own page.
barnaby, barnabywalters, geoffo, CRISPR, gRegorLove_ and [catgirlinspace] joined the channel
#
[catgirlinspace]
any ideas why searching https://catgirlin.space/activity/b2c1370865c396ac923565d156312606/ on mastodon and stuff won’t bring it up? i have the little link tag bridgy docs mention.
#
Loqi
[preview] [rosalinya] meow meow meowww need to work on the next blog post. am bad at writing tho.
#
sknebel
[catgirlinspace]: works for me on chaos.social
#
[catgirlinspace]
hm, firefish didn’t bring it up. both http://indieweb.social and mastosoc didn’t but not authenticated there
#
[catgirlinspace]
so if it’s just a firefish thing?
#
sknebel
possible I guess, not sure how the interop with bridgy fed is there
#
sknebel
and yeah I think if you are not logged in they dont let you load additional posts, only look at ones the server knows
barnaby joined the channel
#
[catgirlinspace]
ah, that’d make sense
geoffo and [Joe_Crawford] joined the channel