#dev 2020-06-20

2020-06-20 UTC
KartikPrabhu joined the channel
#
[tantek]
re: lazy loading images, pretty sure release Firefox an Chrome both support it, good enough to use right?
#
[tantek]
Does anyone have experience or software or a service that (politely) crawls Internet Archive for a MediaWiki install and creates static HTML pages for it? E.g. https://web.archive.org/web/20200514144501/http://heroeswiki.com/Main_Page
jjuran, [chrisaldrich] and [KevinMarks] joined the channel
#
[KevinMarks]
Spiderpig maybe? It depends on there being a link chain from the homepage
#
[KevinMarks]
My fork looks at archive.org, but it proxying through mention.tech because I already had that working.
#
aaronpk
I spiderpig'd my own mediawiki before i shut it down. I've never tried running it on an archive.org URL
#
[tantek]
Yeah just coincidence that I decided to rewatch the series a mere 2 weeks after the site shutdown 😕
#
[tantek]
I figure an archive.org crawl may require more gentle crawling
#
[tantek]
or maybe they have an API to explicitly retrieve archive data? like in WAF format?
#
[tantek]
[KevinMarks], does spiderpig have a commit to github option where you give it a repo and it commits the static files?
#
aaronpk
that would just be `git commit -a` or something after it's done
#
[tantek]
"just" and a command line don't belong in the same sentence 🤣
#
[tantek]
(omits context of directory, presumption of existing git check out etc. etc.)
#
[tantek]
that does bring up another curious option, a locally browseable version, does spiderpig have an option to turn all pages into .html versions and turn all internal links to their .html versions so you can literally double-click one of the files locally and the click and browse locally from there?
#
aaronpk
i just mean they are completely different problemsand likely should not be combined into a single tool
#
aaronpk
and yes that is what spiderpig does
geoffo joined the channel
#
@kixiQu
↩️ and then I start looking at the options that support webmentions, and... I resent static site generators when I start being unable to understand the templating logic and am afraid of how quickly that might start (given very little FE experience)
(twitter.com/_/status/1274144382677999616)
#
@kixiQu
↩️ like, I love writefreely because you can just blog and go, right? but I felt like replying using webmentions to someone, and that isn't supported yet. so I think, hey, you know, an excuse to buy another domain, i'll take it
(twitter.com/_/status/1274144381864275968)
#
aaronpk
that's confusing
#
aaronpk
good luck getting a static site to work with activitypub at all
#
aaronpk
but yes "go sign up for a service" is generally going to be a better experience than setting up a static site
#
@kixiQu
why is the #indieweb so hard the activitypub world seems so simple relatively
(twitter.com/_/status/1274144381067423749)
#
jacky
to be fair
#
jacky
I want to "fix" that gap (the zero to commenting thread thing) for Webmentions
#
aaronpk
i mean micro.blog and pine.blog are already two great options
#
jacky
agreed!
#
jacky
I'm looking to be the "disqus" of that space
#
jacky
which, tbh, is hard as hell lol
#
aaronpk
eww don't say that word
[schmarty] joined the channel
#
[tantek]
goes to do some homework reading on spiderpig
#
vilhalmer
I attempted to implement AP statically
#
vilhalmer
you can show up in the fediverse, but that's about it
#
vilhalmer
I still get scanned regularly, I think there's no escape
#
[tantek]
is there a minimum set of redirect rules to make all the ".well-known" crap "work" without duplicating information?
#
vilhalmer
I got it to work with an nginx rewrite to convert the query string into a path
#
vilhalmer
and a symlink on disk to forward escaped to non-escaped
#
vilhalmer
because I was seeing requests to both
#
vilhalmer
for a while I had a very minimal inbox saving json blobs to disk but it's off at the moment
#
vilhalmer
it was only collecting deletes
#
vilhalmer
will get back to it someday, probably
#
[tantek]
I don't even want to serve metacrap JSON
#
vilhalmer
websub is more urgent
#
[tantek]
is there something that converts an h-card to the metacrap JSON that it wants?
#
vilhalmer
that's on my todo list :)
#
[tantek]
nice vilahalmer++
#
Loqi
vilahalmer has 1 karma over the last year
#
vilhalmer
the canonical form of my site will be html at all costs
#
[tantek]
vilhalmer++
#
Loqi
vilhalmer has 1 karma in this channel over the last year (4 in all channels)
#
[tantek]
s/all costs/minimum viable costs
#
vilhalmer
I just have so many projects
#
vilhalmer
I need to get more invested in my site so I have more reason to work on it
#
vilhalmer
now that I have indieauth working I'm getting closer to it being critical infrastructure
#
vilhalmer
I think I even wrote some code to generate AP… where the heck did I put it
#
[tantek]
aaronpk, by "Query strings are ignored completely" do you mean spiderpig does *not* crawl links with query strings?
#
vilhalmer
aha, I did! it can already generate a minimal Create activity
#
vilhalmer
I'm trying to keep it split up so it could be triggered by i.e. a git post-receive hook
#
vilhalmer
instead of needing a daemon
#
vilhalmer
not static, but close
#
[tantek]
aaronpk, would you accept documentation improvement pull requests to spiderpig?
#
aaronpk
Yes please!
#
aaronpk
IIRC by "ignored" it will not use the query string to determine the filename on disk
#
aaronpk
vilhalmer: I am impressed you got that far with activitypub
#
[tantek]
uh so query string URLs are still crawled? but might overwrite files without the query string?
#
[tantek]
still confused about how a link to a URL with a query string is treated.
#
[tantek]
is it crawled or isn't it?
KartikPrabhu and [snarfed] joined the channel
#
[snarfed]
[tantek] you might also try `wget --mirror` and compare. aaronpk did a good job of describing the differences, but none seem like dealbreakers per se
#
[tantek]
nah I like the explicit usability decisions that aaronpk made with spiderpig
#
[tantek]
I'm just trying to understand what happens with query string links 😂
zootella, nickodd, mattl, myfreeweb, jimpick, geoffo and jjuran joined the channel
#
@rrrrrrrix
↩️ I think, FWIW you might be able to forge webmentions, it's "just" an html POST with a source and destination attribute. this is what i do on my website, its an elisp. @jackyalcine has been talking about building more composable indieweb services, i think?
(twitter.com/_/status/1274199414148493312)
KartikPrabhu and [LewisCowles] joined the channel
#
[LewisCowles]
wget --mirror is not good for archive.org anyway. Wound up downloading an old site recently from archive.org. There are people who have made commercial tools to do the download, but essentially you want to stay within the same frame of time, I've not found anything good
#
Loqi
wget has -1 karma over the last year
#
[LewisCowles]
it's archive that has a problematic model
#
[LewisCowles]
and they also don't need to lose karma
#
vilhalmer
slack workaround bug?
#
[LewisCowles]
I wouldn't mind those characters had a word attached
#
vilhalmer
our work bot used to support precrement karma but we had to disable it because we paste cli commands too often :D
#
[LewisCowles]
they should not have done that
#
[LewisCowles]
I've always been against bots and this has shown me why
#
[LewisCowles]
it's all fun and games until someone harms wget karma
#
Loqi
vilhalmer: lol
#
vilhalmer
see, bots are good
#
vilhalmer
pats Loqi
#
[LewisCowles]
Loqi is brick from anchorman
#
[tantek]
gives loqi a crumb
#
Loqi
grabs the crumb
#
vilhalmer
!botsnack
#
vilhalmer
what are breadcrumbs
#
Loqi
It looks like we don't have a page for "breadcrumbs" yet. Would you like to create it? (Or just say "breadcrumbs is ____", a sentence describing the term)
#
jacky
breadcrumbs are /crumbs
#
vilhalmer
what happens if I click that loqi link after its created
#
vilhalmer
oh nice
#
jacky
clicks to find out
#
jacky
ah it's the edit page
#
vilhalmer
Loqi is probably the most useful bot I've interacted with
#
vilhalmer
arch's phrik is the most amusing
shrysr, KartikPrabhu, treora, jjuran, leg, DanC, gRegorLove, moppy, [fluffy], wombelix, [KevinMarks], [LewisCowles] and jeremycherfas joined the channel
#
Guest68597
I can't find anything either way, so is it generally a good idea for accessibility to add `alt="description"` to a `<video>` tag?
#
Guest68597
Darn it, I am Spartacus.
#
jeremycherfas
Thank you.
gRegorLove and [jgmac1106] joined the channel
#
[jgmac1106]
!tell snarfed...too soon for a Bridgy audio tweet issue?
tinfoil-hat, [LewisCowles], [KevinMarks], nickodd and sknebel_ joined the channel
#
@steveivy
TFW you’re teetering on the edge between using the #microformats library to find h-cards and their properties and writing an entirely new wrapper to make finding #webmention comments “easy” (monkinetic txt-1ad3454)
(twitter.com/_/status/1274371684930187266)
[KevinMarks] joined the channel
#
@aaronpk
↩️ This is exactly the reason for OAuth, which moves the two-factor auth problem away from the app developer and into the account provider. IndieAuth is a way to do OAuth for independent sites like WordPress.
(twitter.com/_/status/1274374991400714242)
[jeremycherfas] and [snarfed] joined the channel
#
[snarfed]
[jgmac1106] never too early! feel free to file one
#
[snarfed]
two key questions to answer in the issue: 1) are they definitely shipping it officially, to everyone? or is it still just an "experiment?" and 2) is there API support yet?
#
[jgmac1106]
2) prolly not and never...good point
[tw2113] and [tantek] joined the channel
#
[tantek]
When are we renaming the Apache web server and foundation? Prime example of cultural appropriation by primarily white and male open source people
#
Loqi
what
#
[jgmac1106]
He is right Loqi
nickodd left the channel
#
aaronpk
oh gosh
#
vilhalmer
and all for a pun
geoffo, [manton], nekr0z, vsasvipul and [LewisCowles] joined the channel
deathrow1 joined the channel
#
Loqi
[non-binary] #660 Change LICENSE
#
[LewisCowles]
General guess to tantek (likely rhetorical joke) is that it may not be any time soon
[tantek] joined the channel
#
[tantek]
Oh yes change the name of the Apache license too
#
[tantek]
[LewisCowles] soon or not, it’s worth raising the issue and having the uncomfortable conversations until it gets changed. Undoing cultural appropriations like that is perhaps one small part of dismantling white supremacy
#
aaronpk
i was surprised to see that was a very well researched and non-flammatory github thread
[fluffy] and gxt joined the channel