#dev 2025-10-23

2025-10-23 UTC
Xe_ and luca joined the channel
#
carrvo aaronpk++
#
Loqi aaronpk has 50 karma in this channel over the last year (130 in all channels)
#
carrvo I did the Non-standard Webmentions! Receive Non-Standard Webmentions · Issue #20 · carrvo/SVNmentions https://github.com/carrvo/SVNmentions/issues/20
#
Loqi [preview] [carrvo] #20 Receive Non-Standard Webmentions
#
carrvo Haven't deployed it yet...
thegreekgeek_, Xe, DanQ, barnaby, geoffo_, srazkvt, qbrack_, geoffo, grufwub, claudinec, sp1ff`` and [capjamesg] joined the channel
#
Loqi carrvo has 13 karma in this channel over the last year (16 in all channels)
#
[capjamesg] carrvo++ nice!
Guest6, Pixi` and thegreekgeek__ joined the channel
#
IWDiscord <j​bcrn>
#
jbcrn I have implemented support for client ID metadata for KcIA, now next up is to implement IndieAuth server metadata
#
jbcrn but I might rewrite some part of it because currently it just checks to a link tag if it's not a OAuth Client Metadata document, and doesn't check the header
#
jbcrn also I added a callback to KcIA as some apps don't like that Keycloak directly goes to the client (e.g. iss doesn't match), so now the flow is client > KcIA > Keycloak > back to KcIA > then goes to client
[Murray] joined the channel
#
[Murray] I'm aware of the noindex and robots pages on the Wiki, but does anyone have a good ELI5 tutorial on how to make a website that is never indexed by search engines, but can be indexed by the Internet Archive? (Also, preferably not LLM crawlers, though I've given up hope on that front)
#
[Murray] I'd be very happy with a way to block all bots, if I could then manually submit it to IA as well
thegreekgeek_ and oodani joined the channel
#
[artlung] `User-agent: archive.org_bot`
#
[artlung] `Disallow:`
#
[artlung] `User-agent: *`
#
[artlung] `Disallow: /`
#
[artlung] that sounds like roughly what you want. though robots.txt is guidance not enforced.
#
[artlung] what is large language model traffic?
#
Loqi Large language model traffic refers to web requests made by LLM operators to ingest data for use in training AI models, or to answer user queries in "search" mode (i.e https://indieweb.org/large_language_model_traffic
#
[artlung] that page has some tools strategies for dealing with llm traffic. the Content-Signals standard is an interesting one, but does not account for your specific case
DanQ, vidak, DanQ1, gRegor, [me1850], albuic, peterkaminski, jonnybarnes, duanin2, [morganm]3, peterkaminski1, thegreekgeek__, chimo_, Tiffnya, opencircuit_, bterry2, CrimeWave and [Al_Abut] joined the channel
#
[Murray] Yeah, I'm not all that fussed about LLMs. I'm most concerned with (preventing) search engine indexing. Will take a look over, thanks 🙂