2023-10-29 UTC
gxt, alephalpha0, gerben, geoffo, [0x3b0b], eitilt, IWSlackGateway, kleb and rocto_ joined the channel
# 07:26 Zegnat rubenwardy: always fun to read about switching experiences!
eitilt1, sgreger and [tantek] joined the channel
# 08:20 Loqi rubenwardy has 8 karma over the last year
bjoern, Sophie, [calumryan], jkphl, Sonja and [jeremycherfas] joined the channel
dervondenbergen joined the channel
# 09:28 Saphire Oh, hmm, guess I have messed up record huh
# 09:29 Saphire Thanks, that helps
# 09:30 Saphire I'll need to chew on the dns records later
[sebsel] joined the channel
# 09:47 sknebel hah, found some ticketing code in my site that I didnt remember adding. apparently I sent some tickets to GWG at some point :D
# 10:21 sgreger Are there any opinions/precedence re respecting robots.txt when polling several thousand URLs (from my own content) to check for their existence?
[bjoern] joined the channel
# 10:23 sgreger I'm testing a link checker tool to validate outgoing links on my old content and getting a huge amount of "Access denied by robots.txt". Feels right to obey, but also renders this task almost pointless.
# 10:34 Saphire sgreger: how much of it is thanks to ad farms?
# 10:36 sknebel sgreger: I feel like a linkchecker you individually run should not respect robots.txt
oodani joined the channel
# 10:41 Saphire Robots.txt is more for automated scrapping and aggregation
# 10:42 sgreger Saphire: I concur. Presumably, most robots.txt excludes are in place to discourage other actors than genuine link verification.
# 10:42 Saphire It might be useful as a signal "that might not be a webpage you are looking for" though
# 10:42 sgreger sknebel: It's a bit of a conundrum. Technically it's a bot, but what it does is akin of me going through old links for both side's benefit.
# 10:44 sgreger This entire automated validation of link-rot is a bit of a rabbit hole, I just realize. A lot of "Schrodinger's URLs": timeouts, rate limits, potentially temporary certificate issues, HTTP200s but with totally different owners/content, etc.
# 10:50 sknebel something like "does the response still contain the title text" might be useful
# 10:54 Saphire sknebel: I suspect a lot of "has a robots txt every covering this link" is just shitty ad plugs
# 10:54 Saphire You know the kind, probably
# 11:02 sgreger This already surfaced in yesterday's link-rot session: HTTP response alone is too weak a signal to determine live/dead/zombie.
tom, nertzy and barnaby joined the channel
# 14:13 GWG Zegnat: Can I pick your brain on a question that we discussed in 2021-ish?
# 14:15 Loqi [preview] [dshanske] #127 Where does the ticket endpoint go looking for the token endpoint?
IWSlackGateway and [tantek] joined the channel
# 14:42 Zegnat I think I will need some time to read up, and I am currently with my head in a different subject at create day, so not sure I can actually give you anything smart right now
[KevinMarks] joined the channel
# 14:54 [KevinMarks] "Does the response still contain the text I quoted? " would maybe be a better test
[calumryan], eitilt and gerben joined the channel
# 16:27 Loqi Ok, I'll tell them that when I see them next
# 16:27 Loqi [preview] [tantek] #701 hidden attr for BF links
alephalpha0 joined the channel
# 16:32 GWG Zegnat: I wonder if I should link to my birthday post in my h-card.
jonnybarnes joined the channel
# 17:11 Zegnat GWG: right you can link it as you have it as a post!
geoffo joined the channel
# 18:41 GWG I'm wondering how much longer I have to support token_endpoint and authorization_endpoint, as opposed to indieauth-metadata.
# 19:11 Zegnat You can be the first to lead by example. Do it and start filing issues to places that do not support it.
# 19:11 GWG Zegnat: Leading by example is supporting it. I do
# 19:13 Zegnat It is just easier to break things if you want to file issues
# 19:14 GWG Zegnat: So, disable the old way for all WordPress sites is your suggestion?
# 19:14 sknebel You could do different endpoint urls in the two places and show a prompt if a user uses an app that does the old way
# 19:17 GWG Requires some thought, I suppose.
neceve, Xe and [jacky] joined the channel
geoffo, AramZS, angelo, nertzy and mustastum joined the channel