#indieweb 2023-02-25

2023-02-25 UTC
gRegor, jbrr[m], AramZS, geoffo, btrem, [chrisaldrich], mro and jeremycherfas joined the channel
#
[snarfed] I find it ironic, if not a bit disingenous, that the fediverse fights so hard against search engines and other centralized indexing, and yet when I spot check of a few of the biggest Mastodon instances' robots.txt files, they don't even bother to block crawlers there
#
[snarfed] https://mastodon.social/robots.txt , https://pawoo.net/robots.txt , https://mas.to/robots.txt
#
[snarfed] https://www.google.com/search?q=site:mastodon.social
mro_, mro, IWSlackGateway, gerben and chenghiz_ joined the channel
#
IWDiscordRelay <j​acky#7226> "the fediverse" isn't unified in that opinion, I'd say
#
IWDiscordRelay <j​acky#7226> but I understand what you're getting at
#
IWDiscordRelay <j​acky#7226> I've seen more people have _less_ of a problem if it's opt-in (and most, if not all, of the suggested solutions) were opt-out - the opposite of a consensual way of knowledge discovery
jeremycherfas joined the channel
#
sknebel right, and lots of people will strongly bristle against using mastodon.social as indication of anything about the fediverse :D
jeremycherfas joined the channel
#
rubenwardy There's a per-user config option for search engine indexing
#
rubenwardy personally, I don't see the difference between a general search engine and a mastodon-specific one
[aciccarello], btrem, gerben, geoffo and [snarfed] joined the channel
#
[snarfed] yup. I guess my point here is, Google Bing etc aren't even opt out, they're nowhere near the current "barely acceptable" fediverse search proposals, and yet the big Mastodon instances I've looked at don't even bother spending the five minutes to block those traditional search engines in their robots.txt files
#
[snarfed] 🤔
gRegor and [KevinMarks] joined the channel
#
[KevinMarks] the little ones are more likely to, and they often have been set up to provide safer spaces for people
geoffo and AramZS joined the channel