#dev 2025-10-09
2025-10-09 UTC
# 
[Al_Abut] Thanks for the beginner-friendly tips on scraping everybody! Looking forward to kicking the tires on a few of these suggestions.
# [morganm] Let us know how it goes 🙂 !
troojg, [benji]1, thegreekgeek_, jjuran_, GWG, vidak and CrimeWave joined the channel
# 
[artlung] Today I learned about `Set` https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Set
oodani, rosipov, bret, Saige_Leah, barnabywalters, grufwub, srazkvt, qbrack_ and [Murray] joined the channel
# 
[Murray] Theo (T3) has a good video on Set: https://www.youtube.com/watch?v=hRSwSAr-gok
grufwub and [Trevor_Morris] joined the channel
# [Trevor_Morris] What data do you store when you *receive* a webmention? The URL, a timestamp… what else?
# [Trevor_Morris] It seems there are a lot of implementations using https://webmention.io and blog posts about *sending* a WebMention, but nothing really about accepting them and storing them!
# [Murray] I use http://webmention.io to store them (no surprises there :D) but basically I'd store the same pattern that does: id (generated), type (like/mention/bookmark etc.), source URL, target URL, date/updated, content
# [Trevor_Morris] What does the WebMention plugin do? I guess Craft stores the data in a database.
qbrack, geoffo and vidak joined the channel
# [Trevor_Morris] I'm curious, then, what does http://webmtion.io do that the Craft plugin doesn't?
# [Murray] Tbc, I don't currently use the Craft plugin. I'm just aware of it, and as a form of saving webmentions outside of http://wm.io so figured I'd bring it. (If anything, the Craft plugin would work better for me, I just haven't got around to installing it; it's newer than my setup 😄 )
# [Trevor_Morris] I'm just trying to understand how http://webmention.io fits in the picture, if the end goal is them in a database in Craft… Is it missing the endpoint to post a webmention to.
# [Trevor_Morris] I am trying to work out what I need to do to support this in my PHP/Laravel/Filament system. I can build a database schema, add an API endpoint to receive mentions and set a blog post post-publish script to ping out mentions to other sites. I am wondering what I am missing.
# [Murray] I think I may have confused matters, sorry 😄 I use http://webmention.io; the Craft plugin does not. The plugin provides endpoints, data ingestion/capture/manipulation, and database config. You can check it out here (GitHub link should show you the repo): https://plugins.craftcms.com/webmention?craft5
# [Murray] For additional context, I have previously played around with using http://webmention.io alongside Craft. The way I had that configured was using the Webhooks that http://webmention.io provides, so every time the Craft server received an incoming hook, it fetched the http://wm.io data via their API, compared to saved entries and created any new Entries (basically database rows) for any previously unknown webmentions
# [Murray] This meant that, yeah, I was outsourcing the endpoints to http://webmention.io (and I was also manually sending). It wasn't a great setup, so I dropped it, and now fetch data from http://webmention.io directly during my front-end build pipeline, which is completely different to what you're trying to do 😉
# [Murray] But yeah, from a PHP perspective, that sounds like it would do everything you need: an endpoint for people to target, a post-publish script to send out webmentions, and some way to get the data from incoming mentions (which requires you to open the source page and use microformats on that page to find the content of the mention, including stuff like type)
# [Trevor_Morris] Thanks for the information. I'll have a look at that Craft plugin, especially helpful as it's PHP-based.
# [Trevor_Morris] So an incoming mention would hit *my* endpoint with the target and source URLs… then I save that data. You mentioned you save "content" and that was my next question: *what content*. You mention I have to open the source page and parse it, which makes sense. To support webmentions, do you *have* to also support microformats, then?
# [Trevor_Morris] Time to have a read of https://newsletter.ownyourweb.site/archive/issue-14/ from the author of that plugin.
ttybitnik joined the channel
# [Trevor_Morris] To start with I could just store the URLs and not parse any of the content. Future could then request those pages and populate the content – could use <title> or meta data, as well.
# [Trevor_Morris] I've just looked at https://webmention.app/ and tested one of my blog posts, where it shows two pages which support webmentions. One is James', which seems to be hosted on http://webmention.io and has your name at the bottom. https://webmention.io/jamesg.blog/webmention I like the fact it supports HTML and I guess POSTing to the URL.
thegreekgeek, [social] and [aciccarello] joined the channel
# 
[aciccarello] I played around with Octothorp harmonizers this morning and got a few of my microformats properties to parse with some issues. The documentation is lacking though so I'm not sure what all of the properties mean. https://gist.github.com/aciccarello/4eab280de8e16b37f5f2d9834affbcc1
# [aciccarello] I had to use the :not css selector to avoid some nesting
# [aciccarello] Still need to figure out the actual hashtags
# [aciccarello] Oh, I think I may have gotten it. I had the hashtags object in the wrong spot.
# [aciccarello] I tried registering with http://Octothorp.es but didn't get an email. How long did it take other people to register?
# [aciccarello] I might have to resubmit then. I submitted like 48 hours ago.
barnaby, thegreekgeek, gRegor, [lazcorp] and Saige_Leah joined the channel
# [Trevor_Morris] Progress on accepting Webmentions…
jjuran joined the channel
# [aciccarello] Oh, looks like I'm already accepted. I didn't see an email though.
jjuran joined the channel
# [aciccarello] I'll have to update my webmention sending to tag the server
sarna joined the channel
CrimeWave joined the channel
rjomara58534 and [snarfed] joined the channel
barnaby joined the channel
# [aciccarello] Non blue sky link:
# [aciccarello] Sounds like it's not an install hack. They are using the unpkg CDN since it's a "trusted" host.
yewscion__ joined the channel
# 
nsmsn Is Squarespace's Domains and DNS product entirely separate from the CMS platform and web hosting? https://domains.squarespace.com/
yewscion__ joined the channel
# [aciccarello] They bought it from Google so the legacy sites would need a way to manage the domain without a square space site
[snarfed]1, [Trevor_Morris]1, geoffo_, gRegorLove_, bret_, [Sophia_wood], troojg, sarna and Lars-Christian joined the channel