#indieweb 2017-02-14

2017-02-14 UTC
danohu and wolftune joined the channel
#
GWG I have a parsing question for people parsing html from untrusted websites for webmentions and such.
#
GWG Do you sanitize before or after you parse?
#
aaronpk what would you sanitize before?
#
GWG I'm looking at WordPress's Press This code, and they filter out most elements and attributes before they attempt to press.
#
aaronpk i don't know what you mean by "press" as a verb
#
GWG parse, excuse me
#
aaronpk what is Press This?
#
Loqi https://indieweb.org/Press_This
#
aaronpk i'm not sure I follow. in order to filter things out, that's part of parsing
#
aaronpk in general, the mf2 parsing process removes most "junk" from the HTML anyway. you're only left with needing to worry about HTML in values such as the "content" property
#
GWG They are filtering out pretty much all classes, which means they are making the content unusable for microformats parsing.
#
aaronpk i remove all classes *except* microformats classes for any HTML values
#
tantek it's a good thing mf2 classes have a specific pattern!
#
GWG Yes. But I'm looking at there is no way to hook in before they do. I'm wondering if I can propose they support specific classes in their filter or suggest they move where they filter to later so I could get the unfiltered version and avoid having to rerequest it
#
aaronpk GWG: you could definitely suggest not removing the mf2 classes. Basically classes that start with h- u- p- e- dt-
#
KartikPrabhu one also needs to sanitise URLs
#
aaronpk here's my HTMLPurifier plugin for it: https://github.com/aaronpk/XRay/blob/master/lib/Formats/HTMLPurifier_AttrDef_HTML_Microformats2.php#L32
#
GWG aaronpk: WordPress uses kses. I have to see if they support wildcards
#
aaronpk (tantek if you have a better recommended regex for matching mf2 classes feel free to file an issue there)
#
GWG aaronpk: I read your code on this. Still have to see if I can actually do that in kses.
#
aaronpk wow wordpress just wrote its own sanitizer? that's risky
#
KartikPrabhu u-url can have javascript hidden in it
#
GWG aaronpk: Just? It's been there for ages
#
GWG https://github.com/WordPress/WordPress/blob/master/wp-includes/kses.php
#
aaronpk s/just //
#
aaronpk KartikPrabhu: heh looks like I already covered that case with XRay. the parser itself of course allows whatever: http://pin13.net/mf2/?id=20170214005200084
#
KartikPrabhu right, parse mf2 first but then sanitise before using/storing
#
GWG That seems easier than trying to teach kses about microformats.
snarfed joined the channel
#
aaronpk GWG: i think you'd add a new block in this function to filter the specific class names similar to how it allows only certain inline style attributes https://core.trac.wordpress.org/browser/tags/4.5.3/src/wp-includes/kses.php#L866
nitot joined the channel
#
GWG aaronpk: I think I'll go with parsing before they remove all the stuff I'm trying to parse, then santiizing. Getting them to change kses is going to be hard, but I might suggest it.
#
aaronpk if you can parse before they remove stuff that's probably easier
#
GWG Trying to think long and short term
squeakytoy joined the channel
#
miklb GWG isn't there IndieWeb versions of the pressthis?
#
GWG miklb: I'm going farther.
#
miklb GWG gotcha
#
GWG miklb: I'm spinning out the code I was working on in Post Kinds
#
GWG I have a Trac ticket for spinning out the Press This parsing code to be used outside of Press This for embeds and other things.
#
miklb cool
#
GWG If properly hooked, it could allow for microformats support without built in core parsing
#
GWG So I figured why not do proof of concept inside Post Kinds before I try a patch.
#
miklb ?
tantek joined the channel
#
gRegorLove What is Press This?
#
Loqi Press This is the WordPress bookmarklet for quickly publishing text, images, or video https://indieweb.org/Press_This
#
gRegorLove Feel free to expand, espeically if there's indieweb versions ^
tolerablyjake joined the channel
#
GWG I am just splitting off the parsing functions into something I call 'Parse This'
wolftune joined the channel
#
GWG Adding in some of my enhancements.
snarfed, wolftune, kerozene, leg and tantek joined the channel
#
@100daysindieweb Day 55: Showing the Raw Request in https://Micropub.rocks/ #100DaysOfIndieWeb: https://aaronparecki.com/2017/02/13/20/day-55-micropub-rocks https://twitter.com/100daysindieweb/status/831364424686460928/photo/1 (twitter.com/_/status/831364424686460928)
tantek, techlifeweb, snarfed, gRegorLove and wolftune joined the channel
#
acegiak morning, all
nitot joined the channel
#
acegiak anyone pondered code to allow arbitrary ZWJ emoji codes on their site?
#
KartikPrabhu what is ZWJ emoji?
#
Loqi It looks like we don't have a page for "ZWJ emoji" yet. Would you like to create it?
#
sknebel I'd assume most people "allow them" by not filtering the zero-width joiner out explicitly, so they just work?
cjk101010 joined the channel
#
sknebel I guess code that tries to identify if something is a single emoji has to deal with it explicitly, e.g. for Reacji
cweiske, cjk101010, nitot, jeremycherfas and acegiak joined the channel
#
Zegnat acegiak: I just allow arbitrary unicode. But my website only displays content I write so I don't have to filter for trickery.
danohu, tantek, friedcell, KevinMarks, Pierre-O and jihaisse joined the channel
#
petermolnar Press_This <<< https://petermolnar.net/press-this-indieweb/
#
Loqi Extending Press This in WordPress to support indieweb reply, like and repost
#
petermolnar hm
#
petermolnar seems like I forgot the syntax
[kevinmarks] joined the channel
#
sebsel it's two < :)
#
petermolnar oh. <<< is bash. thanks :)
#
petermolnar Press_This << https://petermolnar.net/press-this-indieweb/
#
Loqi ok, I added "https://petermolnar.net/press-this-indieweb/" to the "See Also" section of /Press This
#
Loqi Extending Press This in WordPress to support indieweb reply, like and repost
#
petermolnar there, thank you
KevinMarks, danohu, nitot, jeremycherfas, friedcell, jeremycherfas_, sandro_, Garbee, hs0ucy, mlncn, leg, techlifeweb, singpolyma, Jammy_Stuff, emceeaich, Pierre-O, mbrock and [cdevroe] joined the channel
#
[cdevroe] Is Indieweb fatigue a thing? I believe I may have it.
#
aaronpk aww haha
#
aaronpk what's that?
#
Loqi aaronpk: lol
#
[cdevroe] Trying to connect my blog to everything has become rather exhausting and I’m questioning the value of the effort at all. May just resort to posting to my site and having an RSS feed (like the good old days) and scrapping the idea of my blog being connected to everything.
#
aaronpk what do you mean "connected to everything"?
hs0ucy joined the channel
#
[cdevroe] Mostly showing likes, favorites, retweets, comments, etc from social media _back_ on my site. And, trying to get Bridgy and Bridgy Publish to post the way I would want to post on social media when I post to my site.
#
[cdevroe] And the thought of building all of that myself is daunting.
#
aaronpk aha
#
aaronpk yes it's a lot to build for sure!
#
aaronpk the nice thing is if you build support for getting likes/comments from other indieweb sites, then you can get them from social media sites without any extra work thanks to bridgy
#
[cdevroe] And then I begin to question the “why” of it all. There is a good chance Twitter is going to be gone within 10 years and so I wonder if I would want all of these links to tweets for nothing?
#
[cdevroe] What I really want is all of my data in one place; my blog.
#
[cdevroe] If people want to learn RSS and subscribe, good. If not, that is there prerogative.
#
aaronpk and similarly for publishing, if you make sure your posts appear well in indieweb readers and as comments on other peoples' indieweb sites, then bridgy publish pretty much works without extra work
#
[cdevroe] That isn’t necessarily true. I haven’t found Bridgy Publish to work very well at all.
#
[cdevroe] Which is why I considered building everything myself.
#
aaronpk have you tested how well your posts appear in readers or as comments outside of bridgy?
#
[cdevroe] I’m unsure what you mean when you say “as comments”?
#
aaronpk have you tried commenting on one of my posts for example
#
[cdevroe] I do not think so.
#
aaronpk (or if you want a place you can flood with comments for testing, try to get a comment to appear here https://webmention.rocks/test/1)
#
sebsel [cdevroe] I use Bridgy all the time. It's what aaronpk said: focus on Indieweb things first, then Bridgy will understand your site and work with it
#
Loqi [Webmention Rocks!] Discovery Test #1
#
aaronpk great example on that page actually. there's something wrong with the markup on the techlifeweb.com post so it looks bad as a comment. that would also throw off bridgy publish.
singpolyma joined the channel
#
[cdevroe] aaronpk Do you mean webmention?
#
aaronpk webmention is the underlying functionality yes, but the end result is your post appears as a comment on other indieweb sites
#
[cdevroe] I believe I have that working, yes.
#
[cdevroe] My site has shown up on many other sites as comments via webmention
#
[cdevroe] Sorry to dump in here, but that is just how I’m feeling… the “why” of it all.
#
aaronpk understandable
#
[cdevroe] Esp. if these silos go away. Then I’ll have so much clean up to do.
#
aaronpk for me, i want to still talk with my friends who are only on twitter/facebook, so that's why I publish there even if those networks might not be around 10 years from now
#
[cdevroe] I likely won’t outlive Facebook but I think there is a good chance I’ll outlive Twitter.
#
sebsel [cdevroe] what is there to clean up? you have your site and that's that right?
#
[cdevroe] aaronpk I have that pull too… the networks are drugs man, drugs.
#
aaronpk i've syndicated a bunch of posts to app.net and received replies from there, and we know how that went. i don't really mind that there will be abandoned links from old posts on my site
#
aaronpk if by "drugs" you mean "human connection" then yes :)
#
[cdevroe] Like, why in the world post to Instagram? Because likes!! It is like heroin. But I believe it might be time for me to wean myself.
#
[cdevroe] aaronpk I do, yes.
#
[cdevroe] Maybe it isn’t indieweb fatigue I’m feeling. Maybe it is social media fatigue.
#
aaronpk there are some people who i would just not talk to anymore if it weren't for the internet, and it's nice being able to still share things and talk with them even if it's only online
#
aaronpk but yes if you are feeling like you aren't getting value out of using a particular silo, then stop using it
#
jeremycherfas Aaronpk: how long does it normally take for things to show up on webmention.rocks?
#
aaronpk jeremycherfas: should be instant
#
[cdevroe] questions life at all and walks into a meadow
#
aaronpk like actually instant :) you'll see your post appear there without a page refresh
#
jeremycherfas Then my Known install is failing.
#
jeremycherfas Aaronpk Page source contains <a href="https://webmention.rocks/test/1" rel="in-reply-to"
#
jeremycherfas class="u-in-reply-to">a post on
#
Loqi [Webmention Rocks!] Discovery Test #1
#
jeremycherfas <strong>webmention.rocks</strong>
#
jeremycherfas </a>: but it is not appearing.
#
jeremycherfas Ooops. That didn’t work.
#
aaronpk jeremycherfas: what's the URL?
#
jeremycherfas https://stream.jeremycherfas.net/2017/hang-on-so-i-can-use-web-mentionrocks-to-test
#
Loqi [Jeremy Cherfas] Hang on. So I can use web mention.rocks to test how I'm doing? That's good to know.
#
aaronpk good news and bad news
#
aaronpk i sent the webmention for you and it worked. so that means nothing is wrong with the html markup on known. however it looks like known might just not be able to find that webmention endpoint!
#
aaronpk try #4 instead, it's easier to find
#
aaronpk well look at that, #1 is not supported by Known :) https://github.com/w3c/webmention/blob/master/implementation-reports/known.md
#
aaronpk https://github.com/idno/Known/issues/1589
#
jeremycherfas That’s nothing to smile about!
#
aaronpk which, ironically, comes back to me, since I wrote the code that Known uses to find webmention endpoints
#
aaronpk i forgot that benwerd copied my mention-client-php library into known ages ago
#
jeremycherfas Ah well. #4 worked fine.
#
jeremycherfas Known also has a problem with repsonding to `syndicate-to`
jeremycherfas_ joined the channel
#
aaronpk yes i saw that issue
#
jeremycherfas_ It would be nice if they could fix that.
#
aaronpk i should install Known locally so i can test while developing micropub.rocks
#
Loqi it is probable
snarfed joined the channel
#
snarfed [cdevroe]: owning your data is a marathon, not a sprint! definitely no need to burn out. take a break if you're tired of it right now!
#
snarfed i know much of the bridgy publish troubles came from the wordpress plugin, and i know GWG has definitely appreciated your bug reports and feedback
#
snarfed if it's still unhappy, consider posseing manually for a bit! highly underrated. :P
#
[cdevroe] snarfed Thanks for the encouragement.
#
petermolnar [cdevroe] if indieweb fatigue refers to 'do I really want to post to silo X?' then yes, it is a thing, and you're not alone
#
petermolnar these days I've essentially stopped cross-posting and only using my site, for myself and ended up treating silos as ephemeral one-to-many interfaces
tantek joined the channel
#
[cdevroe] petermolnar I like that approach as well. Treat Twitter/Facebook the way I treat Instagram Stories.
jeremycherfas and Jocelyn1 joined the channel
#
Jocelyn1 Jocelyn
EHLOVader joined the channel
#
Jocelyn1 Hi! question for anyone with some downtime... I tried to change the url of my site on wordpress... and now I get a 403 forbidden error from my hosting. I WANT to change the Url back to what it was but cannot access my wp-admin. Any ideas ?
#
tantek hello Jocelyn1 !
#
tantek GWG, can you help out with some WP admin?
#
Jocelyn1 hi tantek!
jmelesky joined the channel
#
sebsel I'm here with petermolnar, Zegnat at Schiphol for HWC The Netherlands
#
sebsel the special valentines edition :)
wolftune, hs0ucy, snarfed, [keithjgrant] and gRegorLove joined the channel
#
Loqi [indieweb] "Thanks for the kind words, Chris! It was good talking to you yesterday. I'm also optimistic about IndieWeb's future!" by Jonathan LaCour on 2017-01-27 https://cleverdevil.io/2017/thanks-for-the-kind-words-chris-it-was-good-talking
#
Loqi [indieweb] "Welcome to the IndieWeb, Keith :)" by Jonathan LaCour on 2017-01-24 https://cleverdevil.io/2017/welcome-to-the-indieweb-keith
snarfed, singpoly1a, mlncn, KartikPrabhu, nitot and tantek joined the channel
#
petermolnar so HWC Schiphol started looking at their Facebook exports from various time to realise there is location data under Security based on IP address, which is not completely incorrect
#
petermolnar Security page is terrifying by the way
snarfed joined the channel
#
aaronpk checks out the security page
#
aaronpk whoa, facebook will encrypt emails it sends you if you give them a public key
tolerablyjake joined the channel
#
sebsel yeah, not the security page, but the security page ON the facebook dump
#
sebsel (we have not checked the security page on Facebook itself)
snarfed joined the channel
#
Zegnat What is bloggercode?
#
Loqi It looks like we don't have a page for "bloggercode" yet. Would you like to create it?
#
Zegnat tantek ^^^
#
Zegnat !tell tantek what is a bloggercode?
#
Loqi Ok, I'll tell them that when I see them next
[keithjgrant] and jeremycherfas joined the channel
#
GWG snarfed, not most of them, some came from a lack of education. But a fair amount from the plugin
#
GWG tantek, I can
wolftune and tantek joined the channel
#
tantek GWG, a bit delayed there - I think Jocelyn1 is no longer here ;)
#
Loqi tantek: Zegnat left you a message 32 minutes ago: what is a bloggercode?
#
tantek hmm - not sure it is worth documenting bloggercode?
#
Zegnat Thing is, the website everyone was linking to for the documentation is gone.
#
Zegnat And apparently there was a “decode” tool, but that is gone too, hahaha
#
tantek likely on archive.org
#
Loqi Zegnat: lol
#
dgold oh, you mean like the GeekCode or the AFPcode?
#
petermolnar wow, is it that embarrassing tantek? :)
#
tantek petermolnar: no just that non-relevant
#
petermolnar ok :
#
tantek like the, can't be bothered kind
#
GWG tantek, sorry, was role playing
#
Zegnat ben_thatmustbeme would you consider opening up *.thatmustbe.us for other names?
#
Zegnat !tell ben_thatmustbeme would you consider opening up *.thatmustbe.us for other names?
#
Loqi Ok, I'll tell them that when I see them next
#
Zegnat HWC the Netherlands is discussing lots of old-internet-stuff
#
tantek wonder what the threshold is for an "us"?
#
tantek Zegnat, have you come across XFN and rel=crush yet?
#
tantek since it is v-day and all
#
Zegnat Oh, yes, I actually really like XFN. There is just noway I would put a public friends list
#
Zegnat I would totally add rel=crush though
#
Zegnat ben.thatmustbe.us redirects to a random ben (documented on /Ben), we just want more options
#
aaronpk ben_thatmustbeme: you should set that up to work with any first name on /irc-people
#
aaronpk i guess we don't have first names there but you could look for an h-card on peoples' home pages to see if there's a first name to use
#
Zegnat adactio has XFN on his homepage still, I believe
#
sebsel well, actually, I posted a Mf2 u-like-of to a profile today... https://seblog.nl/2017/02/14/2/day-30-private-webmentions
#
Loqi [Sebastiaan Andeweg] Day 30: private webmentions (special valentines edition)
#
sebsel (bottom of the post)
#
Zegnat We were wondering if there was an indieweb webring, which made me recall thatmustbe.us, which lead to us thinking it should be a thing other than just ben.*
#
tantek what is a webring
#
Loqi A webring is a collection of websites linked together in a circular structure https://indieweb.org/webring
#
tantek Zegnat, there's a page on it - did anyone there check that?
#
Zegnat First thing I checked, no indiewebring on there
#
aaronpk heh, this is a clever centralized trick for making webrings easier to manage/join https://hotlinewebring.club/
#
aaronpk kind of against the spirit of webrings to have it use a centralized coordinator like that but it's cute
#
ben_thatmustbeme Zegnat: i'd be up for that, i just don't have time to work on that at the moment
#
Loqi ben_thatmustbeme: Zegnat left you a message 10 minutes ago: would you consider opening up *.thatmustbe.us for other names?
#
ben_thatmustbeme if someone has code for it, i'd be cool with setting such a system up
#
petermolnar sure. what language?
#
petermolnar (which is the easiest for you to run?)
#
ben_thatmustbeme everything i have is php and mysql, thats just whats on the server
#
ben_thatmustbeme if you need something else, i'm up for working to get something else set up
#
Zegnat Oh man, old web, I just ended up on http://dean.edwards.name/ and wondering if it is still running from his kitchen
Garbee, Pierre-O, wolftune and [keithjgrant] joined the channel
#
[keithjgrant] http://keithjgrant.com/notes/2017/02/74634/
#
Loqi Test post from phone
#
tantek nice!
#
[keithjgrant] Alright. Now to automate sending webmentions
#
tantek keithjgrant++
#
Loqi keithjgrant has 2 karma
tolerablyjake joined the channel
#
[keithjgrant] And to cut down the time. Takes like 60 seconds to go through the whole Rube Goldberg
tantek joined the channel
#
Loqi [indieweb] "Comment on Using WordPress for IndieWeb by Steve Dowe" by Steve Dowe on 2017-02-14 http://techlifeweb.com/using-wordpress-for-indieweb/#comment-124601
[eddie] joined the channel
#
[eddie] I’ve looked around the IndieWebCamp projects page, looks like I don’t see any Node.js stuff. Anyone know of any Node.js IndieWeb developers or will I be breaking new ground? Curious if there’s any previous look I should take a look at in the Node.js sphere before making stuff from scratch?
#
tantek there were a few I think?
#
tantek what was Barry using?
#
Loqi It looks like we don't have a page for "Barry using" yet. Would you like to create it?
#
tantek heh
#
tantek what is Node?
#
Loqi Node.js is a platform for running javascript applications and runs on all modern operating systems https://indieweb.org/node
#
aaronpk there definitely are some! the node microformats parser is one of the better ones too
#
tantek eddie, a few things here: https://indieweb.org/Node.js
#
tantek (quite good things at that)
#
tantek and I think there are more, just don't remember off the top of my head
#
[eddie] Awesome! Thanks guys ?
#
tantek voxpelli: hey - any more cool Node indieweb stuff? or where it would be documented? :)
#
voxpelli There's Glenn's https://github.com/glennjones/microformat-node as well
#
voxpelli But apart from that I can't think of any more – there are some indieauth things and other that I think are pretty pre-alpha and unmaintained
#
[eddie] microformat-node and micropub-express look pretty sweet. I’ll have to check these guys out.
#
voxpelli [eddie]: I'm building all of my stuff in Node, as can be seen on the page tantek linked to :) micropub endpoint and webmention endpoint so far, (some more in early dev)
#
[eddie] voxpelli: Awesome, ? You’re using Jekyll as well? (Looking at your IndieWebCamp profile. lol)
#
ben_thatmustbeme keithjgrant++ what were you posting with from your phone?
#
Loqi keithjgrant has 3 karma
#
[keithjgrant] Quill.
#
voxpelli [eddie]: yes, I use Jekyll for my own site
#
[keithjgrant] So, it goes Quill -> Heroku MicroPub endpoint (voxpelli’s lib) -> Forestry.io to rebuild Hugo site & push to GitHub pages
#
[keithjgrant] Co-worker and I are discussing putting together a lib to consolidate some of this
#
ben_thatmustbeme cool
#
ben_thatmustbeme i'm still deep in my rewrite to laravel... in what time i have
#
ben_thatmustbeme completely redoing my site in it. and should make it much easier to install for anyone else who wants to use it
#
[eddie] voxpelli: Ahhh, you and I are gonna be friends. haha. I’m playing around with both Jekyll (which currently powers my site that I’m slowly working on building out with proper IndieWeb standards) and Node.js which I am hoping to use to add the more dynamic parts of my site. Currently, I’m using Node.js just to fetch my goodreads books and place the JSON for my Jekyll site to grab when it rebuilds on post-commit hook
#
@islayblog @spreeblick @XiongShui oder mich der Avantgarde im Indieweb anschliessen, die nicht alles dem Kommerz ueberlassen will. (twitter.com/_/status/831618525655597058)
#
Loqi nice
#
voxpelli [keithjgrant]: I'm looking at using https://github.com/aaronpk/Telegraph/issues/13, https://github.com/barryf/webhook-mentions or something of my own for automatic web mentions
#
voxpelli Still doing all webmentions manually
#
voxpelli [eddie]: nice! I really like the combo of static site and node.js (micro)services
#
[keithjgrant] Nice. I'll help where I can. Can't wait to finish writing my book so I have more time
miklb and snarfed joined the channel
#
[keithjgrant] Can MicroPub theoretically accept a future-dated note and publish at the designated time?
#
aaronpk it would be up to the micropub server to handle that but yes
#
aaronpk the quill blog post interface allows you to create a future-dated post
#
aaronpk https://aaronparecki.com/2017/01/15/3/day26-quill
#
Loqi [Aaron Parecki] Day 26: Tag tokens and publish date for Quill #100DaysOfIndieWeb
tantek, snarfed, wolftune and Loqi joined the channel
#
miklb aaronpk if you run out of ideas for #100days (lol) a service to get auth token for micropub would be handy ;-)
KevinMarks, Loqi, hs0ucy, aaronpk and nitot joined the channel
#
tantek really easy 100days project: 100days of reporting spam accounts (pick a silo, any silo, like IG which notifies you when they've taken down the accounts!)
#
Zegnat I am making good time on 100days of reporting spam accounts on Instagram then. Just the amount of fake follower requests I get is astounding.
#
tantek same same
#
tantek I'm trying to see if I can get an "notifications" screen that is nothing but reports of spam accounts I've helped take down
#
tantek they really ought to gamify that
#
tantek like I want to see a spam slaying leaderboard. all time. this month / week / day.
#
tantek #slayallday
jacus, KartikPrabhu, sensiblemn and gko joined the channel