#dev 2018-04-19

2018-04-19 UTC
snarfed, eli_oat, chimo, [tantek], [charliepark], tantek, jalcine, renem, Mandrake, [sdepolo], leg, tantek_ and bdesham joined the channel
#
j12t aaronpk: I'm attempting to get Aperture to work. When running the first db migrations, I get "Syntax error or access violation: 1071 Specified key was too long; max key length is 767 bytes". Chances are you are running different mysql defaults: mine are InnoDB tables, and utf8 everywhere, and there seem to be size limitations. What is your db / charset like?
#
dansup j12t: what version of mysql?
#
dansup I used to encounter that error, https://laravel-news.com/laravel-5-4-key-too-long-error
#
dansup using laravel, not aperture. If you update mysql it should work
#
j12t Ahh ... I'm not quite seeing cause and effect here, but I'll try that!
#
j12t dansup: does not seem to have worked.
#
j12t I'm on mariadb 10.1.32 which is current.
#
j12t Actually maybe not ... I'm on UBOS, which is derived from Arch, and those guys tend to be close to upstream. But apparently not in this case.
#
dansup ooh, mariadb.
#
dansup Stable release: 10.2.14 (March 27, 2018; 14 days ago)
#
j12t Yes, I just noticed.
#
dansup iirc 10.2 has the fix, j12t are you sure your running current?
#
j12t I guess until the Arch guys get mariadb 10.2.x sorted out, and so far I'm mostly fooling around anyway with Aperture, I'm going to try that innodb_large_prefix option.
#
aaronpk Yea that key size requires MySQL 5.7 or compatible, can't remember the mariadb version ironically even tho that's what I actually use
jalcine, maingo, cweiske and KartikPrabhu joined the channel
#
cweiske aaronpk, is that javascript micropub client still to find somewhere? https://chat.indieweb.org/2016-02-16#t1455587718590000
#
Loqi cweiske: swentel left you a message 15 hours, 32 minutes ago: release at https://github.com/swentel/indigenous-android/releases
#
Loqi [aaronpk] i just made a minimal "built-in" editing interface for p3k, that does only the most common functions, but it's actually a Javascript Micropub client
#
cweiske the screenshot is gone unfortunately
#
cweiske oh. just learned about https://github.com/jjdelc/grumble, a pure javascript micropub client
#
Loqi [jjdelc] grumble: Micropub client
swentel joined the channel
#
realize.be edited /Micropub (+155) "/* Libraries */" (view diff)
AngeloGladding, leg, [ciudadanob], [pfefferle], jeremycherfas and Mandrake joined the channel
#
@huffduffer An Indieweb Podcast- Episode 2: IndieAuth | David Shanske https://huffduffer.com/deeden/472410 (twitter.com/_/status/986914591975370752)
[jgmac1106], [xavierroy], [miklb], [matthilt], [pfefferle], Mandrake, snarfed, tantek, [kevinmarks], singpolyma and KartikPrabhu joined the channel
#
loqi.me created /A2P (+100) "prompted by KartikPrabhu and dfn added by singpolyma" (view diff)
#
loqi.me created /short_code (+222) "prompted by KartikPrabhu and dfn added by singpolyma" (view diff)
#
tantek being available over SMS did allow for both Twitter and Dodgeball to take off rapidly in comparison to other "internet only" services
#
loqi.me edited /A2P (+98) "sknebel added "https://www.twilio.com/docs/glossary/what-a2p-sms-application-person-messaging" to "See Also"" (view diff)
[tantek] and benharri joined the channel
#
aaronpk oh no
#
aaronpk https://www.instagram.com/pk_spam/?__a=1 is returning 403
maingo joined the channel
#
sknebel that was part of the "secret api"?
#
aaronpk yea
#
aaronpk looks like xray is having trouble with it too
[snarfed] joined the channel
#
[snarfed] [aaronpk] feel free to borrow/port this for extracting it from the html: https://github.com/snarfed/granary/blob/master/granary/instagram.py#L771
#
aaronpk thx, I have something like that in xray for photos already, need to adapt it for profiles now apparently
#
aaronpk omg that comment
#
aaronpk "Instagram sometimes returns 200 with incomplete HTML. often it stops at the end of one of the <style> tags inside <head>. not sure why."
#
aaronpk the things we do to get our data out of the silos
#
KartikPrabhu or the things silos do to keep our data
#
Loqi KartikPrabhu: snarfed left you a message 2 days, 21 hours ago: thanks again for all your recent work on mf2py! i can't wait to start using it. any chance of a pypi release soon?
#
KartikPrabhu [snarfed]: I'll have to coordinate with [kevinmarks] for a release. Hopefully in the coming weeks
AngeloGladding and singpolyma joined the channel
#
aaronpk okay what the heck, these spam pingbacks keep coming through and I don't understand how
#
aaronpk also it's a bit tricky to see the actual HTML of the source the way this is set up
#
aaronpk i'm wondering if they are actually temporarily adding a link to the site in order for the pingback to validate
#
tantek I temporarily (24h) add a link to Bridgy so that Bridgy Publish works
#
tantek (like literally my generating code has an autotimeout window)
barpthewire joined the channel
#
aaronpk ha
#
aaronpk bridgy publish is an unusual overloading of webmention tho
[jgmac1106] joined the channel
#
aaronpk what's the h-card property for "bio"?
#
aaronpk like instagram bio
#
singpolyma note
#
aaronpk that works. "additional notes" doesn't tell me much tho http://microformats.org/wiki/h-card
leg joined the channel
#
@jgmac1106 This is what I am exploring. For academics in our spaces whose #GoOpen, #oer, #digped, #DOO, philosophies align with #indieweb principles would the tools like MicroPub and MicroSub and standards like webmentions not only make tracking the spread of… http://quickthoughts.jgregorymcverry.com/2018/04/19/this-is-what-i-am-exploring-for-academics-in-our (twitter.com/_/status/987024112106127361)
#
aaronpk the secret api for photo permalinks still works
#
aaronpk https://www.instagram.com/p/7QVh2kCMH-/?__a=1
jeremych_ and snarfed joined the channel
#
tantek "secret" 😂
#
aaronpk the one good thing about this js;dr graphql trend is it means websites now have easy to parse JSON blobs in their source code
[snarfed] joined the channel
#
[snarfed] not necessarily in the source code though, often in subsequent AJAX requests
#
[snarfed] like these recent Instagram changes!
#
aaronpk instagram seems to still put the json blob in the html
#
[snarfed] which are less discoverable
#
[snarfed] not always any more
#
[snarfed] eg home page feed i think. finding.
#
aaronpk ah yea I don't deal with that one for OYG
#
sknebel uh oh, do the latest FB changes mean that they've killed Events completely in the API? http://archive.is/Seejz (archive since its behind login wall, not how it has a note from yesterday saying they changed more)
#
[snarfed] https://github.com/snarfed/granary/issues/140
#
Loqi [snarfed] #140 fix IG home page feed scraping (again)
#
[snarfed] @sknebel not in practice yet. bridgy still reads them fine
#
[snarfed] details are in logs here from a couple weeks ago or so
#
sknebel I saw that, asked since it says they changed things yesterday
#
snarfed ah ok
#
snarfed confirmed. /me/events API call for the indiewebcamp page return nothing right now. :(:(:(
#
snarfed https://brid.gy/log?start_time=1524160132&key=aglzfmJyaWQtZ3lyIQsSDEZhY2Vib29rUGFnZSIPNjg4NDQ3NDIxMTkzMjg1DA
#
snarfed from the page sknebel posted, sounds like that API call may work again after i go through another permissions review
#
aaronpk alright ownyourgram is fixed
#
aaronpk side effect of this change is it should be possible to follow an instagram profile URL in aperture now
#
tantek ooh - and see photos in chronological order?
#
snarfed aaronpk does aperture also support rss or atom? or just h-feed?
#
aaronpk yeah rss and atom
#
aaronpk and jsonfeed
#
aaronpk tantek: I already follow my instagram timeline via granary.io in aperture, and see chronological order photos with no ads :)
#
aaronpk this would allow me to follow a specific person now
#
tantek amazing
#
snarfed (which granary can also do, but if you can now just plug the instagram URL in directly, that's definitely a better UX!)
#
aaronpk ah I think I need to tweak something about the feed discovery bit in order to make this work by just plugging in the instagram profile URL
#
aaronpk but all the pieces are there now
#
aaronpk https://xray.p3k.io/parse?expect=feed&url=https://www.instagram.com/aaronpk/
#
snarfed diffs against https://granary.io/instagram/aaronpk/@self/@app/?format=mf2-json out of curiosity
#
aaronpk xray is jf2 so it'll be a little different
#
snarfed ah ok
#
aaronpk oh and for this pass, xray doesn't fetch the photo permalinks, so it's missing some things in the feed like venues, person tags, and videos
#
aaronpk that data doesn't come down in the initial pageload of an instagram profile
#
snarfed heh granary doesn't either, but i didn't realize that misses so much. https://github.com/snarfed/granary/issues/123
#
Loqi [snarfed] #123 instagram scraped profile feeds don't include video mp4 URLs
#
aaronpk hm how does granary get the person tag in that example tho
#
snarfed will look in a min
#
aaronpk I didn't think I saw that in the json
snarfed and swentel joined the channel
#
swentel aaronpk, when using quil, the event post type sends 'type' => 'event', but the micropub page says it should be 'h' => 'event', it should follow the indieweb page right ? :)
cweiske joined the channel
#
sebsel swentel It depends on the syntax. https://www.w3.org/TR/micropub/#vocabulary
#
sebsel Content-Type*
#
swentel oooh
#
swentel right
#
swentel hmm, yeah, symphony has already converted the json in my callback
#
swentel ok, makes sense
#
swentel I should start using aaron's helper functions so I don't have to care what comes in
#
Loqi +1
#
swentel thanks sebsel!
#
snarfed aaronpk: granary parses @-mentions out of photo captions and converts them to person tags
#
snarfed starts to capture FB API change details in https://github.com/snarfed/bridgy/issues/814
#
Loqi [snarfed] #814 facebook: re-apply for page events permission
#
aaronpk snarfed: ah I guess I missed that the person tag didn't actually resolve the profile info and show the full name and URL
KartikPrabhu joined the channel
#
aaronpk any reason you don't also extract hashtags from the caption and set those as tags then too?
#
snarfed not really, no :P
#
cweiske swentel, liking a browser page on android takes 4 steps now: 1. Share, 2. Indigenous, 3. Like, 4. Send
#
cweiske a bit much in my eyes
[chrisaldrich] joined the channel
#
cweiske I don't think that people add tags to likes
#
cweiske this is an unnecessary step IMO
#
cweiske and maybe indigenous could add explicit reply and like buttons in the android share screen
#
swentel cweiske, oh yeah, I've thought about that, didn't want to add to many share options in that screen initially
#
swentel but you're right, it's a but cumbersome now
#
swentel (ironically, I add tags heh)
#
cweiske oh :)
#
swentel but I plan to make this configurable
#
swentel in the settings screen to allow all kinds of widgets per post type
#
swentel and probably add a 'direct' like/reply too
#
swentel because the same happens in the reader
#
cweiske swentel++ for making the android app
#
Loqi swentel has 2 karma in this channel (6 overall)
#
swentel I guess some people when hitting like just want to send the request immediately in the background
#
swentel cweiske, feel fee to open an issue for that
#
swentel it's definitely worth considering
#
cweiske there are enough open issues already :)
#
swentel oh I don't mind
#
swentel I have 105 open in the drupal plugin lol
#
swentel I rather have everything written down
#
swentel instead of having to remember it
#
swentel I need to create setup a better roadmap though
#
swentel but the two are very much connected
#
swentel working on event micropub post now on the drupal part
#
swentel then switch to indigenous
#
swentel and posting crap to my site initially :)
#
cweiske aaronpk, does webmention.io handle salmentions?
#
aaronpk thinks
#
aaronpk what would it have to do to handle salmentions?
#
cweiske 1. comment #2 to comment #1 is posted
#
cweiske 2. server #2 notifies server #1
#
cweiske 3. server #1 notifies server #0 that contains the blog post that was commented to by comment #1
#
swentel oh funky
#
cweiske 4. webmention.io (server #0) receives notification from server #1 and fetches comment #1, and with that fetches comment #2
kaushalmodi joined the channel
#
kaushalmodi cweiske: Thanks for bringing that discussion here :)
#
kaushalmodi Here's a live example where I could use some salmentions :) https://scripter.co/golang-quirk-number-strings-starting-with-0-are-octals/#webmentions
#
cweiske but then webmention.io would need to nest comments in its JSON responses
#
aaronpk how does it know to find comment #2?
#
cweiske because it's a h-reply on the comment #1 page
#
aaronpk oh, webmention.io only looks at the main post on the page, doesn't look for any responses to that post
#
aaronpk reviewed https://indieweb.org/Salmentions#Receiving_Salmentions
#
cweiske so kaushalmodi, 2 pieces of your comment system miss salmention support :)
#
kaushalmodi Sorry, I didn't follow. Which 2 pieces?
#
cweiske commentpara.de does not display replies below comments
#
cweiske webmention.io does not fetch comments of comments
#
kaushalmodi So this part "When it receives a previously received Webmention:" from that wiki.. I believe webmention.io would need to support that?
#
cweiske yes
#
kaushalmodi If webmention.io updated a previously received wm with a nested reply, I can parse that.. but then until then the current scheme will work
#
kaushalmodi Then it wouldn't make sense to have the "reply" link in commentpara.de
#
cweiske one step after another
#
cweiske btw, I was looking for a javascript-only micropub comment box that one can integrate below the blog post
#
cweiske someone actually made a javascript-only micropub client: https://github.com/jjdelc/grumble
#
Loqi [jjdelc] grumble: Micropub client
#
cweiske and I made the necessary changes to commentpara.de to support it (send CORS headers)
#
kaushalmodi aha, so then the commenting experience would be similar to that of disqus, etc
#
cweiske yes
#
cweiske so we know now that it is possible to build this
#
cweiske and somebody has to do that
#
kaushalmodi I might just need to display something like "Your comment won't show up immediately"
#
kaushalmodi as the comment will fly through the mp client -> commentpara -> webmention.io -> zapier -> netlify -> finally on my site :P
#
cweiske brave new world
#
cweiske brave new distributed world
#
cweiske that grumble client is too heavy, the comment box could be a very downstripped version of it
#
kaushalmodi I'd very much apprecitate that :)
#
cweiske I'd appreciate that, too :)
#
kaushalmodi One of the many reasons to drop disqus was its 150kb+ js
#
cweiske making that comment box server-side in PHP would be easier, but that does not help static blogs
#
cweiske but
#
sknebel you want to retain some kind of auth step? otherwise you could just use a normal form?
#
cweiske ideally the user can input his url
jjuran joined the channel
#
cweiske and if he did, his micropub endpoint would be used to post the comment
#
cweiske if not, it would fall back to commentpara.de
#
sknebel ah
#
kaushalmodi sknebel: right now the auth url is commentpara.de by default
#
cweiske commentpara.de could actually provide comment box processing code now that I think about it
#
kaushalmodi yeah, as not all commenters would have any idea what that auth is about
#
cweiske which is an awesome idea now that I think about it
#
cweiske but that would also mean that commentpara.de would be a dependency
#
cweiske a pure js mp client would be standalone
#
kaushalmodi talking about processing, did you notice the transformation of markdown in https://commentpara.de/comment/240.htm to html on the site? :)
#
Loqi [Kaushal Modi] @Anonymous > You may want to try something like this with Python .. print 017 You are correct, though that was true only in Python 2.x. Thankfully you now need to use the `0o` or `0O` prefix for octal literals in Python 3.x. Someone wrote [...
#
cweiske kaushalmodi, the client would need to convert the markdown text to html and then send it to the micropub client
#
cweiske micropub posting is either plain text or html
#
cweiske there is no way to tell the micropub server "hey, that's markdown, please render it"
#
cweiske (no standard way)
#
kaushalmodi It will be fine if I get the exact same HTML that I get now.
#
kaushalmodi Else, I guess.. a complication.. add a button to pick the comment format: md, text, html
KartikPrabhu and snarfed1 joined the channel
#
snarfed1 ugh facebook broke profile picture URLs
#
snarfed takes one step closer to dropping facebook from bridgy entirely'
#
aaronpk oh noes
#
kaushalmodi curious.. can bridgy work with Hacker News?
#
snarfed both the URLs we construct like https://graph.facebook.com/v2.10/212038/picture?type=large , and the final URLs those used to (and still) resolve to
#
snarfed neither work
#
snarfed kaushalmodi: PRs welcome! https://github.com/snarfed/bridgy/issues/693
#
Loqi [snarfed] #693 hacker news support: publish, backfeed
#
kaushalmodi Thanks, I didn't think of looking for an existing issue.
#
snarfed 🤔
#
kaushalmodi Thanks for the detailed instructions on adding a new silo support. I'll try it out and see how far along I can go through that.
#
snarfed [kaushalmodi] awesome! definitely feel free to ping me with any q's
#
snarfed facebook API i wish i could quit you. https://github.com/snarfed/bridgy/issues/815
#
Loqi [armingrewe] #815 FB profile pictures missing as well now?
#
snarfed heh, pretty much the entire front page of the facebook API forum right now is complaints about profile pictures: https://developers.facebook.com/bugs/?tag_ids=175067919228429#u_0_1
[kevinmarks] joined the channel
#
aaronpk lol
#
aaronpk well i'mglad i have my own archive of all the previous facebook profile pictures i received!
#
snarfed more background here: https://techcrunch.com/2018/04/18/login-with-facebook-data-hijacked-by-javascript-trackers/
#
snarfed notably, they started doing exactly what we speculated >2y ago that they already were doing. http://snarfed.org/2015-10-25_de-anonymizing-facebooks-app-scoped-ids#reported
#
snarfed "we...are working to institute additional authentication and rate limiting for Facebook Login profile picture requests." (from TC article)
[jgmac1106] joined the channel
#
[kevinmarks] https://files.slack.com/files-pri/T03QR2B2T-FA99K8D96/screenshot_20180419-214929.png?pub_secret=cbd63e601c&name=Screenshot_20180419-214929.png Why are family fighting? (ownyourgram.com vs withknown)
#
cweiske known version?
#
cweiske older known versions did not return the syndication endpoints on ?q=config
#
cweiske only on ?q=syndicate-to
tantek and tantek_ joined the channel
#
[kevinmarks] Hosted known
[cleverdevil] joined the channel
#
[cleverdevil] So, I bit the bullet last night and moved Puny to work with MySQL, using a JSON column to store the MF2 JSON, and a few columns for fast indexing/search.
#
[cleverdevil] Its so much simpler than all of the hoops I was jumping through trying to get it to work against just S3 or DynamoDB.
#
[cleverdevil] RDBMS ❤
#
aaronpk nice! with the new json indexing thing?
#
[cleverdevil] Yup!
#
[cleverdevil] I already have it working on Lambda too.
#
aaronpk does AWS have a mysql version new enough for that now?
#
[cleverdevil] So, its entirely serverless, but everything is dynamic.
#
[cleverdevil] Yup.
#
aaronpk nice
#
[cleverdevil] In RDS.
#
[cleverdevil] Next step, move it to Aurora Serverles.
#
[cleverdevil] Then, it'll be 100% consumption based.
#
[cleverdevil] (That's an AWS MySQL/PostgreSQL compatible database service that only bills you when you run queries).
#
jalcine woah
#
jalcine Aurora Serveless
#
jalcine that's brilliant
#
[cleverdevil] Indeed.
#
[cleverdevil] Its still in preview, unfortunately.
#
[cleverdevil] But, this is the way everything is moving.
#
[cleverdevil] You only pay for what you use.
snarfed, barpthewire, KartikPrabhu, [kevinmarks], singpolyma, chrisaldrich and tantek joined the channel
#
oodani hi again! i just noticed that https://indiewebify.me/validate-h-card/ thinks i have multiple representative h-cards, and i'm not really sure why? https://00dani.me/ has several h-cards but only one of them has a u-uid property at all (and it points to the current page as it should)
#
oodani is indiewebify.me just Wrong™ or am i missing something here :o