2018-03-30 UTC
voxpelli_, wagle, j12t, oodani, treora, raucao, GWG, strugee, KevinMarks_ and [cleverdevil] joined the channel
# 00:23 [cleverdevil] I just got my first proper IndieAuth authorization working on AWS Lambda 😄
# 00:23 [cleverdevil] Quill -> PunyAuth running on Lambda
tbbrown, schmarty, eli_oat[m], zoglesby, plindner, myfreeweb, mindB, renem, grantcodes, neil1, globbot and [miklb] joined the channel
# 01:36 aaronpk cleverdevil++ nice
# 01:36 Loqi cleverdevil has 22 karma in this channel (78 overall)
# 01:37 aaronpk sknebel: what about what about items that changed? can't find context
plindner, myfreeweb, grantcodes, eli_oat[m], schmarty, zoglesby, mindB, AngeloGladding, snarfed and kaushalmodi joined the channel
# 03:44 aaronpk not sure of the full context, but yes in general each h-entry in an h-feed should include u-url of its permalink
# 03:52 KartikPrabhu or a u-uid
# 03:54 Loqi [mblaney] the only reason I mentioned your h-feed is that I tried subscribing to it in my reader and it didn't display any posts because there were no u-url's on the h-entry's.
# 03:54 kaushalmodi mblaney is unable to fetch the h-entry posts from h-feed
# 04:01 kaushalmodi mblaney: I now have h-feed > h-entry > u-url. Does the feed fetching now work better?
# 04:04 kaushalmodi meta question.. how is each user's handle hyperlinked to their domain? (I see those hyperlinked handles on chat.indieweb.org). How do I associate my handle to my domain?
tbbrown and tantek joined the channel
# 04:20 kaushalmodi KartikPrabhu++ Thanks I added myself there. But still I don't see the hyperlink.
# 04:20 Loqi kartikprabhu has 16 karma in this channel (189 overall)
# 04:20 kaushalmodi OK, messaged too soon. Now I see it :)
# 04:45 kaushalmodi !tell cweiske Can you please check if commentpara.de is loading for you? It times out for me.
# 04:45 Loqi Ok, I'll tell them that when I see them next
snarfed joined the channel
# 05:27 gRegorLove It's down for me too, kaushalmodi
tantek joined the channel
# 05:52 Zegnat Oh boy! I just spotted aaronpk did release an alpha for php-mf2 :D Good stuff
[jeremycherfas], renem, tantek, KevinMarks and cweiske joined the channel
# 06:32 Loqi cweiske: kaushalmodi left you a message 1 hour, 47 minutes ago: Can you please check if commentpara.de is loading for you? It times out for me.
# 06:33 cweiske kaushalmodi: thanks - fixed.
# 06:34 cweiske I've got RAM problems on my server lately. the VPS always gets "privvmpages" to the limit, although linux says there is still enough ram
AngeloGladding and [kevinmarks] joined the channel
mblaney joined the channel
# 08:14 mblaney kaushalmodi yes my reader is picking up the u-url's now. fetching was ok, it's just skipped entries without a link.
# 08:16 mblaney I should add support to my reader for p-summary though.
jeremycherfas and sebsel joined the channel; mblaney left the channel
# 09:59 sknebel !tell aaronpk if a microsub server sees a post has been updated (e.g. it gets a websub notification about that), how does it tell the microsub client about that happening?
# 09:59 Loqi Ok, I'll tell them that when I see them next
EmreSokullu joined the channel
[kaushal_modi] joined the channel
# 11:07 [kaushal_modi] mblaney: Thanks for the test! The only thing remaining is the p-name parsing now. Zegnat++ and aaronpk++ have updated the php-mf2 library to support HTML5 too. The pin13.net/mf2 site has also be updated to use the updated library and so now https://pin13.net/mf2/?url=https%3A%2F%2Fscripter.co parses the p-name in h-feed correctly.
# 11:14 [kaushal_modi] cweiske++ Thanks, that site is up now. May you find a true fix for that soon :)
# 11:14 Loqi cweiske has 32 karma in this channel (134 overall)
KevinMarks, EmreSokullu and [kevinmarks] joined the channel
KevinMarks, snarfed and EmreSokullu joined the channel
EmreSokullu and snarfed joined the channel
# 15:49 Zegnat What is asocial?
# 15:53 sknebel ok, *something* works with my microsub bridge
# 16:03 sknebel !tell grantcodes: together sees the channel list from my microsub server, but I can't switch channels away from the notification channel and it appears as if it doesn't even send requests to get the timeline for those when I try
# 16:03 Loqi Ok, I'll tell them that when I see them next
# 16:11 aaronpk you can try out monocle too
# 16:11 Loqi aaronpk: sknebel left you a message 6 hours, 12 minutes ago: if a microsub server sees a post has been updated (e.g. it gets a websub notification about that), how does it tell the microsub client about that happening?
# 16:12 sknebel ah, didn't remember that's available too
# 16:12 sknebel what is monocle?
# 16:13 aaronpk good question. there isn't a mechanism for that right now. it kind of assumes clients are "dumb" and only cache the data they get from the microsub server.
[cleverdevil] joined the channel
# 16:14 [cleverdevil] Speaking of microsub... I was visiting [snarfed] in SF earlier this week, and got into a discussion about some things I'd like to be able to add to Together, [aaronpk].
# 16:15 [cleverdevil] One thing I'd love is the ability to show interactions (replies, reposts, likes, etc.) on items in the timeline.
# 16:15 [cleverdevil] Was curious if you have any early thoughts about that?
# 16:15 aaronpk yeah sorta, just decided to bump that down on the priority list in order to get something out the door
# 16:15 [cleverdevil] I was thinking it'd be good for Microsub to make it clear to readers whether or not a particular item has interactions (or even supports interactions).
snarfed joined the channel
# 16:16 aaronpk the "easy" version is the microsub server should fetch the permalinks of the posts and check if the posts are reporting any comments/likes/etc
# 16:16 [cleverdevil] It seems to me that the reader should likely be able to ask the Microsub server to fetch the latest interactions on-demand.
# 16:16 aaronpk but I skipped fetching post permalinks entirely for the first version of Aperture in order to speed up development
# 16:17 [cleverdevil] It wouldn't be a very good experience if interactions were only updated as items are fetched in the normal update mechanisms.
# 16:17 [cleverdevil] Makes sense.
# 16:17 aaronpk yeah I want to think through how I want to implement that sort of on-demand fetching before jumping in
# 16:17 aaronpk i'm worried about making a quick decision that I regret later
# 16:18 [cleverdevil] Good to know you've been thinking about it 🙂
# 16:18 [cleverdevil] And, fair warning, I'm starting to think about how to do private information sharing!
# 16:18 aaronpk I found a draft wiki page about the authentication bit of that the other day
# 16:18 [cleverdevil] Was thinking it might be cool to be able to share via syndicate-to.
# 16:19 [cleverdevil] So that people could create channels in their microsub servers that can be published to via micropub.
# 16:19 [cleverdevil] Does that make sense?
# 16:19 aaronpk not sure how that relates to syndicate-to
# 16:20 aaronpk aperture channels are already micropub endpoints :D
# 16:20 sknebel huh, same error in monocle
# 16:20 sknebel I must be missing something
# 16:20 [cleverdevil] So, the idea would be that when I publish something, I could make it private in my website, but toggle syndication to a friend or family member's microsub server.
# 16:21 aaronpk I hadn't considered writing to channels as something that could be done by other people
# 16:22 [cleverdevil] I like it conceptually, but the downside is that you'd have to have syndicate-to defined for all "friends".
# 16:22 [cleverdevil] Which is sort of... not ideal 🙂
# 16:22 aaronpk yeah probably doesn't make sense with the literal syndicate-to UI
# 16:22 aaronpk conceptually that actually sounds a lot like activitypub
# 16:23 [cleverdevil] Yeah, probably right.
# 16:23 aaronpk the more webby version of that is that you create either a separate feed where posts to friends-only show up and it requires authentication to view, or your main feed shows additional items when fetched with authentication
# 16:24 [cleverdevil] Yeah, I am trying to avoid requiring a bunch of changes to CMSes to allow them to participate
# 16:25 aaronpk hm, well using syndicate-to will likely also require CMS changes
# 16:26 sknebel aahh, found it. apparently uid's can't just be plain URLs, they have to be urlencoded...
# 16:27 aaronpk sknebel: hm the value should be allowed to be a URL
# 16:27 aaronpk but you'd need to urlencode it in requests of course
# 16:27 sknebel well, neither together nor monocle can deal with that
# 16:28 aaronpk hm that's not good
tantek, eli_oat and [snarfed] joined the channel
# 16:31 [snarfed] sknebel++ for building a microsub bridge!
# 16:31 Loqi sknebel has 33 karma in this channel (92 overall)
# 16:33 aaronpk sknebel: is your bridge something I can get running in order to figure out why monocle can't handle the URL uids?
eli_oat joined the channel
tbbrown, KevinMarks, EmreSokullu, eli_oat, KartikPrabhu, AngeloGladding and tantek joined the channel
# 17:21 tantek from #indieweb - aaronpk prompting me about my indie event posts
# 17:21 sknebel aaronpk: hm, not so easy right now. I can make a dummy that shows the problem if you want, but it seems pretty clear that uid's with slashes in them are the problem
# 17:21 tantek since my event posts are cloned (codewise) from my article posts, they support full arbitrary markup in the e-content
# 17:21 aaronpk sknebel: okay guess I can try tweaking aperture to include slashes then
# 17:22 tantek by convention I include venues by mf2 markup inside the e-content
# 17:22 tantek e.g. <a class="u-location h-card" href="https://wiki.mozilla.org/SF">Mozilla San Francisco</a>
# 17:22 Loqi Mozilla San Francisco
KartikPrabhu joined the channel
# 17:23 tantek I realized I didn't need venue support myself, as long as I could link to a canonical venue page
# 17:23 tantek that's how I was able to postpone venue support of my own
# 17:24 tantek and then I hacked up the venue equivalent of a nicknames cache, keyed by venue URL
# 17:24 tantek and mapped to e.g. Twitter @-name equivalent
# 17:26 tantek and then I wrote custom POSSE to Twitter code for my indie events that posts an semi-structured event summary to Twitter, with the venue @-name serving as a convenient text-readable @-venue = "at venue"
# 17:27 aaronpk I like including more info about the venue than just the name, like the address, in order to have a map show up
# 17:27 tantek which I later changed from "More: " to "RSVP: " once I was able to accept and show RSVPs
radedwork joined the channel
# 17:27 aaronpk and entering all that info by hand each time is too much work
# 17:27 tantek aaronpk, in my approach, I would add that to my venue cache
# 17:27 tantek along side the venue's @-name, the address
# 17:27 aaronpk yeah, I need a venue cache :)
# 17:28 tantek hmm I should totally do that
# 17:29 tantek my cache is pretty small now so it's just a PHP array constant in my POSSEing code
# 17:30 tantek aaronpk, so that's how I got away with it minimally, just a URL field for venue for me to manually enter, and then the rest is automatic from the code
# 17:31 tantek right now it's not a big deal to manually add one entry at a time every time I post an indie event for a new (first time for me) venue
# 17:33 tantek I need a map view in my events for sure
# 17:34 tantek that's been an itch for a while
# 17:34 tantek hmm I wonder if I can code that by next week
# 17:38 aaronpk oh damn, I didn't notice that silopub truncated my tweet last night
# 17:38 aaronpk it counted wrong since both quill and twitter said there were 5 chars left
peterlawson[m] and [miklb] joined the channel
# 17:49 [miklb] I’ve been out of the loop for the past week or so, is there a websub server yet that’s open to accounts for using a client with?
[cleverdevil], KevinMarks and eli_oat joined the channel
# 17:59 tantek oooh I wonder if indie events POSSEd to Twitter should stash the event lat/long into the tweet location
# 17:59 tantek I mean, if I'm tracking this info, might as well put it there right?
# 18:00 sknebel [miklb]: I think for now the protocol is still "ask nicely here and hope someone gives you an account", there is no officially open server
# 18:02 aaronpk sknebel: thanks! I think I fixed it
# 18:03 aaronpk I forgot that I was using the channel UID as a path component of the URL in monocle
# 18:03 GWG aaronpk, worth implementing venue support as a Micropub server extension?
# 18:03 aaronpk GWG: yeah i'm hoping to, not sure where that falls on my priority queue tho
# 18:04 sknebel GWG: yeah, lookups like that have been proposed a few times but I don't know any implementation (tags, nicknames, venues are the ones that come to mind)
# 18:04 tantek aaronpk, what's better to put in a venue cache? address (street, locality, region), or latlong?
# 18:04 aaronpk address for human-readable, latlong to be able to easily put a dot on a map
# 18:05 aaronpk converting latlng to address is ambiguous at best, and converting an address to latlng is expensive (sometimes actual money)
# 18:05 tantek aaronpk, what is the use case for each?
# 18:06 tantek if it's just map/directions display (ala /event ) then address is sufficient right?
# 18:06 tantek what does the tweet API need or can take for location info?
# 18:06 aaronpk pretty sure twitter accepts lat/lng only
# 18:07 aaronpk i like showing a map preview on my website, so i need to either store the latlng, or generate the map once from the address lookup and store the image
# 18:07 tantek aaronpk I've seen tweets with named venues though
# 18:07 tantek which they seem to get from the Foursquare API
# 18:07 tantek hmm I want some simple code to generate a map view
# 18:08 aaronpk they use place_id or lat/lng or both
# 18:08 tantek is the place_id the *foursquare* place_id? or do they map to some internal place_id?
# 18:08 aaronpk if you want a JS map take a look at leaflet, they have some pretty simple code
strugee joined the channel
# 18:11 tantek yeah that might be easiest / least impactful serverside in terms of perf
# 18:12 tantek and fallback to a Google maps link in case of NoJS
# 18:13 tantek which I believe are fairly easily constructable
# 18:13 tantek I mean from the address
# 18:13 aaronpk i think q works with an address too
# 18:14 tantek I dislike lat long for Google maps links because to human in cities it's often ambiguous
# 18:14 tantek especially in multifloor buildings
# 18:14 tantek in fact IMO Google maps links with a lat long are a bit of a UI anti-pattern
barpthewire joined the channel
kaushalmodi joined the channel
# 18:36 tantek in answer no - twitter place_id is not even close to same / similar to Foursquare's hex ids
# 18:38 tantek I'm wondering if Twitter is just creating place_ids on demand and has a mapping from their place_id to Fousquare's
# 18:42 sknebel snarfed: add that snippet to the /Twitter page, which doesn't seem to mention granary at all yet?
# 18:42 snarfed sure, will add to my list
# 18:48 Loqi [gRegor Morrill] Facebook, I have never even heard of these organizations much less been a customer. I manually removed at least 100 of these from my Ad Preferences page recently and now there are these 15. What are you doing?
# 18:49 sknebel yeah, the idea is clever. not a fan of them trying to make business out of it though
# 18:53 skippy boo: the Twitter export uses t.co links in the "source" field, and derefernces them in a separate "expanded_urls" field.
# 18:53 kaushalmodi About plus codes, forgot to add that that example showed just Newyork; you can zoom down to a city block level resolution by adding the trailing 2 characters
# 18:53 kaushalmodi +1 to that boo
# 18:54 tantek what3words sounds proprietary though
# 18:54 tantek also horribly English-centric goodness sakes
# 18:55 kaushalmodi One last thing about + codes: *if* you use Google Maps, you can long press on any location (Android app at least) to get that point's plus code
# 18:55 kaushalmodi very useful when coordinating with friends in an unknown city
# 18:56 snarfed skippy: yup welcome to the twitter API
# 18:56 sknebel tantek: what3words is in 22 languages already, so they are thinking aobut that
# 18:56 snarfed granary handles all that. also auto links them in its output HTML, as well as @-mentions, hashtags, etc
# 18:57 aaronpk xray can do that too in case you want another option :)
# 18:57 snarfed diversity++ yes!
# 18:57 Loqi diversity has 2 karma in this channel (5 overall)
# 18:57 aaronpk you can pass XRay tweet JSON and it'll give you a nice microformats2 JSON object
# 18:57 aaronpk it does all the photo/video URL wrangling too
# 18:57 sknebel (although it is 22 different dictionaries, not one that's directly translateable in all 22 languages)
# 18:58 skippy is xray standalone for this? i thought xray was a library
# 19:00 tantek sknebel: indeed - it would have been more interesting if they had treated it like a chance for a modern multilingual rosetta stone
# 19:00 sknebel skippy: xray is an API and a library. so you can run an xray server, or use aaronpks one, and query that, or integrate it into a PHP program
# 19:00 tantek ok so there's a chance to improve on it
# 19:00 tantek (on the positive side)
# 19:00 snarfed skippy: both granary and xray are both libs and hosted REST services
# 19:01 Loqi [aaronpk] XRay: X-Ray returns structured data from any URL
[kim_landwehr] joined the channel
# 19:01 [kim_landwehr] Asocial is a markdown-based, Dropbox-enable website hosting which is still in beta.
# 19:02 kaushalmodi snarfed: granary.io looks so much like brid.gy. No wonder you created that too! :)
# 19:03 Loqi snarfed has 54 karma in this channel (373 overall)
# 19:03 snarfed thanks kaushalmodi! heh yes i'm mediocre (if not worse) at design and UI
# 19:03 skippy thank you, aaronpk and snarfed.
# 19:03 sknebel what is Asocial?
# 19:03 sknebel [kim_landwehr]: now say the definition again ;)
# 19:06 [kim_landwehr] Asocial is a markdown-based, Dropbox-enable website hosting which is still in beta.
# 19:07 [kim_landwehr] Thanks @sknebel, saw the question as I was scrolling, not sure how to handle it
# 19:09 tantek aaronpk, as a geo expert, WDYT of this "The square size of 3m x 3m is consistent across the globe" - from what I know I have a hard time understanding how that's possible in any reasonable transformation / projection
# 19:09 tantek unless they're redefining "meter" lol
KevinMarks joined the channel
# 19:12 KartikPrabhu tantek: yeah that is not possible/bad wording. There are equal-area projections but they will distort the shape of a square
# 19:13 KartikPrabhu i.e. there is no isometry from a 2-sphere to the 2-plane ;)
# 19:14 sknebel they optimize it for correctness in longitudes <85°
# 19:14 sknebel and it's not a strict grid
# 19:14 KartikPrabhu right it can't be :P
# 19:15 sknebel so there is offsets between the "rows"
# 19:27 tantek sknebel ugh that is really ugly then
# 19:29 sknebel very much a black box for these specific constraints
# 19:31 Loqi [gRegor Morrill] What is Digg going to do to make sure this link (this discussion) still exists in 5 years?
KartikPrabhu joined the channel
# 19:45 skippy are there instructions somewhere for using Granary to get ALL my tweets? using the site, I get back to November 2017.
# 19:46 tantek skippy: better to use Twitter's own export functions
# 19:46 tantek what is how to export
# 19:46 Loqi export (specifically, How to export your data) in the context of the indieweb refers to the ability to download some or all of your data from a site, typically from a silo, though also for CMS or site migration https://indieweb.org/how_to_export
# 19:46 tantek should be links there ^^^
# 19:46 snarfed agreed. skippy: you can page in granary, but it's not designed to get a full archive
# 19:47 skippy i used the Twitter archive, and have JSON and CSV representations. Can I feed all that JSON to Granary somehow?
[snarfed] joined the channel
# 19:52 Loqi [snarfed] for granary, it's just `microformats2.object_to_html(twitter.Twitter().tweet_to_object(tweet_json))` for each tweet
# 19:53 skippy oh. thanks. i'll give that a try.
eli_oat, KevinMarks, [Vanessa], tantek, [miklb] and snarfed joined the channel
# 20:24 skippy snarfed: my Python-fu is very weak. Can I pester you for some additional hand holding?
[cleverdevil] joined the channel
# 20:24 Loqi [Jonathan LaCour] Going Serverless with Python WSGI Apps
# 20:24 snarfed skippy: sure! busy right now but i can reply async
snarfed, tomasparks and KartikPrabhu joined the channel
# 20:47 skippy `ValueError: time data '2009-01-31 00:00:00 +0000' does not match format '%a %b %d %H:%M:%S %Y'`
snarfed joined the channel
# 20:49 sknebel can you post the full stacktrace somewhere?
snarfed and treora joined the channel
# 20:58 sknebel ugh, do they seriously use a different format than in the API for the export?
# 21:00 radedwork wow firebase dynamic links sound like a principal of least surprise disaster
# 21:01 radedwork principle* (I can English good)
KartikPrabhu joined the channel
# 21:04 gRegorLove what is goo.gl?
# 21:05 skippy sknebel: these are from 2009, likely they changed a lot along the way, and never applied the new formats to the old data.
snarfed and [kevinmarks] joined the channel
# 21:10 [kevinmarks] I went through a lot of this geo stuff earlier this week. Leaflet is very easy, and has a great choice of image tile sources. What3words is worse in every way than geo urls. If you want a good name to lat long service or vice versa use foursquare
snarfed and [snarfed] joined the channel
# 21:26 [snarfed] skippy: ugh yeah, try with a newer export
snarfed, renem and tomasparks joined the channel
# 21:37 skippy snarfed: this is an export from today. the posts are from 2009.
# 21:37 skippy i could always try to massage the created_at date in the object before feeding it to tweet_to_object, I suppose...
[Vanessa] joined the channel
# 21:40 [kevinmarks] The pre 2009 dates are broken in the export . You may be able to fix them by looking up the tweet I'd at twitter
leg and KartikPrabhu joined the channel
# 21:44 snarfed ah ok skippy. interesting. thanks [kevinmarks]!
snarfed and [miklb] joined the channel
# 21:54 skippy oh, interesting. even the tweets from 2018 in this export have the same date format as the 2009 ones: "created_at" : "2018-03-01 14:24:51 +0000",
# 21:56 snarfed yeah and the API always returns "Tue Mar 21 20:50:14 +0000 2006" , both pre and post 2009 (ie ctime format)
# 21:56 snarfed so the export may be a different format entirely than API
# 21:57 snarfed i have an old export from 2013, looking now
# 21:58 snarfed skippy: are they still in data/js/tweets/YYYY_MM.js files?
# 21:59 snarfed looks like they are normal API objects, only the dates are different. weird.
# 22:01 [kevinmarks] The old ones are all at midnight iirc
# 22:02 skippy yes; and the date has dashes instead of spaces as expected by Granary
# 22:04 snarfed confirmed, only the dates are different, everything else works. i can whip up a fix now
tbbrown joined the channel
# 22:16 snarfed ok skippy, i've pushed the fix. try reinstalling with pip install -e git+git@github.com:snarfed/oauth-dropins.git#egg=granary
# 22:16 snarfed (tested locally)
# 22:19 snarfed odd. feel free to post one tweet from your archive and i can double check
# 22:20 snarfed oh sorry, that pip install was wrong
# 22:20 skippy Obtaining granary from git+git@github.com:snarfed/oauth-dropins.git#egg=granary Cloning git@github.com:snarfed/oauth-dropins.git to ./src/granary Running setup.py (path:/Users/smerrill/Downloads/twitter/src/granary/setup.py) egg_info for package granary produced metadata for project name oauth-dropins. Fix your #egg=granary fragments.
# 22:20 snarfed right, heh. try pip install -e git+git@github.com:snarfed/granary.git#egg=granary
# 22:20 skippy thought i did...
# 22:20 snarfed slightly different cmd
# 22:21 snarfed s/oauth-dropins/granary/
# 22:22 skippy it worked. Thank you!
# 22:22 Loqi does a happy dance!
snarfed and EmreSokullu joined the channel
# 22:49 aaronpk sknebel: out of curiosity, why did you end up using URLs for the channel uids?
# 22:56 aaronpk hm something's going wrong with my granary jsonfeed conversion again
# 22:56 aaronpk it's adding a title for my notes which have the <br> whitespace removed
EmreSokullu, [miklb] and [snarfed] joined the channel
# 23:11 [snarfed] ruh roh. about to get in the car, but feel free to fill an issue!
# 23:29 sknebel aaronpk: I'm not using urls strictly, but inoreader uses something that looks like a URL path as their id's for channels
# 23:29 sknebel and I wanted to just pass these through
# 23:56 sknebel dealing with feeds that are not in channels is something I'll have to figure out, not sure what I want to do there. either synthesize a catchall channel, or turn each of them into their own channel. UI and model just don't match up, at least with the microsub readers we have now