#dev 2021-07-03

2021-07-03 UTC
poftto, jeremycherfas, Seirdy and [chrisaldrich] joined the channel; poftto left the channel
#
GWG
Spent some time updating Ticket Auth to match some of the other specs in format. Good way to think about it in detail
samwilson joined the channel
#
batkin[m]
Awesome!
hendursa1, capjamesg, Seirdy, [jgmac1106] and jeremycherfas joined the channel; KartikPrabhu left the channel
#
aaronpk
oh no, i can't figure out how to make a new foursquare application
#
aaronpk
i might be in some legacy state on my account
#
aaronpk
but i'm not sure it's possible for people to make apps or get access tokens for their own accounts anymore
#
aaronpk
would anyone care to try this out? visit https://foursquare.com/developers/apps and let me know if you have a way to make an app
#
aaronpk
(I'm writing up instructions for using my check-in import script but it won't be very useful if you can't get an access token...)
#
GWG
Trying now
#
GWG
I don't see a button. I have one app I created for testing
#
aaronpk
ah, on the new "Personal" (free) account there is a 1 app per account limit
#
aaronpk
so i'm guessing they hide the "create app" button once you've hit the limit
#
GWG
Isn't 1 enough?
#
aaronpk
that just explains why i don't see the create app button
capjamesg and [manton] joined the channel
#
[manton]
Just to confirm, I see the same thing. I’m interested in checking your script when you’re ready, too!
#
[manton]
I’m bummed that the Foursquare export doesn’t seem to work anymore. I’m planning to remove the Foursquare import feature in Micro.blog and replace it with… something. Maybe just hitting the API.
#
[manton]
I guess the fact that they have a paid API tier is a good thing in terms of supporting the API for the long-term.
#
aaronpk
i requested my foursquare export too but still haven't received anything
#
aaronpk
the good news is the api method works fine
KartikPrabhu joined the channel
#
aaronpk
it'd definitely be possible to turn what i've done into a web service, i just don't think i am motivated enough to do that
#
[manton]
Yeah. The API limits also make it a little trickier.
#
aaronpk
and it'd require a lot of UI work for reporting progress/status/errors
hendursaga and [jgmac1106] joined the channel
#
aaronpk
hmm now the question is do i also import past comments on these checkins?
hendursaga joined the channel
#
aaronpk
eh too complicated i think
capjamesg joined the channel
#
aaronpk
this is getting to be enough work just to publish this script itself
#
aaronpk
now i'm wondering how to handle photos
#
aaronpk
my website will import any photo URL in the micropub request, but i'm not sure other peoples' will do that
#
aaronpk
which i suppose means i should upload the photos to the media endpoint and replace the URLs with the URL from the media endpoint
[schmarty] joined the channel
#
[schmarty]
aaronpk: my site would use the photo URLs in the Micropub request as-is.
#
aaronpk
👍 that is kind of what i assumed
#
[schmarty]
(Something I've thought about updating precisely for ownyourswarm)
#
aaronpk
i forgot that ownyourswarm doesn't do media endpoint handling at all
#
[schmarty]
The only "handling" around incoming files on my Micropub endpoint is if a client doesn't support media endpoint and uploads them directly to my Micropub endpoint. In that case it'll upload and use the new URL.
#
aaronpk
well this import script now pushes the files to the media endpoint first
#
GWG
aaronpk: This will help a lot of people
#
aaronpk
fewer than i would like probably
#
aaronpk
because it's a bit of a pain to set up
#
GWG
This weekend I need to prototype a ticket endpoint
jamietanna joined the channel
#
jamietanna
Aaronpk I require `photo`s to be from a set of domains I trust so often it's better to just upload it
#
jamietanna
At the media endpoint then reference it*
#
aaronpk
so the next question is whether i should build in any sort of state into this script. right now it publishes all the checkins in one go, and has no way to keep track of whether a checkin has already been published
#
aaronpk
so if you run it twice you'll get duplicate posts...
#
aaronpk
now that i'm saying this out loud i am pretty sure i need to do better
#
aaronpk
these are the things that make open sourcing this kind of stuff take so long 😂
#
GWG
aaronpk: You could add a date range argument or check if it's in the directory
#
aaronpk
i made it save the published URL into the folder so it knows if it's published a checkin now
#
aaronpk
i think i'm ready to try this with my site now!
#
aaronpk
oh why did that get marked private
#
aaronpk
because i checked in privately apparently
#
aaronpk
the downside to not having imported these ages ago is the venues that got renamed mean the history is wrong :(
capjamesg joined the channel
#
aaronpk
well this is working great! time to let it run!
chenghiz_ joined the channel
#
aaronpk
this is very cool
#
aaronpk
oh man the venue renames are killing me though
#
aaronpk
so. many. checkins.
#
sknebel
guess for common ones you can mass-edit them
#
sknebel
wonder if there is some source to pull history from
#
aaronpk
yeah i think i'm going to end up scripting the edits for a few of the main ones i am finding, but there isn't even a good way to know if a venue has been renamed
#
sknebel
does the internet archive have old versions of venue pages?
#
aaronpk
oh gosh
#
sknebel
since the internet didn't get the "please expose history" memo, one needs to look for workarounds :D
[manton] joined the channel
#
[manton]
That’s annoying that venues are renamed… I didn’t even know that was a thing that happened.
#
aaronpk
yeah it's useful for like fixing typos, but often people will rename a restaurant/bar when it gets changed to something else even tho you could argue that it's a totally different venue now
#
[manton]
One of the things I’m working on is automatically organizing check-ins by state or country into categories… Still have a lot of data to sift through but it’s nice if I remember I went somewhere but can’t remember when or where exactly. 🙂 e.g. https://manton.coffee/categories/washington-dc/
#
aaronpk
i've always wanted to do that, but canonicalizing place names is not trivial
#
aaronpk
e.g. Düsseldorf vs Duesseldorf
#
aaronpk
also is the seattle airport in seattle or seatac?
#
sknebel
Düsseldorf you can at least replace all Duesseldorfs with it
#
aaronpk
yes it just means i need some code somewhere to canonicalize via some list of rules like that
#
sknebel
or have you actually been in a "Duesseldorf" thats a separate thing?!
#
aaronpk
there's also the places that use other alphabets
#
sknebel
yeah, there its harder.
#
batkin[m]
I've been in Düsseldorf as well
#
aaronpk
Nuremberg vs Nürnberg is also a weird one
#
[manton]
Yeah, there are probably lots of little edge cases… All I really want is to be able to say “show me places in Oregon I’ve been to” and scroll through. A nice overview map would be a bonus but probably not worth it for me.
#
batkin[m]
Both the airport and the area near the Hauptbahnhof
#
aaronpk
i'm pretty sure the way i will end up doing it is searching for nearby checkins based on lat/lng
#
aaronpk
so if i type in a city name, it'll first geocode that, then search for nearby things
#
[manton]
I really wish I had my check-ins from Gowalla circa 2008 or whenever. All that data is gone. (Silos!) I didn’t switch to Foursquare until 2010.
#
aaronpk
but i don't have a good plan for making URLs for cities
#
sknebel
if you have lat-long for everything, map view + "list everything in view port" might be easier?
#
[manton]
[aaronpk] Thanks for publishing your script! Nice that it’s in 3 separate steps.
#
[manton]
It’s downloading my check-ins now. Looks good!
#
aaronpk
weird, there were a bunch of gaps in my website history from the beginning of ownyourswarm
#
aaronpk
that was some careful surgery i had to do but i think i filled it all in now
#
aaronpk
now i have to let my website run all the background jobs for the 7 years of posts i just imported :D
#
aaronpk
lots of map images to create and potential webmentions to be sent
Seirdy, [tantek], alex11 and [schmarty] joined the channel
#
[schmarty]
aaronpk++ pretty rad!!
#
Loqi
aaronpk has 50 karma in this channel over the last year (139 in all channels)
#
[schmarty]
aaronpk++ again i was able to get this set up and downloaded all my checkins and photos so quickly!
#
aaronpk
oh yay
#
aaronpk
hopefully you can think of something to do with the pile of json files it makes!
#
[schmarty]
need to find the dividing line on which to actually upload, heh.
#
[schmarty]
this is great because i had used perkeep (previously: camlistore) to backup my 4sq checkins, because it has a pretty good importer that uses the API. however, i always find it challenged to get stuff _out_ of camlistore so this is like 100x faster. 😅
#
[schmarty]
*challenging
#
aaronpk
there's something to be said for just files
#
[schmarty]
ooh looks like maybe i can create .txt files for all my existing checkins so prevent dupes 🤔
#
aaronpk
oh yea sure!
#
[schmarty]
haha, _yeeeessss_. all ownyourswarm checkins on my site have a syndication URL which includes the checkin ID as the last path segment. this should be something i can script up without too much heartbreak.
#
aaronpk
heartbreak??
#
[schmarty]
sitebreak? 😜
#
[schmarty]
oh, (potentially) even better. the .json files are organized by yyyy/mm/dd/hhmmss.json just like my posts 😂
#
[schmarty]
ha, or i could just move aside all checkins after 2017, which is when i set up ownyourswarm. previously i heavily used 4sq from 2009-2012 and then _stopped for five years._
#
aaronpk
that's basically what I did, I only imported the ones from before ownyourswarm
#
aaronpk
there were a few months of weird gaps though so i did a bit of spot checking during the transition to clean things up
#
aaronpk
looks like today is an archiving day for me
#
aaronpk
now i'm moving on to instagram from my flickr archive
#
aaronpk
also thankful for my past work on the API for "Where was I when my watch read 9:30am on July 15th?"
#
[schmarty]
it is a very powerful thing.
#
aaronpk
lol well crap i don't know what timezone nonsense is going on
#
aaronpk
the photo clearly from the afternoon in SF has a date taken value of "2014-03-07 23:37:00" in flickr
#
aaronpk
so probably instagram sent a UTC date?
#
aaronpk
hm it is not consistent either. the next one had the correct local time
#
aaronpk
well this is working pretty well
[jacky] joined the channel
#
[jacky]
random thought: is it bad to have a IndieAuth service _adjust_ scopes after the fact? Like I can imagine that as a client, if an action was randomly unauthorized and it hasn't expired yet that refreshing the token's information and/or asking for a new one isn't a bad idea
#
[jacky]
I ask because I want to have my endpoint potentially adjust the permissions upstream (like if I realize that I don't want to allow something to upload to my site anymore)
#
aaronpk
that's fine
#
aaronpk
the client should be able to recognize that the operation failed and ask you to authorize it again
#
[jacky]
:smiling_face_with_tear:
#
GWG
I am still trying to figure out, once I have a ticket induced token, what to do with it other than storing it
#
GWG
I need simple proof that it works
#
aaronpk
alright, this is working swimmingly. i also realized i can do it with no additional API requests other than the search API
#
[jacky]
failed to find a way to mix swarm and swimmingly together as a joke
#
aaronpk
my script is buzzing along
#
[jacky]
aaronpk++ lol
#
Loqi
aaronpk has 51 karma in this channel over the last year (140 in all channels)
#
Loqi
misses the pebble watch https too
#
Loqi
[Aaron Parecki] Password-less logins via IndieAuth with a #pebble watch! Blog post coming soon https://aaronparecki.com/img/1240x0/2013/07/15/14/photo.jpg
#
GWG
Me too..it was good and simple
#
GWG
Did you try the pinetime?
#
aaronpk
i have not
#
aaronpk
wow this is surreal having both my checkins and photos from 8+ years ago all collected on my site now
#
aaronpk
also *wow* i used to post on instagram a lot
#
GWG
aaronpk: how many did you import total and what's still missing
#
aaronpk
it's about 700 photos that were from before ownyourgram
#
aaronpk
and 9000 checkins
#
aaronpk
aaaand done
#
aaronpk
I am free from the silos!
#
[jacky]
the goal
#
aaronpk
i'm on a roll... what else can i import
#
aaronpk
how about the songs i sang at karaoke...
#
aaronpk
what would that post type be
#
[jacky]
lol u-jam-of u-quote-of
#
aaronpk
it's somewhere between a jam, a listen, and play
#
aaronpk
omg there's start *and* end time in here
#
aaronpk
does that mean it's an h-event?
#
[jacky]
oh it _is_ a play hmm
#
[jacky]
haha tbh this is one specific heuristic
#
aaronpk
it's a performance
#
[jacky]
then def a play
#
aaronpk
there's no "play" on the wiki yet
#
aaronpk
there's jam and listen
#
aaronpk
and game play
#
aaronpk
i'm going with performance
#
[jacky]
ah gotcha
#
aaronpk
i'm not gonna put any special microformats on the published page, but i do need some vocab to store it internally
#
[jacky]
ah this reminds me, editing content is possible in Quill, no?
#
[jacky]
actually nvm lol
#
[jacky]
I can edit my posts on disk now