#dev 2022-06-30
2022-06-30 UTC
jacky, geoffo_, gxt and nertzy joined the channel
# 
gRegor indiewebify-me PR for review: https://github.com/indieweb/indiewebify-me/pull/101
jacky, geoffo, strugee, [jamesg483] and gxt joined the channel
# 
@DavidDarnes This was a nice problem to have. Had to fix my webmention comments on my posts because people were sharing useful links. All fixed now:
https://darn.es/you-should-add-a-generator-tag-to-your-eleventy-site/#comments (twitter.com/_/status/1542419470194442242)
# 
IWDiscordGateway <capjamesg> KevinMarks I already expose last_crawled dates on IndieWeb search "search for "last_crawled" in this JSON file:
# IWDiscordGateway <capjamesg> To access, append &format=results_page_json to the end of any query.
# IWDiscordGateway <capjamesg> I'm not sure if this data is fully backfilled.
# IWDiscordGateway <capjamesg> Is a first_crawled helpful?
angelo, jeremycherfas, [grantcodes], gRegor, tetov-irc, mro, nertzy, jacky and [snarfed] joined the channel
# [snarfed] capjamesg I use https://cloud.google.com/logging/ to capture Bridgy's logs, but there are lots of similar monitoring/observability tools. New Relic, Datadog, Splunk, Honeycomb, etc
geoffo and jacky joined the channel
# IWDiscordGateway <capjamesg> snarfed Do you serve those logs from the brid.gy web interface (i.e. the ones that shows whether retrieving a Tweet was successful)?
geoffo joined the channel
jacky joined the channel
# IWDiscordGateway <capjamesg> Fascinating! That might solve this issue for me!
# IWDiscordGateway <capjamesg> How do you store logs in terms of what goes into each file?
gRegor, geoffo, AramZS and [hollie] joined the channel
# IWDiscordGateway <capjamesg> [snarfed] Wow. This makes logging so much easier.
# IWDiscordGateway <capjamesg> Context: I'm planning on making IndieWeb Search crawl logs public.
jacky and AramZS joined the channel
# 
jacky might be interesting to some https://fedidcg.github.io/fedidcg-report.html
# IWDiscordGateway <capjamesg> [snarfed]
# IWDiscordGateway <capjamesg> [snarfed] Are POST requests rate limited?
# IWDiscordGateway <capjamesg> Never mind. The issue I was having was caused by instantiating the logger too many times.
# IWDiscordGateway <capjamesg> This is going to be really difficult...
# IWDiscordGateway <capjamesg> I have a system through which I can query a domain and return logs. But, it takes 7 seconds to retrieve 200 lines of logs from Google Cloud.
# 
[KevinMarks] Another thing to look at for performance logging is honeycomb.io
AramZS joined the channel
jacky and gxt joined the channel
# gRegor Maybe not spam bot, looks like a twitter account to test gatsby webmention, though the profile URL doesn't work now. https://twitter.com/gtsb_webmention
# IWDiscordGateway <capjamesg> "Is this webmention spam?" 😂
# IWDiscordGateway <capjamesg> [snarfed] Thank you for sharing!
# IWDiscordGateway <capjamesg> Based on my intended use case, it might be quite difficult to work with GCP.
# IWDiscordGateway <capjamesg> (i.e. see all crawl logs for a domain in the last three months)
# IWDiscordGateway <capjamesg> The alternative is for me to store them locally.
# IWDiscordGateway <capjamesg> But that limits my capacity to search them without starting an ELK sort of thing 😂
# gRegor Thanks for the review, jacky. Updated https://github.com/indieweb/indiewebify-me/pull/101. Think someone with write access also needs to make an approving review, then it can be merged.
# IWDiscordGateway <capjamesg> Has anyone played around with fly.io?
# 
[schmarty] i just migrated a Rails app to fly.io. i also used to use fly.io as a custom domain proxy in front of a glitch.com app (they have since made custom domains a part of glitch so i dropped that)
tetov-irc and AramZS joined the channel