#dev 2019-04-05

2019-04-05 UTC
jonnybarnes, [fluffy] and eli_oat joined the channel
#
GWG aaronpk: What did you mean by this? https://github.com/aaronpk/Compass/blob/master/compass/app/Http/Controllers/Api.php#L313
jonnybarnes joined the channel
#
Ruxton pretty sure that's because the remote call to https://atlas.p3k.io/ takes a bit too long for a request loop, so run a background task to geocode incoming locations?
#
GWG I'd like to see about doing something in this vein.
[kevinmarks] joined the channel
#
GWG Okay. Storing weather for now.
eli_oat and snarfed joined the channel
#
aaronpk Yes that's because it's not a good idea to do the remote geocoding call in-line in that request
#
GWG aaronpk: Where would you put it?
#
GWG I'm looking at where I'd put weather
#
aaronpk Well the point of that one was so that the app could display the current city
#
aaronpk there's a background queue mechanism already so any stuff like that should really go there
#
GWG aaronpk: That is the thing that wasn't working for me though.
#
GWG I couldn't get the web hooks working no matter how hard I tried.
#
aaronpk I'd recommend trying to figure that out
#
aaronpk But for weather, I just have a completely separate compass database to store the weather, and the script that gathers the weather info isn't part of Compass at all
#
aaronpk I don't want to add too much fancy stuff to Compass. I want to keep it mostly as a time/location-based database
#
GWG aaronpk: I didn't want Compass to do it.
#
GWG I was looking for a way to trigger it.
#
GWG But if I get the web hook working, I could do that.
#
aaronpk Ah yeah. If you do anything else inline like that you'll run into the same problem
#
aaronpk best to get the queue working
#
GWG Is there a way to test it, I wonder.
#
Ruxton aaronpk: have you considered using a time series db instead of MySQL for the points in time?
#
aaronpk Yes. I don't store the data in MySQL.
#
Ruxton ahh I didn't read the readme entirely ;P
jonnybarnes joined the channel
#
GWG I'm seeing the job by monitoring the redis server
#
GWG But no execution
snarfed1 joined the channel
#
aaronpk Hmm ... when you run the artisan script do you see it making any requests to redis?
#
aaronpk I also assume you've configured the .env file to use redis for the queue?
#
GWG aaronpk: Yes
#
GWG And I tried database as well.
#
GWG When I switched to sync, it worked. But that is no queue
#
aaronpk It sounds like there's something wrong with the command line environment. Do you have multiple PHP versions on the server?
#
GWG Not that I'm aware of
#
aaronpk Do any of the other artisan commands work?
#
GWG All of them execute
#
aaronpk I've never had this happen before but it's probably something silly. Have you tried searching for this problem with Lumen or Laravel?
#
GWG Yes
#
GWG Will keep trying
#
aaronpk Have you tried all the different ways of running the jobs with artisan? queue:listen vs queue:work etc
#
aaronpk one will run in the background so you won't see anything in the output and instead stuff is written to the log file
jonnybarnes joined the channel
#
GWG Yes
gRegorLove__ joined the channel
#
GWG No luck
#
GWG I am just completely stumped
#
aaronpk Can you describe what is happening when you try to run it?
cweiske and ingoogni joined the channel
#
ingoogni regarding weather, http://www.ecomet.eu/ecomet-catalogue/download-facilities
GWG joined the channel
#
ingoogni The Dutch KNMI has 10 min data
#
ingoogni url = "https://data.knmi.nl/download/Actuele10mindataKNMIstations/1/noversion/%s/%s/%s/KMDS__OPER_P___10M_OBS_L2.nc"%(Y,M,D)
#
ingoogni Hourly data http://projects.knmi.nl/klimatologie/uurgegevens/getdata_uur.cgi
#
ingoogni day data: http://projects.knmi.nl/klimatologie/daggegevens/getdata_dag.cgi
#
ingoogni several feeds https://www.knmi.nl/kennis-en-datacentrum/dataset/rss-feeds-van-het-knmi
#
ingoogni and https://data.knmi.nl/datasets
#
ingoogni then there is the WOW project http://wow.metoffice.gov.uk/
#
ingoogni https://wow.knmi.nl/over-wow-nl
#
ingoogni and knmi by ftp ftp://ftp.knmi.nl/pub_weerberichten/
cuibonobo, plindner[m], astrojuanlu[m], zoglesby, grantcodes[m], voss[m], Rixon, myfreeweb, PatrickMNiedziel, jgmac1106[m], jamietanna[m], swentel and jonnybarnes joined the channel; ancarda left the channel
#
GWG !tell aaronpk Nothing. No output. Monitoring the redis server I see the job being added in there
#
Loqi Ok, I'll tell them that when I see them next
#
GWG Morning all
#
Zegnat Do the jobs disappear from redis or keep stacking up?
#
GWG How would I check that?
#
GWG I don't see them coming up multiple times
#
GWG I tried the database queue also
#
GWG This is my first time with this system, but I have used databases and redis before
#
Zegnat I would have thought that redis would be keeping the jobs queued until they go out - and because you said you were monitoring it I thought you were seeing the jobs
#
Zegnat Its weird, I have ran queueing with Gearman and Beanstalk and never had technical problems like that with either of them
#
GWG I see them at the time they were added
#
GWG I think beanstalk is an option
#
GWG I could try switching, but if database and redis don't work as a backend, then something else is afoot
#
Zegnat Yeah, makes me think the actual workers aren’t picking up on jobs
#
GWG And what can I do about that?
#
Zegnat Unsure, especially with Lumen/Laravel which I have never used :(
#
Zegnat I usually go the manual beanstalk or gearman route. I know aaronpk uses beanstalk a lot too (e.g. it is what Watchtower uses)
#
GWG Wonder if it is worth a try
KartikPrabhu joined the channel
#
Zegnat If you are running aperture/watchtower then you know you have a functioning beanstalk, at least
#
GWG I am not
#
GWG Either way, the problem appears to be the jobs
#
GWG And there is no logging that helps
#
Zegnat And nothing is showing up in the PHP error logs? E.g. a background job is having errors but just not outputting them outside of log files
#
GWG Not a lick
#
Zegnat Crazy
#
GWG And the log, unless I use Sync, shows nothing
#
petermolnar GWG: is this via php-fpm? Sometimes it stops logging. If you restart the process, it shows logs again.
#
GWG petermolnar: It is running on the CLI
#
petermolnar oh.
#
GWG For now, I am giving up
#
GWG This is not a high priority anyway for now
#
GWG It would be nice to have the data stored, but I will just do it when I post as I have been doing
#
GWG Going back to webmentions for now
#
GWG I know how to work on that
#
GWG We seem to talk less about webmentions lately
#
GWG Wonder if that means it is mature
KartikPrabhu joined the channel
#
Zegnat I had a bit of a chat with ancarda the other day about abuse control on webmentions.
eli_oat joined the channel
#
Zegnat but overall I think people are happy about their sending and receiving, and would rather work on the next layer up
#
GWG I am working on the redoing the layer down
#
Zegnat ancarda documented his anti-abuse ideas, if you want to dive into webmention stuff again: https://github.com/ancarda/website/issues/41
#
Loqi [ancarda] #41 WebMentions with AWS Lambda
tw2113 joined the channel
#
GWG I will see
#
GWG Right now, other fish to fry
#
GWG Merging the two plugins has been on the list for ages
barpthewire and [eddie] joined the channel
#
[eddie] Ohh, Lambda?? 👀
#
Zegnat ancarda was trying to set up as much of his website over on lambda as possible, similar to you [eddie]
snarfed joined the channel
#
@freshyill Did I just restart my website and then abandon it? Absolutely not!I’ve just been busy tidying things up. I’ve made some nice improvements webmentions and added likes. Check it out! https://illtron.net/2019/04/a-few-small-site-updates/ (twitter.com/_/status/1114176974421811202)
barpthewire, [schmarty] and [jgmac1106] joined the channel
#
[jgmac1106] anyone know of a tool or way where I can add multiple opml files and remove duplicates and then get just one file?
snarfed joined the channel
#
GWG Zegnat, h-measure
#
GWG Thoughts?
#
GWG I didn't think about h-card as I was thinking weather
#
@soypunk ↩️ Ok, thanks. I’ll keep reading the source code but as you know with anything OAuth/OpenID/IndieAuth it is a bit of PITA to follow all the references around was kinda hoping someone had done my homework for me :-) (twitter.com/_/status/1114205661946998784)
tw2113, BenLubar, snarfed, leg, [jgmac1106], KartikPrabhu, [kimberlyhirsh], [eddie], swentel, [kenbauer], [shaners], [schmarty], [tantek], gRegorLove_, ichoquo0Aigh9ie, petermolnar_, wagle_, kants, strugee_, callMeBaby, blueyed, iasai and gRegorLove__ joined the channel
#
@ketudb Trying to decide: syndicate to mastodon using... something, or just expose ActivityPub direct from content in some way (e.g. http://fed.brid.gy or some other on-site impementation)? Definite pros and cons to each... #indieweb #fediverse #meta #posse (twitter.com/_/status/1114314159204622336)
#
@ketudb ↩️ I'm also trying to decide which of my content I've been working on takes the feel of a blog post vs more of a 'wiki page' on my site. Obvs either way it supports #indieweb integration and #webmentions (twitter.com/_/status/1114314272840925185)
#
@ketudb ↩️ I guess I feel like some pages are better just kept up to date, rather than done as progressive posts? E.g. how I've been building something. And I can make status posts when the page has been updated with allows for #POSSE syndication/#microsub updates? (twitter.com/_/status/1114314351605768193)