#dev 2021-08-04

2021-08-04 UTC
jacky, Seirdy, KartikPrabhu, Stasimon and capjamesg joined the channel
#
[snarfed]
#hugops [jacky], hope https://jacky.wtf/ is back up soon!
#
capjamesg[d]
Do full text search engines typically index whole pieces of content?
#
capjamesg[d]
I am only indexing titles, headings, meta descriptions, and keywords on my blog search engine.
#
capjamesg[d]
This came to mind last night but I haven't made a decision because I wondered how this would impact performance.
#
capjamesg[d]
(with sqlite, that is)
#
[snarfed]
yes, full page text is indexed. that's pretty key
#
[snarfed]
it's unlikely that you have enough content to hit scaling or performance issues, but the way to find out is to measure 😁
#
capjamesg
Indeed!
#
capjamesg
I have been using a few tools to find keywords and just indexing those instead of the whole page.
#
capjamesg
(as well as the other factors I mentioned earlier)
neceve joined the channel
#
capjamesg
Algorithmically, how could I weigh non-archive pages over archive pages?
hendursa1 and petermolnar joined the channel
#
vikanezrimaya
I knew it! I knew streams in Rust had a try_collect() method, they must've had one!
#
vikanezrimaya
Before that I was trying to panic inside a stream and then catch unwinding the stack outside to see if an error occured
#
vikanezrimaya
I couldn't even know which error it was
#
vikanezrimaya
And I'm pretty sure that a database connection used inside the stream might not've been properly returned into the pool, causing pool exhaustion and subsequent database connection errors!
#
vikanezrimaya
The code even type-checks, so it must compile. I have to try it in production to see if it's effective
#
vikanezrimaya
And people call me smart. No, I do things in ways people are not supposed to do things, which is clearly indicated in the documentation for the methods I use to do things
#
vikanezrimaya
catch_unwind() literally says "do not use this to catch recoverable application errors"
#
vikanezrimaya
And I still used it and successfully pierced my foot with it, resulting in my application needing restarts roughly every other day
#
vikanezrimaya
And people call me smart
KartikPrabhu joined the channel
#
vikanezrimaya
I really wanted to do some frontend work today but I fixed a backend bug instead. Accidentally.
#
vikanezrimaya
I just wanted to see if post["properties"]["author"] gets autoexpanded for presentation
#
vikanezrimaya
(it does not, but I could probably fix it)
chee joined the channel
#
vikanezrimaya
https://fireburn.ru/posts/kittybox-db-connection-leak - here's a somewhat technical explanation of what I've done wrong
#
vikanezrimaya
if someone's interested
#
Loqi
Ok. Past me made the dumbest mistake ever of ignoring documentation and using `std::panic::catch_unwind()` to catch a general application error. Basically I got resource exhaustion in the database connector and my website couldn’t connect to the da...
shoesNsocks and rockorager joined the channel
#
hala-bala[m]
Is there good tutorial how to obtain token with help of indieweb ?
#
rockorager
I think I (finally) have the two main things I wanted to get done for a "minimal" config indieweb starter site: self-hosted webmentions and micropub. If anyone wants to "alpha" test it, here's the site: https://11ndieweb.netlify.app/
#
hala-bala[m]
I am trying to create extention and I would like to authenticate to be able to use my micropub instance
#
Loqi
[Tim Culverhouse] 11ndieWeb
#
rockorager
The main thing is you'll need a Github Personal Access Token once you click the Deploy to Netlify button
#
Loqi
[Aaron Parecki] How to Sign Users In with IndieAuth
#
hala-bala[m]
that will do, thank you aaronpk
#
rockorager
It has self-hosted webmentions with configurable "accepted domains", so once I get around to building the API, it could also serve as a single-click self hosted (well, Netlify hosted) webmention receiver for any domain
#
hala-bala[m]
rockorager: I will check it out for sure, I am running 11ty myself so I might take some parts.
#
hala-bala[m]
Has anybody developed private blog channels and has written about it ? Kinda like, post you want to share only with family/friends etc.
#
rockorager
I wrote the endpoints as an 11ty plugin (eleventy-plugin-11ndieweb), which basically just gives you the lambda function for the webmention and micropub endpoints
#
rockorager
The catch is that there is basically no config for a different folder structure (yet?) for the way micropub saves your files
#
hala-bala[m]
rockorager: I can modify that if anything. I have been pretty happy with https://github.com/getindiekit/indiekit for that.
#
Loqi
[getindiekit] indiekit: An IndieWeb publishing toolkit
#
rockorager
Indiekit is definitely more polished than this! :)
hendursaga, rockorager, hendursa1, [grantcodes], [jeremycherfas] and shoesNsocks1 joined the channel
#
hala-bala[m]
aaronpk: how do you deal with cors ? how do you fetch links without hitting cors issues ?
#
hala-bala[m]
when doing link discovery on website
#
aaronpk
i don't write javascript apps :P
#
hala-bala[m]
do I really need to create server to get html to get links to be able to use them ?
#
aaronpk
if you're talking about for indieauth, it's only fetching content from the site the user themselves is using, so you could have that site send CORS headers to allow all requests
#
aaronpk
there are some JS indieauth clients already
#
hala-bala[m]
is there microservice which takes website url and returns array of micropub, indieauth endpoint etc ?
#
hala-bala[m]
Basically I am trying to authenticate user in webextention (basically js website) to be able to post content as him/her. Based on the blog you shared, I am supposed to parse html to get links for indieauth and micropub, which I feel can be done on server but not in client :/. So I might have to make server to do that part for me.
#
hala-bala[m]
and while I can allow no cors on my own website, if I want to publish the extension, I don't expect people to fiddle cors options.
#
hala-bala[m]
yea, same issue ```Client side useage
#
hala-bala[m]
Although this library is intended to be usable client side you will likely run into CORS issues so be careful about that.```
#
hala-bala[m]
but I think I can take auth endpoint and micropub as settings value and jump over this proccess.
#
aaronpk
yep that works too
hendursaga joined the channel
#
[aciccarello]
Nice work on 11ndieweb rockorager++
#
Loqi
rockorager has 3 karma over the last year
jacky joined the channel
#
[jacky]
has been requested
#
[jacky]
[snarfed] oh yes, thank you!
KartikPrabhu, neceve and capjamesg joined the channel
#
capjamesg
I have made a few style changes to my blog to make text easier to read. Would someone be willing to take a quick look to see if anything sticks out as an issue?
#
GWG
The skip to main content link is something I normally see hidden for screen readers
petermolnar, jacky, KartikPrabhu, chee and rockorager joined the channel
#
jacky
how 'taboo' would it be to have a Micropub endpoint support CORS?
#
jacky
I guess this is a 'security' question
#
[snarfed]
seems pretty necessary for writing a JS-based client
#
jacky
will note that that _is_ a requirement
#
jacky
hmm okay
#
jacky
I ask because I don't see a lot of them outside of [grantcodes]'s setup
#
jacky
that said, that works nicely with it enabled
BinarySavior joined the channel