U++ forum: Welcome to the forum

Re: Key/Value store disk-based caching solution [message #52347 is a reply to message #52346]

Wed, 11 September 2019 11:42

jjacksonRIAB
Messages: 220
Registered: June 2011

Experienced Member

mirek wrote on Wed, 11 September 2019 10:20

Wrapper would be nice.

Alternatives (from the head): To cache things from the internet (or from over the network), traditional approach to cache them as files works well. Done that in the past.

For key/value storage, if I would be too lazy to use other options (like creating a wrapper), I would use Sqlite3 or MySQL with trivial schema as key/value storage.

Mirek

Yes, right now I'm caching images as files which works just fine, but there is also metadata associated with the images and text that would be very helpful to gather in a KVS. In discord each comment a person makes has a snowflake associated with it and you can start "replaying" missed content while you were offline by providing that snowflake, I believe, at which point it gives you every change made after it (edits, deletes, etc). Right now I'm doing it the "dumb" way and just asking for the last 100 posts but that is not only slow reloading every time you come back online but precludes people from going back even further in the history (pretty much everything in the channel's lifetime is saved in pages).

I think after I've gotten somewhere with it, I'll put it up on github so people can rip through it and tell me how the code can be improved. You've already helped me improve how I'm doing things quite a bit. I'll look into Sqlite3 or see if I can write an lmdb wrapper that has some method calls similar to U++ containers.

[Updated on: Wed, 11 September 2019 11:43]

Report message to a moderator