TigerBeetleDB

[nelsonic]

Definitely don't get distracted with this one. I'm just opening to have a reference to return to later ...
Especially if you didn't study accounting ... 🤓

https://tigerbeetle.com/

TigerBeetle - A Million Financial Transactions per Second in Zig

https://github.com/tigerbeetledb/tigerbeetle/blob/main/docs/DEEP_DIVE.md

[nelsonic]

Looks like we might be using this ... 💭

QCon London '23 — A New Era for Database Design with TigerBeetle: https://youtu.be/_jfOk4L7CiY

The FASTEST and SAFEST Database: https://youtu.be/sC1B3d9C_sI

[nelsonic]

Jepsen test: https://jepsen.io/

[nelsonic]

I've gone down the Zig rabbit hole again ... https://ziglang.org/documentation/master/ 🐇 🕳️ 🙄

[LuchoTurtle]

I had no idea the fsync issue was so compromising to data integrity and fault tolerance, especially in distributed systems. And to think that major DBs like Postgres simply "band-aid"d' it is incredible.
I don't know how recurring bitrot issues may occur on disk, but even if it's rare, the consequences are too big just to be "brushed aside".

I like the two write-ahead log approach TigerBeetle has to recover from these scenarios and to address their threat model. Although the reliance on io_uring raises some security concerns, personally.

[nelsonic]

@ndrean mentioned building an Elixir client for TigerBeetle in dwyl/learn-zig#1 (comment)
@rbino has: https://github.com/rbino/tigerbeetlex which looks promising:

Ref: dwyl/learn-tigerbeetle#1 ⏳

[rbino]

I'll put a small disclaimer since I've been mentioned 😄 The project is functional but a little out of date, I was waiting for the Zig 0.12 update to land in TigerBeetle to pick it up again, then Zig came up relatively quickly with 0.13 so I have some backlog to handle.
Basically the project should work correctly for creating Accounts and Transfers with a certain version of TigerBeetle (it should be mentioned in the commits/used in CI) but it doesn't support the new get_account_balances and get_account_transfers queries and their filters. PRs are of course welcome.

Also, since I'm recently going down the Ash rabbit-hole, I was intrigued by the idea of doing a TigerBeetle data layer and/or see if it was possible to use TigerBeetle to back ash_double_entry.