Skip to main content

One post tagged with "Streams"

Append-only logs, consumer groups, and event streaming.

View All Tags

Redis Streams, Natively: Append-Only Logs, Consumer Groups, and Blocking Reads

· 6 min read
Clustron Team
Distributed Systems Engineering

A native, replicated append-only log with consumer groups and blocking reads in Zaris

Zaris already speaks in collections — hashes, lists, sets, and sorted sets that live on the server and replicate like any other key. Streams are the fifth kind, and they're the one that turns Zaris from a store into a piece of messaging infrastructure.

A Zaris stream is a real append-only log: entries get monotonic IDs, you can read ranges, and you can attach consumer groups so a pool of workers divides the log between them, tracks per-consumer pending entries, and acknowledges what it has processed. You can also do a blocking read — a consumer parks and waits until new entries arrive instead of hot-looping.

And because it's a native Zaris collection, the log is partitioned and replicated exactly like everything else. A stream survives a node failover, which is the whole reason to reach for durable messaging in the first place.