LiteLLM swaps its 18,000-line Python router for a Rust core in a dev pre-release
LiteLLM merged a Rust router core, deleted the Python router and moved proxy Redis traffic to Rust. It ships in v1.110.0-dev.1, not a stable release yet.
Topic · 8 stories
8 stories tagged redis on AI Tamer, newest first.
LiteLLM merged a Rust router core, deleted the Python router and moved proxy Redis traffic to Rust. It ships in v1.110.0-dev.1, not a stable release yet.
Pipelining cuts Redis request round trips, while MULTI/EXEC controls whether a group runs without another client interleaving. Choose by the state guarantee each operation needs.
A Lua script can keep a Redis read-and-update decision together, but every millisecond of execution holds up other server activity. Bound the work before using EVAL.
Redis memory pressure can evict a cache key or reject a write. Choose the policy by deciding which data may disappear and how the application handles a full instance.
Redis advisory CVE-2026-81934 (Aug 28, 2026): authenticated TLS pending-data use-after-free; public CVSS revised 9.8→7.5 High. Upgrade OSS/Software builds; Cloud Essentials patched, Pro underway.
Redis operator 7.22.2-45 (Sep 2026) fixes a high-severity Active-Active bug: GitOps/config updates could send an empty password—DB stayed healthy while accepting unauthenticated clients. No CVE for this bug.
Redis 8.4 adds optional CLAIM min-idle-time on XREADGROUP—claim idle PEL entries then read new ones in one command (shared COUNT). Idle ms + delivery count come back when CLAIM is used; XACK still required. ~22.5× vs XAUTOCLAIM is Redis-reported on their stress setup.
A practical guide to using Redis for response caches, request limits, agent queues, session memory and vector retrieval, with the correctness and licensing trade-offs to check first.