Resin: a Rust core so coding agents can build fast LLM inference engines
Eric Zhang's Resin keeps scheduling, caching and serving in a shared Rust core, so you or an agent write only each model's forward pass and kernels.
Wildness 3/5 · Partly tamed
Topic · 5 stories
cuda
5 stories tagged cuda on AI Tamer, newest first.
Respan releases Span-02 weights that run only on its Rust and CUDA server
Respan's 15 October post releases Span-02. The card says the weights run only on its Rust and CUDA engine, on Blackwell GPUs.
Wildness 3/5 · Partly tamedmistral.rs merges Qwen3.8-Flash-Next model support (#2462)
EricLBuehler/mistral.rs (not Mistral AI) merged PR #2462 on 2026-10-01: Qwen3.8-Flash-Next from safetensors and GGUF with built-in MTP. Not a new release tag. Paged attention requires CUDA; FP8 KV / TP / GGUF MTP / external drafters unsupported.
NVIDIA introduces CUDA Rust: cuda-oxide (SIMT) and cutile-rs (Tile)
A dated brief on NVIDIA’s Sep 2026 CUDA Rust post: two early-stage kernel tracks — cuda-oxide (SIMT, early alpha) and cutile-rs (Tile) — neither production-ready. Correctness demo only; no perf claims.
Wildness 2/5 · Mostly tamedmistral.rs 0.9.3 adds FP8, DFlash, and NVFP4 serving paths
A dated changelog brief on Eric Buehler’s mistral.rs v0.9.3 (tagged 2026-09-07): FP8 and DFlash decode, NVFP4 with cuTile Blackwell, and stronger Anthropic Messages / Claude Code server support. Not affiliated with Mistral AI.
Wildness 1/5 · Tamed
