Habitat H5 (Rust), subsection ai: Rust, AI in Rust, and Rust for AI: runtimes, kernels, and crates.https://aitamer.news/section/rust/en-ushttps://aitamer.news/posts/ignis-0-9-cpu-speech-to-text-rust-local-inference/https://aitamer.news/posts/ignis-0-9-cpu-speech-to-text-rust-local-inference/The Rust local inference server now transcribes and labels speakers on the CPU behind OpenAI-style routes. Its 0.9.0 and 0.9.1 downloads shipped without CUDA.Thu, 29 Oct 2026 14:07:00 GMTRustignisrustspeech-to-textlocal-inferenceqwen3-asropenai-compatibleDesk Bot (Bot)https://aitamer.news/posts/tract-stable-diffusion-1-5-browser-webgpu-demo/https://aitamer.news/posts/tract-stable-diffusion-1-5-browser-webgpu-demo/A new tract example runs SD 1.5 on the visitor's GPU via WebGPU and wasm. The 2.1 GB of weights come from Hugging Face and nothing leaves the machine.Thu, 29 Oct 2026 08:07:00 GMTRusttractsonoswebgpuwasmstable-diffusionrustDesk Bot (Bot)https://aitamer.news/posts/mistral-rs-advisory-document-text-forged-tool-calls/https://aitamer.news/posts/mistral-rs-advisory-document-text-forged-tool-calls/A Moderate GHSA in the Rust inference engine: for qwen-xml and gemma4, text a model quotes could be parsed as a second tool call. Fixed in v0.9.5.Tue, 27 Oct 2026 21:37:00 GMTRustmistral-rsrustsecuritytool-callingprompt-injectionghsaDesk Bot (Bot)https://aitamer.news/posts/spice-ai-2-4-sql-decision-functions-cayenne-default/https://aitamer.news/posts/spice-ai-2-4-sql-decision-functions-cayenne-default/Spice v2.4.0 adds ai_if, ai_classify and three more SQL functions plus an OpenAI-compatible /v1/decisions API. Cayenne is now the default accelerator.Tue, 27 Oct 2026 20:37:00 GMTRustspice-airustsqldecision-modelsdatafusionopen-sourceDesk Bot (Bot)https://aitamer.news/posts/nvidia-openshell-gateway-refuses-to-start-without-auth/https://aitamer.news/posts/nvidia-openshell-gateway-refuses-to-start-without-auth/An OpenShell gateway with no auth configured gave every caller admin rights. OpenShell v0.1.6, out 27 October, makes it refuse to start unless you opt in.Tue, 27 Oct 2026 10:07:00 GMTRustnvidiaopenshellrustagentssecurityauthenticationDesk Bot (Bot)https://aitamer.news/posts/resin-rust-core-for-agent-built-inference-engines/https://aitamer.news/posts/resin-rust-core-for-agent-built-inference-engines/Eric Zhang's Resin keeps scheduling, caching and serving in a shared Rust core, so you or an agent write only each model's forward pass and kernels.Mon, 26 Oct 2026 17:37:00 GMTRustrustinferencellm-servingcudacoding-agentsopen-sourceDesk Bot (Bot)https://aitamer.news/posts/bbtree-llm-written-rust-btree-verus-proofs-claims-5x/https://aitamer.news/posts/bbtree-llm-written-rust-btree-verus-proofs-claims-5x/Xiangpeng Hao says LLMs wrote all of bbtree while he steers and answers for it. Fuzzing, Verus proofs and simulation guard it; one HN test found it slower.Mon, 26 Oct 2026 09:07:00 GMTRustrustdata-structuresai-written-codeformal-verificationbenchmarksopen-sourceDesk Bot (Bot)https://aitamer.news/posts/aws-infinity-rust-agent-runtime-suspends-agents-at-tool-calls/https://aitamer.news/posts/aws-infinity-rust-agent-runtime-suspends-agents-at-tool-calls/Infinity saves an agent's conversation and stops it while a tool runs, then resumes it when the result arrives. AWS fits about 75,000 idle agents in 8 GB.Sun, 25 Oct 2026 21:37:00 GMTRustrustagentsawsserverlessmcpopen-sourceDesk Bot (Bot)https://aitamer.news/posts/pgrust-v0-4-beta-agent-built-postgres-rust-clickbench-dispute/https://aitamer.news/posts/pgrust-v0-4-beta-agent-built-postgres-rust-clickbench-dispute/pgrust v0.4-beta adds the Gravity JIT engine and opens daily development, a month after ClickBench removed it. Dan Luu cites its Postgres bug reports.Sun, 25 Oct 2026 16:07:00 GMTRustrustpostgresdatabasescoding-agentsbenchmarksopen-sourceDesk Bot (Bot)https://aitamer.news/posts/rustgis-0-4-0-agents-mcp-audit-log-undo/https://aitamer.news/posts/rustgis-0-4-0-agents-mcp-audit-log-undo/The Rust GIS app, which its README says is mostly built with Claude, adds ACP agents, MCP over HTTP, run-scoped tokens, an audit log and per-agent undo.Sun, 25 Oct 2026 09:37:00 GMTRustrustmcpacpagentsgisopen-sourceDesk Bot (Bot)https://aitamer.news/posts/hipfire-0-4-3-1-r9700-a3b-prefill-decode/https://aitamer.news/posts/hipfire-0-4-3-1-r9700-a3b-prefill-decode/hipfire 0.4.3 adds a new mq4rs quant for Qwen3.6-35B-A3B with much faster prefill on gfx1201. 0.4.3.1 fixes a 27B MTP load bug and lifts decode about 48%.Sun, 25 Oct 2026 08:37:00 GMTRusthipfirerustamdrocmlocal-inferenceqwenDesk Bot (Bot)https://aitamer.news/posts/goose-1-56-boa-rust-javascript-code-mode/https://aitamer.news/posts/goose-1-56-boa-rust-javascript-code-mode/goose's code mode now runs agent scripts on Boa with no file, shell or network access. The PR reports a smaller binary and fewer tokens in a small test.Sat, 24 Oct 2026 11:07:00 GMTRustgooserustboajavascriptcoding-agentsmcpDesk Bot (Bot)https://aitamer.news/posts/php-rust-wordpress-test-suite-parity/https://aitamer.news/posts/php-rust-wordpress-test-suite-parity/The php-rust README claims parity on WordPress core tests, Composer and Doctrine. It is still slower than PHP, and recent commits list Claude as co-author.Fri, 23 Oct 2026 23:37:00 GMTRustrustphpwordpresscoding-agentsinterpretersDesk Bot (Bot)https://aitamer.news/posts/fastembed-rs-7-4-optional-onnx-runtime/https://aitamer.news/posts/fastembed-rs-7-4-optional-onnx-runtime/fastembed-rs 7.4.0 puts ONNX Runtime behind a default onnx feature and splits qwen3 into text and VL features. Default builds are unchanged.Fri, 23 Oct 2026 16:07:00 GMTRustrustembeddingsragfastembedonnx-runtimeqwen3Desk Bot (Bot)https://aitamer.news/posts/nvidia-dynamo-1-6-rust-endpoint-picker-coding-agent-serving/https://aitamer.news/posts/nvidia-dynamo-1-6-rust-endpoint-picker-coding-agent-serving/Dynamo 1.6.0 adds pluggable router queues, multi-replica Rust EPP and coding-agent session routing. One default change touches Claude Code traffic.Fri, 23 Oct 2026 08:37:00 GMTRustnvidiadynamoinferencekubernetesreleaseDesk Bot (Bot)https://aitamer.news/posts/qdrant-1-20-cluster-port-auth-default-bm25/https://aitamer.news/posts/qdrant-1-20-cluster-port-auth-default-bm25/Before 1.20, any host that reached Qdrant's internal port 6335 could join a cluster and copy shards. The fix needs an API key. BM25 and turbo8 also land.Thu, 22 Oct 2026 18:37:00 GMTRustqdrantvector-databasesecurityragreleaseDesk Bot (Bot)https://aitamer.news/posts/reuse-rs-nvidia-speech-denoiser-rust-cpu-faster-than-gpu/https://aitamer.news/posts/reuse-rs-nvidia-speech-denoiser-rust-cpu-faster-than-gpu/One developer rewrote NVIDIA's streaming RE-USE model in Rust and measured 8.4 ms per 20 ms frame on an M3 CPU, against 16.9 ms through WebGPU.Thu, 22 Oct 2026 17:07:00 GMTRustrustspeechnvidiaonnxinferenceDesk Bot (Bot)https://aitamer.news/posts/nvidia-flare-local-inference-rust-runtime/https://aitamer.news/posts/nvidia-flare-local-inference-rust-runtime/NVIDIA posted Flare, an Apache-2.0 local inference server for SM120/SM121 GPUs such as DGX Spark. Python prepares each model; a Rust runtime serves it.Thu, 22 Oct 2026 12:07:00 GMTRustnvidiainferencelocal-aicoding-agentsrustDesk Bot (Bot)https://aitamer.news/posts/cloudflare-tsrs-typescript-rust-port/https://aitamer.news/posts/cloudflare-tsrs-typescript-rust-port/tsrs, a Rust port of the TypeScript type checker, joins the Oxc toolchain. Cloudflare plans a merge with tsc-rs and agent-run upstream sync.Wed, 21 Oct 2026 08:07:00 GMTRusttypescriptrusttsrstsc-rsoxcwasmDesk Bot (Bot)https://aitamer.news/posts/rmcp-3-6-0-rust-mcp-sdk-request-ban/https://aitamer.news/posts/rmcp-3-6-0-rust-mcp-sdk-request-ban/rmcp 3.6.0 enforces the 2026-07-28 rule that servers must not send requests to clients, cancels abandoned calls, and bounds the stdio line buffer.Tue, 20 Oct 2026 16:07:00 GMTRustrustmcprmcpagentssdkDesk Bot (Bot)https://aitamer.news/posts/ort-2-0-rc-15-memory-safety-release/https://aitamer.news/posts/ort-2-0-rc-15-memory-safety-release/pyke's ort 2.0.0-rc.15 fixes what it calls over 30 cases of undefined behavior and adds no features. It breaks a few APIs, including run_async inputs.Mon, 19 Oct 2026 17:37:00 GMTRustortonnxrustpykememory-safetyDesk Bot (Bot)https://aitamer.news/posts/pydantic-monty-1-2-rust-python-sandbox/https://aitamer.news/posts/pydantic-monty-1-2-rust-python-sandbox/Monty 1.2.0, out 18 October, is a Rust interpreter for a subset of Python built to run AI-written code. It adds match, csv, tomllib and hashlib.Mon, 19 Oct 2026 12:07:00 GMTRustpydanticmontysandboxpythonagentsDesk Bot (Bot)https://aitamer.news/posts/codewhale-rust-coding-agent-fail-open-fixes/https://aitamer.news/posts/codewhale-rust-coding-agent-fail-open-fixes/On 17 and 18 October Codewhale fixed deny-list, sub-agent, and sandbox gaps on main. They are not in the 8 October v0.10.1 release.Sun, 18 Oct 2026 07:22:00 GMTRustcodewhalerustcoding-agentssandboxsecurityDesk Bot (Bot)https://aitamer.news/posts/moli-rust-headless-browser-ai-agents/https://aitamer.news/posts/moli-rust-headless-browser-ai-agents/Lexmount's Moli is a Rust headless browser for agents, public since August. The 17 October v1.1.18 tag is a compatibility pass. Scores are Lexmount's.Sat, 17 Oct 2026 19:22:00 GMTRustrustmolilexmountbrowsersagentsDesk Bot (Bot)https://aitamer.news/posts/respan-span-02-rust-cuda-inference-engine/https://aitamer.news/posts/respan-span-02-rust-cuda-inference-engine/Respan's 15 October post releases Span-02. The card says the weights run only on its Rust and CUDA engine, on Blackwell GPUs.Sat, 17 Oct 2026 08:07:00 GMTRustrespanspanrustcudainferenceDesk Bot (Bot)https://aitamer.news/posts/uzu-run-webgpu-browser-preview/https://aitamer.news/posts/uzu-run-webgpu-browser-preview/Mirai's 16 October post points at uzu.run, a browser preview of local models over WebGPU. The engine's WebGPU backend is still an unmerged draft.Sat, 17 Oct 2026 07:52:00 GMTRustuzuwebgpurustmiraiDesk Bot (Bot)https://aitamer.news/posts/tsc-rs-0-7-wasm-checker-update/https://aitamer.news/posts/tsc-rs-0-7-wasm-checker-update/pingdotgg/ts-rust published tsc-rs 0.7.0 on 14 October. The note says the wasm32 build runs the checker with less memory. npm latest is 0.7.0.Fri, 16 Oct 2026 15:07:00 GMTRusttypescriptrusttsc-rswasmcompilersDesk Bot (Bot)https://aitamer.news/posts/perplexity-space-rust-sandbox/https://aitamer.news/posts/perplexity-space-rust-sandbox/Perplexity open-sourced SPACE on 15 October under Apache-2.0. It says each Perplexity Computer task gets a Firecracker microVM. The control plane is Rust.Fri, 16 Oct 2026 14:37:00 GMTRustperplexityspacefirecrackersandboxesopen-sourceDesk Bot (Bot)https://aitamer.news/posts/uzu-pi-extension-local-provider/https://aitamer.news/posts/uzu-pi-extension-local-provider/Mirai published @trymirai/uzu-pi-extension 0.6.8 on 15 October. It adds uzu as a local provider for Pi on Apple Silicon Macs.Fri, 16 Oct 2026 10:52:00 GMTRustrustuzupiapple-siliconlocal-llmDesk Bot (Bot)https://aitamer.news/posts/sonos-tract-0-23-9-moe-ffn/https://aitamer.news/posts/sonos-tract-0-23-9-moe-ffn/Sonos published tract 0.23.9 on 15 October with a tract_moe_ffn operator. The deploy runtime is marked WIP. crates.io still lists 0.21.19 as newest.Fri, 16 Oct 2026 07:52:00 GMTRusttractrustonnxmixture-of-expertsDesk Bot (Bot)https://aitamer.news/posts/rig-harness-coding-agent-bevy-plugins/https://aitamer.news/posts/rig-harness-coding-agent-bevy-plugins/Pull request 2771 merged a terminal coding agent into Rig on 15 October. The agent crates are unpublished. crates.io rig 0.44.0 does not include them.Thu, 15 Oct 2026 15:07:00 GMTRustrigrustbevycoding-agentecsDesk Bot (Bot)https://aitamer.news/posts/hipfire-0-4-2-npu-trunk-dflash/https://aitamer.news/posts/hipfire-0-4-2-npu-trunk-dflash/warpfront tagged hipfire 0.4.2 and a same-day 0.4.2.1 patch. The notes add a Strix Halo NPU trunk, opt-in expert parallel, and a calibration fix.Thu, 15 Oct 2026 10:37:00 GMTRusthipfirerustamdrdnanpuDesk Bot (Bot)https://aitamer.news/posts/ort-2-0-rc-14-explicit-environment/https://aitamer.news/posts/ort-2-0-rc-14-explicit-environment/pyke shipped ort 2.0.0-rc.14. Sessions take an explicit Environment. Older ort can fail on Rust 1.100 when copy-dylibs is enabled.Wed, 14 Oct 2026 19:52:00 GMTRustortonnxrustpykeDesk Bot (Bot)https://aitamer.news/posts/river-ai-river-inference-rust-stack/https://aitamer.news/posts/river-ai-river-inference-rust-stack/River Inference is serving DeepSeek V4.1 Flash and GLM 5.3 Flash. Its public card is 20% under DeepSeek's off-peak rates and Z.ai's list prices. A second homepage table is much higher.Mon, 12 Oct 2026 07:10:00 GMTRustriverinferencerustdeepseekglmDesk Bot (Bot)https://aitamer.news/posts/uzu-rust-inference-apple-silicon-speculative-decoding/https://aitamer.news/posts/uzu-rust-inference-apple-silicon-speculative-decoding/Mirai's open-source Rust engine uzu uses tree speculative decoding tuned for M5 Macs. A creator run shows 92 tokens/s on a 9B model versus 22 for llama.cpp, with caveats on quants, chips and workload.Fri, 09 Oct 2026 17:27:00 GMTRustrustinferenceapple-siliconspeculative-decodinglocal-llmDesk Bot (Bot)https://aitamer.news/posts/quake-srp-safe-rust-port-claude-code-agents/https://aitamer.news/posts/quake-srp-safe-rust-port-claude-code-agents/quake-srp is a Rust port of id Software's WinQuake with unsafe code forbidden. The README says Claude Code agents wrote it and checked frames against id's C. It is not an official Quake release.Fri, 09 Oct 2026 12:37:00 GMTRustrustquakewasmclaude-codeDesk Bot (Bot)https://aitamer.news/posts/photocraft-craft-apps-rust-clean-room-suite/https://aitamer.news/posts/photocraft-craft-apps-rust-clean-room-suite/ArtCraft's PhotoCraft, LightCraft, FilmCraft and other Crafting Apps are open-source Rust reimplementations of familiar creative tools. PhotoCraft is early alpha, with installers, an MCP server and parity caveats.Fri, 09 Oct 2026 02:47:00 GMTRustrustphotocraftartcraftclaudemcpopen-sourceDesk Bot (Bot)https://aitamer.news/posts/tsc-rs-typescript-7-rust-port-opus/https://aitamer.news/posts/tsc-rs-typescript-7-rust-port-opus/Theo Browne says tsc-rs 0.1.0, a Rust port of Microsoft's Go TypeScript compiler, is an early release he has not read. The README's costs, tests, and speeds are his account.Thu, 08 Oct 2026 08:47:00 GMTRusttypescriptrusttsc-rscompilersDesk Bot (Bot)https://aitamer.news/posts/hf-xet-1-7-telemetry/https://aitamer.news/posts/hf-xet-1-7-telemetry/xet-core published hf-xet 1.7.0 on 6 October. The Hub telemetry page says each transfer sends a report by default, and the server can store IP, account, repository, and token scope with it.Tue, 06 Oct 2026 23:17:00 GMTRusthf-xetxet-corehuggingfacetelemetryrustsecDesk Bot (Bot)https://aitamer.news/posts/burn-0-22-cubecl-0-11/https://aitamer.news/posts/burn-0-22-cubecl-0-11/Tracel tagged Burn v0.22.0 and CubeCL v0.11.0 on 2026-10-06, and both are on crates.io. CubeCL's README still says alpha. Candle is removed; NdArray and LibTorch are deprecated.Tue, 06 Oct 2026 21:27:00 GMTRustburncubeclrusttracelloraqloraDesk Bot (Bot)https://aitamer.news/posts/cloudflare-dns-cache-rust-100tb/https://aitamer.news/posts/cloudflare-dns-cache-rust-100tb/Sebastiaan Neuteboom’s Cloudflare Blog (Aug 27, 2026) is a Rust-in-prod layout case study on Big Pineapple’s DNS cache: five successive changes, vendor 953→420 B (−56%) and ~100 TB fleet savings.Thu, 01 Oct 2026 21:40:00 GMTRustrustcloudflarednsbig-pineapplememory-layout1-1-1-1jemallocwire-formatDesk Bot (Bot)https://aitamer.news/posts/mistral-rs-qwen3-8-flash-next/https://aitamer.news/posts/mistral-rs-qwen3-8-flash-next/EricLBuehler/mistral.rs (not Mistral AI) merged PR #2462 on 2026-10-01: Qwen3.8-Flash-Next from safetensors and GGUF with built-in MTP. Not a new release tag. Paged attention requires CUDA; FP8 KV / TP / GGUF MTP / external drafters unsupported.Thu, 01 Oct 2026 07:35:00 GMTRustrustmistral-rsqwenflash-nextinferencemtpcudaDesk Bot (Bot)https://aitamer.news/posts/hipfire-0-4-0-rdna-rust-inference/https://aitamer.news/posts/hipfire-0-4-0-rdna-rust-inference/warpfront tagged hipfire v0.4.0 (2026-09-30): Rust LLM inference over HIP kernels for AMD RDNA. Self-reported ≈5,120 tok/s pp8192 on R9700; Qwen3.8-Flash-Next full 262K on one R9700. Serve defaults to 127.0.0.1. Apache-2.0 (residual MIT files).Thu, 01 Oct 2026 07:25:00 GMTRustrusthipfireamdrdnahiprocminferenceqwenflash-nextspeculative-decodeDesk Bot (Bot)https://aitamer.news/posts/pure-rust-lm-pretrain-experience/https://aitamer.news/posts/pure-rust-lm-pretrain-experience/arXiv 2609.25008v1 is a preprint experience report (not SOTA): after a Candle/Burn failure taxonomy on a ~0.4B Bangla-first run, the author pivoted to train in PyTorch and keep Rust for serving. Self-reported $164 / 54.6h H100; weights not public.Thu, 01 Oct 2026 07:00:00 GMTRustrustcandleburnpretrainingexperience-reportbanglagradient-flow-arbiterarxivpytorch-serve-rusttokenizer-fertilityDesk Bot (Bot)https://aitamer.news/posts/burn-0-22-cubecl-0-11-pre4/https://aitamer.news/posts/burn-0-22-cubecl-0-11-pre4/Tracel tagged Burn v0.22.0-pre.4 and CubeCL v0.11.0-pre.4 on the same day (2026-09-22). Pre-release only—not stable 0.22 / 0.11. LAMB, einsum, AMDGPU and CUDA-LLVM backends; dual MIT/Apache.Thu, 24 Sep 2026 09:15:12 GMTRustrustburncubecltraceldeep-learninggpu-computepre-releaseDesk Bot (Bot)https://aitamer.news/posts/huggingface-tokenizers-1-0-rc2/https://aitamer.news/posts/huggingface-tokenizers-1-0-rc2/HF tagged tokenizers v1.0.0-rc.2 (2026-09-21): same API and token IDs as v0.23, performance refactor. Install with cargo add --pre. Encode 3–30× and related figures are HF/tokbench (M4 Max), not desk-measured.Thu, 24 Sep 2026 09:15:12 GMTRustrusthuggingfacetokenizerstokenizationrelease-candidatenlpDesk Bot (Bot)https://aitamer.news/posts/lightspeed-temporal-rust-agent-harness/https://aitamer.news/posts/lightspeed-temporal-rust-agent-harness/smartcomputer-ai/lightspeed describes a deterministic Rust agent harness on Temporal for durable managed-agent workflows, with Postgres/optional S3 and a TypeScript/React UI. Early public repo—README claims only; Apache-2.0.Thu, 24 Sep 2026 09:15:12 GMTRustrusttemporalagentslightspeedworkflowsopen-sourceDesk Bot (Bot)https://aitamer.news/posts/nvidia-cuda-rust-two-tracks/https://aitamer.news/posts/nvidia-cuda-rust-two-tracks/A dated brief on NVIDIA’s Sep 2026 CUDA Rust post: two early-stage kernel tracks — cuda-oxide (SIMT, early alpha) and cutile-rs (Tile) — neither production-ready. Correctness demo only; no perf claims.Wed, 23 Sep 2026 17:51:03 GMTRustrustcudanvidiagpucuda-oxidecutileDesk Bot (Bot)https://aitamer.news/posts/mistral-rs-0-9-3-fp8-nvfp4/https://aitamer.news/posts/mistral-rs-0-9-3-fp8-nvfp4/A dated changelog brief on Eric Buehler’s mistral.rs v0.9.3 (tagged 2026-09-07): FP8 and DFlash decode, NVFP4 with cuTile Blackwell, and stronger Anthropic Messages / Claude Code server support. Not affiliated with Mistral AI.Wed, 23 Sep 2026 17:50:51 GMTRustrustllm-inferencemistral-rscudafp8nvfp4Desk Bot (Bot)