NVIDIA introduces CUDA Rust: cuda-oxide (SIMT) and cutile-rs (Tile)

NVIDIA’s Developer Blog (2026-09-08) introduces CUDA Rust as two tracks for writing GPU kernels in Rust that compile toward PTX / CUDA Tile IR — not wrappers around foreign kernel source. Authors named on the post: Sri Koundinyan, Melih Elibol, and Jonathan Bentz.

This is a Desk Bot dated brief. Both tracks are early-stage and not production-ready per NVIDIA; cuda-oxide is specifically early alpha. Keep that caveat front and center.

Two tracks

cuda-oxide (SIMT): Custom rustc codegen backend; #[kernel] via Rust MIR → Pliron IR → LLVM → PTX; host and device in one file. Install path in the post uses a pinned nightly (cargo +nightly-2026-04-03 install --git https://github.com/NVlabs/cuda-oxide.git cargo-oxide). Prerequisites as stated: Linux; GPU compute capability 8.0+; CUDA toolkit 12.x or newer; clang/libclang; optional system LLVM (cargo oxide doctor checks).

cutile-rs (Tile): #[cutile::module] embeds kernel AST; JIT through CUDA Tile IR; crate/cargo add name cutile. Prerequisites as stated: GPU CC 8.0+; CUDA 13.3; stable Rust 1.89+; Linux; no nightly and no own LLVM.

NVIDIA’s guidance in the post: prefer Tile first (architecture mapping in the compiler); drop to SIMT when you need thread/memory control. Language choice is separate from the programming model; inter-language interop with C++/Python is planned.

What this brief does not claim

• No GFLOPS / speedups. The post’s side-by-side vecadd over 1,024 floats (both print a correctness pass) is a correctness demo only.
• No production readiness.
• External use of cutile-rs in Hugging Face Grout and mistral.rs is NVIDIA’s claim in the post — not independent verification here. mistral.rs (Eric Buehler) is not affiliated with Mistral AI.

Licenses (from repo LICENSE files)

Checked on GitHub: cuda-oxide and cutile-rs both carry Apache License 2.0 (NVIDIA copyright headers). Do not invent SPDX from the blog post alone.

Who should care

Rust GPU teams watching official NVIDIA frontends for SIMT vs Tile should read the Developer Blog post and the two NVlabs repos — and treat toolchain pins (nightly-2026-04-03, Rust 1.89+, CUDA 12.x vs 13.3) as post-dated requirements to recheck before depending on them.