Topic · 5 stories
5 stories tagged sglang on AI Tamer, newest first.
An SGLang remote code execution flaw let an attacker into NEAR AI's inference servers, about 100 accounts and 18 agents. Confidential mode was in scope too.
Long prompts to GLM-5.3 on Workers AI could return text from other users' requests from 27 Aug to 9 Sep. Cloudflare and SGLang explain the bug and the fix.
EAGLE-4 adapts its draft tree to batch size and hardware. It needs patched engine builds, and commercial use stops being free above $20M in revenue.
TorchTPU, built with Meta's PyTorch team, is open source. Google adds TPU backends for vLLM, SGLang, Ray and VeRL, and device_map="tpu" in Transformers.
llm-d 1.0, a CNCF Sandbox project started by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA, adds flow control, router HA and DisaggregatedSet.
