Topic · 5 stories
5 stories tagged model-serving on AI Tamer, newest first.
CVE-2026-115812 (CVSS 9.8) lets a crafted model archive write files outside its folder. MMS is end of life, so AWS says migrate. No fix is planned.
Use an Istio VirtualService to copy live requests to a candidate model deployment, discard its responses, and compare its errors and latency with the stable version.
PyTorch mmap loading delays access to checkpoint storage. Budget for resident pages, parameter copies, activations and device memory during model startup and serving.
A model can move to a worker thread even when its fields prevent shared references from crossing threads. The choice changes how requests reach it.
A Kubernetes scratch volume can hold files a model server prepares at startup. Its lifetime makes it a poor home for the only copy of a model or a result.
