Topic · 11 stories
11 stories tagged memory on AI Tamer, newest first.
Files under /dev/shm and other tmpfs mounts live in RAM and swap. A df on the main disk never counts them, so a forgotten build folder there can starve a machine while every disk alarm stays quiet.
The fourteenth tutorial sorts what a Bot remembers, what a saved skill holds, and which facts stay in the source instead of memory.
On 15 October the OpenBMB README announced PilotDeck 2.0, an AGPL agent OS with per-project memory. Its task scores are the project's own.
Hy Memory 2.0 is on GitHub and PyPI as hy-memory 2.0.2 under Apache 2.0. MemHub imports authorized tool chats into a local store. The scores are Tencent's.
Cargo's default job count is the number of logical CPUs. On a machine with many cores and several builds at once, memory becomes the limit long before CPU. Three ways to set the job count, and how to pick one.
A process list sorted by resident memory can hide the largest holder, because memory pushed to swap no longer counts as resident. Where Linux records the swapped part, and a one-line way to rank by both.
Checkpointing keeps fewer forward activations and reruns a segment during backpropagation. The memory saving comes with compute, RNG, and implementation tradeoffs.
Rust's Vec may reserve more space than requested. The useful guarantee is a capacity floor based on the current length.
A model’s weights are only part of its memory needs. The attention cache grows with the conversation, and saving space can slow generation.
Memory requests place a Pod. Limits constrain its containers. Learn how to tell a container out-of-memory kill from node-pressure eviction and size inference workloads accordingly.
What GGUF quantization names like Q4_K_M, Q5_K_S, Q8_0 and IQ3_M mean, how size and quality trade off, and how to pick one for the memory you have.
