Topic · 8 stories
8 stories tagged testing on AI Tamer, newest first.
A Cosmos DB sample gives each coding task its own emulator, worktree and seeded fixtures, so parallel agents stop overwriting each other's test data.
Run cargo miri test on a crate with unsafe code to catch out-of-bounds reads, use-after-free and aliasing violations that pass ordinary tests.
Switch a Rust test suite to cargo-nextest so each test runs in its own process, flaky tests can retry, and slow or hung tests are flagged and stopped.
Swap TestModel or FunctionModel in for the real model and block real model requests, so Pydantic AI agent tests run fast, free and the same way every time.
Rust doctests can demonstrate forbidden API use, but compile_fail only checks that compilation fails. A misspelled import can make the lesson appear tested.
Page structure changes. A locator based on a control’s role and name can keep a browser test focused on the action a person takes.
Metamorphic tests check how answers relate when inputs change. They can reveal faults even when no exact expected answer is available.
A practical way to turn real user examples into graders, regression tests, and model-update reviews.
