Model a tagged stream of model events with serde internally tagged enums
Map a JSON event stream with a "type" field onto a Rust enum using #[serde(tag = "type")], handle unknown event types, and see why tuple variants fail to compile.
Topic · 7 stories
7 stories tagged streaming on AI Tamer, newest first.
Map a JSON event stream with a "type" field onto a Rust enum using #[serde(tag = "type")], handle unknown event types, and see why tuple variants fail to compile.
HTTP/2 interleaves independent request streams, yet one missing TCP segment can delay them together. QUIC changes stream delivery, with limits of its own.
Streaming captions need a committed transcript and a replaceable interim suffix. Learn what isFinal, stability, and confidence each say about a result.
Stream training examples as you need them. Learn how shuffle buffers and shards affect data order, parallel loading, and restarts.
A streaming shuffle can choose only from rows it has reached. Buffer and shard shuffling improve the mix, but they do not provide the global reach of an indexed dataset.
How to handle a model response that arrives in pieces. It covers server-sent events, partial JSON, user cancellation, and what is safe to store.
A practical map of speech recognition, language models, speech synthesis, direct speech-to-speech models, streaming, and the latency measurements that matter.