When a Repetition Rule Becomes a Ban
A repetition penalty discourages reused tokens. An n-gram rule can rule out a repeated sequence entirely, including one the text needs.
Wildness 2/5 · Mostly tamed
Topic · 5 stories
5 stories tagged text-generation on AI Tamer, newest first.
A repetition penalty discourages reused tokens. An n-gram rule can rule out a repeated sequence entirely, including one the text needs.
Top-p sets a probability-mass cutoff for the next token. The number of candidates changes as the model's probabilities change.
A cut-off answer can result from a stop string, a token cap, or a time limit. Check each setting before changing it.
Beam search keeps several possible sequences in play. That lets a weaker opening lead to a stronger completed answer.
Temperature reshapes the odds of each next token. A higher setting can produce more varied text, but it cannot guarantee originality.