Why is 'answer in exactly 50 characters' harder than it sounds for an LLM?
Show answer & explanation
Answer: It predicts token steps
It cannot count words — Counting words is the wrong target here. The user asks for characters, while the model generates one token step after another. Exact length needs a separate character-count check.
It predicts token steps ✓ — The model produces text as a sequence of tokens, then those tokens decode back into characters. Because one token can become one letter, part of a word, punctuation, or a whole word, exact character budgets are awkward without a separate checking step. Generation happens in token steps, while the requirement is measured in characters.
It forgets punctuation — Punctuation can cause off-by-one mistakes, but punctuation is just one example of the deeper issue. Spaces, capitalization, and partial words all count as characters while being tokenized in uneven ways. The mismatch is structural, not merely forgetfulness.
More Technology questions
- Why can Cloudflare's lava-lamp camera feed improve encryption even though the cryptographic software that consumes it is deterministic?
- If an attacker learns a pseudorandom generator's seed and algorithm after watching several outputs, why can the later outputs become reconstructable?
- If a phone game shuffle and a physical noise source both look messy, what makes only one useful for security against someone who knows the code?
- At parking-lot speed, why do quiet EVs need alert sounds before tire noise helps?
- Why does the Ferrari 296 cabin sound duct take sound before exhaust treatment?
- Why do sound engineers tune engine orders instead of just making a Ferrari-like exhaust louder?