Why our voice agent felt slow: a latency budget for STT, LLM and TTS, and turn detection
Our first voice assistant prototype took two to three seconds to answer, and callers talked over it. Most of the delay was not the language model. How we built a latency budget across audio transport, end-of-turn detection, speech recognition, the LLM and speech synthesis, and what we changed in each stage.
