- Turn-taking · TurnBench: detecting turn endings, false alarms and decision delay. - Commands · SLURP: choosing the correct tool and matching its argument values. - Voice style · InstructTTSEval: following voice descriptions, delivery directions and role-play instructions, with separate scores for each.
Models include VAP, p99, Smart Turn, Qwen3-TTS, VoxCPM2, FireRedTTS3 and MOSS-VoiceGenerator, alongside cloud configurations from OpenAI, Google, AWS and ElevenLabs. Each table shows run sizes and links to the protocol.
- Turn-taking · TurnBench: detecting turn endings, false alarms and decision delay. - Commands · SLURP: choosing the correct tool and matching its argument values. - Voice style · InstructTTSEval: following voice descriptions, delivery directions and role-play instructions, with separate scores for each.
Models include VAP, p99, Smart Turn, Qwen3-TTS, VoxCPM2, FireRedTTS3 and MOSS-VoiceGenerator, alongside cloud configurations from OpenAI, Google, AWS and ElevenLabs. Each table shows run sizes and links to the protocol.