ElevenLabs 发布强制对齐模型 Cue
ElevenLabs 发布强制对齐模型 Cue，可将每个字符精确定位到音频时间轴，并在测试中超过所有受测开源对齐器。Cue 支持任意长度录音单次处理，在基准覆盖的 29 种语言中准确率均高于受测开源对齐器，单 GPU 对齐一小时音频约需半秒。该模型已用于 ElevenLabs 的全部 Speech to Text 转写，并通过 Forced Alignment API 单独提供。
Cue 将逐字时间定位、29 种语言准确率和单 GPU 约半秒处理一小时的性能放在一起，提供了字幕与配音对齐的技术参照。
New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.
Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.
Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.
Read the full post: elevenlabs.io/blog/cue-align…
来源：ElevenLabs · x.com