Mistral 发布 Voxtral 3 语音模型,Artificial Analysis 评测其榜单表现
Mistral 发布 Voxtral 3,包括一个 Text to Speech 模型和三个 Speech to Text 模型(Small Transcribe 3、Mini Transcribe 3、Mini Transcribe Realtime 3),Artificial Analysis 对全部模型做了评测。
Mistral has released new Speech models! Voxtral Small Transcribe 3 takes the #3 spot on the Artificial Analysis Speech to Text leaderboard, and Voxtral 3 TTS enters the top 12 in both Text to Speech arenas
@MistralAI has released Voxtral 3: a new Text to Speech model and three Speech to Text models (Small Transcribe 3, Mini Transcribe 3 and Mini Transcribe Realtime 3). We evaluated all of them.
Key takeaways:
➤ Speech to Text: Voxtral Small Transcribe 3 takes the #3 spot on the Artificial Analysis Speech to Text leaderboard with a 2.1% AA-WER Index, ahead of ElevenLabs Scribe v2 (2.2%) and Grok Voice Transcribe 2.0 (2.3%). Voxtral Mini Transcribe 3 lands at #5 with 2.2%.
➤ Streaming Speech to Text: Voxtral Mini Transcribe Realtime 3 scores 3.3% final-transcript AA-WER at the 960 ms setting (#6 of 46) and 3.6% at 480 ms, down from 5.2% for the previous Voxtral Mini Transcribe Realtime.
➤ Text to Speech, Provider Voice: Voxtral 3 TTS scores an Elo of 1,218 across 1,599 arena appearances, ranking #12 of 98, just behind Breeze TTS 2 at 1,221 and ahead of Inworld Realtime TTS-2 Flash and StepAudio 2.5 TTS at 1,216. It ranks #13 in English (US) and #12 in English (UK).
➤ Text to Speech, Controlled Voice: Voxtral 3 TTS scores 1,068 across 1,614 appearances, ranking #12 of 43 with the same 8 cloned voices, behind Eleven v3 at 1,072 and level with Ant Group's Ming-3.0-tts at 1,068. It ranks #10 in Assistants and #10 in English (UK).
➤ Pronunciation Robustness: Voxtral 3 TTS scores 84.4%, ranking #13 of 32 models, behind Qwen-Audio-3.1-TTS-Plus at 84.6% and ahead of HeyGen Voice at 83.2%. It ranks #3 in Standalone Terms at 93.9%.
➤ Pricing: Voxtral 3 TTS is priced at $13/1M characters, compared to Gemini 3.8 Flash TTS at $16.5/1M characters, Eleven v4 Turbo at $40/1M characters and Simba 3.2 at $6.6/1M characters.
See more details and listen to samples below ⬇️
来源:ArtificialAnlys · x.com