FA-Bench Leaderboard
ASR with timestamps commercial speech APIs
| System | Mean F1 |
|---|---|
| Google Chirp 2 | 0.436 |
| Amazon Transcribe | 0.269 |
| AssemblyAI Universal-3.5 Pro | 0.210 |
| Deepgram Nova-3 | 0.197 |
| IBM Watson STT en-US | 0.157 |
| Speechmatics Enhanced | 0.143 |
| Azure AI Speech | 0.138 |
| ElevenLabs Scribe v2 | 0.137 |
Word boundary F1 at 20 ms, averaged over TIMIT and Buckeye, clean and noisy. Higher is better.
Olewave makes FA-Bench and scores every system with the same public code against the same human annotations. Olign, also from Olewave, no longer takes part in the benchmark.
Speech Timestamps Playground
Forced alignment and ASR timestamps
Up to 30 seconds of English speech. No account needed.
We proudly offer
Large-Scale Pre-Labeled Speech Datasets
Label-Validated,
and Scientist-Verified OTS Datasets
-
Multiple languages, including 🇺🇸 🇪🇸 🇲🇽 🇸🇦 🇧🇷 🇮🇳 🇯🇵 🇨🇳 🇬🇧 🇩🇪 🇫🇷 …
-
Diverse topics in education, finance, legal, entertainment, healthcare, retail, customer service …
-
Validated labels for speaker names & turns, transcripts …
Production-Grade Voice AI Solutions
On Your Own Servers,
No SaaS Vendor Lock-In.
-
Superior STT/TTS with higher quality & faster inference than open-source or cloud APIs
-
Tailored to your use case, tuned to your domain, languages, and workflows
-
You own the code, with 100% IP rights on all customization
Avant-Garde Voice AI Consulting Services
Experienced in Assisting Clients,
Located in San Francisco
-
Market & technology evaluation covering the competitive landscape and build-vs-buy
-
Strategic business planning for roadmap, staffing and go-to-market
-
Strict non-disclosure, with an NDA on every engagement