Voice & audio, with a verdict on each.
Turning speech into text, text into speech, and cloning a voice from a short sample.
Consent is not optional. Cloning a voice without documented permission is a legal problem in several jurisdictions before it is a technical one.
Moving fastest this week: MoneyPrinterTurbo (+17k), OpenMontage (+8.0k), unsloth (+5.9k).
Adopt now
1Mature enough to put in production this quarter.
Pilot it
9Worth a timeboxed spike before you bet on it.
AI-powered short video generator
Instead of: manual video editing tools
Open-source text-to-speech synthesis
Instead of: Paid TTS services or manual voiceovers
Offline speech-to-text and text-to-speech engine
Instead of: Cloud-based speech services like Google Cloud Speech-to-Text
Clones a voice from roughly a minute of audio and reads new text in it.
Instead of: Per-character pricing at a commercial voice vendor.
Local voice cloning and audio editing tool
Instead of: ElevenLabs or manual voice editing
Video translation with dubbing and subtitles
Instead of: Manual video translation and editing
Apple Silicon speech analysis library
Instead of: Manual speech processing or paid APIs
Open-source speech synthesizer
Instead of: Paid text-to-speech services
Python toolkit for end-to-end speech processing
Instead of: Manual speech processing or Kaldi
Watch, or skip
6Real software; just not where a small team's next hundred hours should go.
Makes fine-tuning open models substantially faster and small enough to fit on one consumer GPU.
Instead of: Renting multi-GPU cloud instances for a training run.
Open-source video production system with AI tools
Instead of: Manual video editing or paid video production software
Open-source text-to-speech system
Instead of: Paid TTS services or manual recording
Gradio WebUI for TTS and voice cloning
Instead of: manual audio editing tools
Local voice cloning and audio tools
Instead of: ElevenLabs or manual voice editing
Open-source voice assistant in TypeScript
Instead of: Manual voice assistant scripts or paid services
Voice & audio, in short
- What are the best open source speech and voice AI right now?
- We would put supertonic into production this quarter. supertonic — On-device text-to-speech engine The full list below ranks 16 by momentum, size and how recently they shipped.
- Which of these can I use in a commercial product?
- 9 of the 16 carry a permissive licence (MIT, Apache-2.0, BSD). 7 do not — OpenMontage (AGPL-3.0), index-tts (Custom / check the LICENSE file), voice-pro (GPL-3.0) and others. Copyleft and source-available licences carry obligations when you ship them inside something you sell. Read the LICENSE file; this is a reading of the label, not legal advice.
- How is this list ranked?
- By real week-over-week star movement first, with a size floor so an established tool is not buried by a two-week-old project, and a hard penalty for anything that has stopped shipping. Verdicts are an editorial call for a team of 2-20 with limited engineering hours — not a judgement on the software, and not the same call we would make for a lab.
Which of these matters to your business?
Tell us what you sell in one sentence and we will hand you three specific moves — priced per month, with the arithmetic shown. Free, no signup.
Give me three moves