NEW
A model or algorithm that converts acoustic features or spectrograms into time‐domain audio waveforms.
DESCRIPTION
In modern TTS, a vocoder generates waveforms from intermediate acoustic features (e.g., mel spectrograms). Neural vocoders like WaveNet, WaveRNN, and HiFi-GAN produce natural-sounding speech, outperforming classical algorithms such as Griffin-Lim. Quality, latency, and computational cost vary across architectures, leading to trade-offs in deployment. Vocoders are also used in voice effects and encoding applications beyond TTS. Selection depends on target fidelity, throughput, and hardware constraints.
ALTERNATIVE DEFINITIONS
Wikipedia
A vocoder is a category of voice codec that analyzes and synthesizes the human voice signal for audio data compression, multiplexing, voice encryption, voice transformation, and voice effects.
Classical, communications-oriented definition covering multiple applications beyond TTS.
arXiv (HiFi-GAN)
We propose HiFi-GAN, a generative adversarial network-based vocoder that can synthesize high-fidelity audio efficiently.
Highlights modern neural vocoder approach emphasizing fidelity and efficiency.
RELATED TERMS
Neural Vocoder WaveNet HiFi-GAN WaveRNN Mel Spectrogram Speech Synthesis Pitch Formants
COMPETING TERMS
Griffin-Lim
RELATIONS
- Narrower: Neural Vocoder
KNOWLEDGE AREAS
TARGET AUDIENCE
AI Engineer Data Scientist Software Developer
EXTERNAL SOURCES
TOP QUESTIONS
What does a vocoder do in a TTS pipeline?
It converts acoustic features, such as mel spectrograms, into an audible waveform, determining much of the final speech quality.
Category: Overview
How do neural vocoders differ from Griffin-Lim?
Neural vocoders learn waveform generation and generally produce more natural speech than iterative phase reconstruction like Griffin-Lim.
Category: Comparison
Which vocoder is fastest for deployment?
GAN-based vocoders like HiFi-GAN are typically faster than autoregressive models while maintaining strong quality.
Category: Performance
Can vocoders be used for music?
Yes, vocoders can process musical audio and effects, though TTS-focused models are optimized for speech characteristics.
Category: UseCases
What affects vocoder quality most?
Training data quality, feature conditioning accuracy, and architecture choice heavily impact naturalness and intelligibility.
Category: Quality
Are vocoders language dependent?
They are largely language-agnostic but benefit from training on the target language’s phonetic characteristics.
Category: Capabilities
What’s the trade-off among vocoders?
Higher quality can increase compute and latency; deployment often balances fidelity, speed, and cost.
Category: Tradeoff
Do vocoders require GPUs?
Not strictly, but GPUs help achieve real-time performance, especially for high-fidelity models.
Category: Requirements
How to evaluate a vocoder?
Use MOS or CMOS listening tests, objective metrics (e.g., PESQ), and domain-specific qualitative assessments.
Category: Evaluation