NEW
A deep generative model for raw audio using dilated causal convolutions to synthesize highly natural speech.
DESCRIPTION
WaveNet is an autoregressive model that generates audio waveform samples conditioned on previous samples, enabling high-fidelity speech synthesis. It uses stacks of dilated causal convolutions to expand receptive fields without pooling. WaveNet variants serve as neural vocoders for TTS systems, converting acoustic features to waveforms. While high quality, vanilla WaveNet can be computationally expensive at inference time due to sample-by-sample generation. Subsequent models like WaveRNN and GAN-based vocoders addressed speed-quality trade-offs.
ALTERNATIVE DEFINITIONS
DeepMind
WaveNet is a deep generative model of raw audio waveforms.
Canonical one-sentence definition stressing raw audio generation.
arXiv
We present WaveNet, a deep generative model of raw audio waveforms.
Original paper’s opening sentence highlighting contribution.
RELATED TERMS
Neural Vocoder Raw Audio Generation Tacotron 2 Autoregressive Model Dilated Causal Convolutions Speech Synthesis Audio Generation
COMPETING TERMS
KNOWLEDGE AREAS
TARGET AUDIENCE
AI Engineer Data Scientist Software Developer
EXTERNAL SOURCES
- Wikipedia - WaveNet
- arXiv - Original WaveNet research paper
- DeepMind - Official WaveNet blog and explainer
TOP QUESTIONS
Why was WaveNet a breakthrough for TTS?
It synthesized natural speech directly as raw waveforms, dramatically improving quality over traditional vocoders and concatenative systems.
Category: Impact
How do dilated causal convolutions help WaveNet?
They expand the receptive field efficiently while preserving causality, allowing the model to capture long-range temporal dependencies.
Category: Mechanism
What are WaveNet’s limitations?
Autoregressive sampling is computationally expensive, leading to high latency without specialized optimizations.
Category: Limitations
How is WaveNet used as a vocoder?
It conditions on acoustic features (e.g., mel spectrograms) to generate high-quality time-domain speech waveforms.
Category: Application
What superseded WaveNet in speed?
Models like WaveRNN and GAN-based vocoders (e.g., HiFi-GAN) achieve faster inference while maintaining strong quality.
Category: Alternatives
Is WaveNet still relevant?
Yes. Many modern vocoders and TTS pipelines build on WaveNet concepts or use WaveNet-like conditioning.
Category: Relevancy
Can WaveNet run in real time?
With heavy optimization and hardware acceleration it can approach real-time, but non-autoregressive vocoders are generally faster.
Category: Performance
What datasets are used with WaveNet?
Common TTS datasets include LJSpeech, VCTK, and proprietary studio-quality corpora for multi-speaker synthesis.
Category: Data
How does WaveNet compare to HiFi-GAN?
WaveNet is autoregressive and often higher-latency, while HiFi-GAN is GAN-based and typically faster with competitive quality.
Category: Comparison