Graph
WaveNet

🔊WaveNet

NEW

A deep generative model for raw audio using dilated causal convolutions to synthesize highly natural speech.

DESCRIPTION

WaveNet is an autoregressive model that generates audio waveform samples conditioned on previous samples, enabling high-fidelity speech synthesis. It uses stacks of dilated causal convolutions to expand receptive fields without pooling. WaveNet variants serve as neural vocoders for TTS systems, converting acoustic features to waveforms. While high quality, vanilla WaveNet can be computationally expensive at inference time due to sample-by-sample generation. Subsequent models like WaveRNN and GAN-based vocoders addressed speed-quality trade-offs.

ALTERNATIVE DEFINITIONS

DeepMind

WaveNet is a deep generative model of raw audio waveforms.

Canonical one-sentence definition stressing raw audio generation.

Source

arXiv

We present WaveNet, a deep generative model of raw audio waveforms.

Original paper’s opening sentence highlighting contribution.

Source

Neural Vocoder Raw Audio Generation Tacotron 2 Autoregressive Model Dilated Causal Convolutions Speech Synthesis Audio Generation

COMPETING TERMS

HiFi-GAN WaveRNN

KNOWLEDGE AREAS

AI Data Science Mathematics

TARGET AUDIENCE

AI Engineer Data Scientist Software Developer

EXTERNAL SOURCES

TOP QUESTIONS

Why was WaveNet a breakthrough for TTS?

It synthesized natural speech directly as raw waveforms, dramatically improving quality over traditional vocoders and concatenative systems.

Category: Impact

How do dilated causal convolutions help WaveNet?

They expand the receptive field efficiently while preserving causality, allowing the model to capture long-range temporal dependencies.

Category: Mechanism

What are WaveNet’s limitations?

Autoregressive sampling is computationally expensive, leading to high latency without specialized optimizations.

Category: Limitations

How is WaveNet used as a vocoder?

It conditions on acoustic features (e.g., mel spectrograms) to generate high-quality time-domain speech waveforms.

Category: Application

What superseded WaveNet in speed?

Models like WaveRNN and GAN-based vocoders (e.g., HiFi-GAN) achieve faster inference while maintaining strong quality.

Category: Alternatives

Is WaveNet still relevant?

Yes. Many modern vocoders and TTS pipelines build on WaveNet concepts or use WaveNet-like conditioning.

Category: Relevancy

Can WaveNet run in real time?

With heavy optimization and hardware acceleration it can approach real-time, but non-autoregressive vocoders are generally faster.

Category: Performance

What datasets are used with WaveNet?

Common TTS datasets include LJSpeech, VCTK, and proprietary studio-quality corpora for multi-speaker synthesis.

Category: Data

How does WaveNet compare to HiFi-GAN?

WaveNet is autoregressive and often higher-latency, while HiFi-GAN is GAN-based and typically faster with competitive quality.

Category: Comparison