NEW
A time–frequency representation that maps a signal’s power spectrum onto the mel scale approximating human pitch perception.
DESCRIPTION
A mel spectrogram is computed by applying a mel filter bank to the magnitude or power spectrogram, often followed by log compression. It emphasizes perceptually relevant frequency bands and is standard in speech and audio ML. Many TTS systems condition vocoders on mel spectrograms, and ASR models use them as inputs. Parameters include FFT size, hop length, number of mel bins, and sample rate. Proper normalization and windowing are critical for consistent features across datasets.
ALTERNATIVE DEFINITIONS
MathWorks
The mel spectrogram of a signal represents the short-time power spectrum of the signal on a mel scale.
Precisely connects mel spectrograms to short-time power spectra and mel scaling.
librosa
Compute a mel-scaled spectrogram.
Concise function-level description from a widely-used audio library.
RELATED TERMS
Spectrogram Mel Scale STFT Log-Mel Feature Extraction Vocoder Speech Recognition Speech Synthesis Audio Classification
COMPETING TERMS
Mel-Frequency Cepstral Coefficients
KNOWLEDGE AREAS
TARGET AUDIENCE
Data Scientist AI Engineer Data Engineer Software Developer
EXTERNAL SOURCES
- Wikipedia - Mel scale
- librosa - Reference for mel spectrogram function
- torchaudio - PyTorch MelSpectrogram transform docs
TOP QUESTIONS
Why use mel spectrograms in audio ML?
They align frequency resolution with human perception, improving model performance for speech and audio tasks.
Category: Benefits
How do I choose mel spectrogram parameters?
Tune FFT size, hop, mel bins, and sample rate to balance time–frequency resolution for your task.
Category: Practice
What is log-mel?
It applies logarithmic compression to mel energies, stabilizing dynamic range and improving model training.
Category: Concepts
Are mel spectrograms better than MFCCs?
For deep learning, mel spectrograms often outperform MFCCs by preserving more spectral detail.
Category: Comparison
How do windowing and overlap affect results?
They control time–frequency trade-offs; improper settings can blur temporal events or harm frequency resolution.
Category: Mechanism
Do mel spectrograms work for music?
Yes. They are widely used in music tagging, transcription, and source separation tasks.
Category: UseCases
What pre-processing helps with mel spectrograms?
Pre-emphasis, normalization, and silence trimming often yield cleaner features and better training stability.
Category: Practice
How to visualize a mel spectrogram?
Plot time on x-axis, mel frequency on y-axis, and energy intensity as color.
Category: Visualization
Can mel spectrograms be inverted to audio?
Only approximately with algorithms like Griffin-Lim; neural vocoders achieve better reconstructions.
Category: Limitations