NEW
A downsampling operation that aggregates local neighborhoods to reduce spatial dimensions in convolutional networks.
DESCRIPTION
Pooling summarizes local regions of feature maps to reduce spatial resolution and computation. Common variants are max pooling, average pooling, and global average pooling. It helps achieve translational invariance and mitigate overfitting by reducing parameters. Pooling is typically inserted between convolutional layers in CNNs. Max pooling emphasizes the strongest activation in a region, while average pooling computes mean responses. Although standard in early CNNs, pooling is sometimes replaced with strided convolutions or dilated convolutions. Global average pooling often substitutes for fully connected layers in modern architectures. Appropriate kernel sizes and strides are chosen based on downsampling needs and task constraints.
ALTERNATIVE DEFINITIONS
Stanford CS231n
It is common to periodically insert a Pooling layer in-between successive Conv layers in a ConvNet architecture. Its function is to progressively reduce the spatial size of the representation to reduce the amount of parameters and computation in the network.
Highlights purpose: reducing spatial size, parameters, and computation in CNNs.
Wikipedia
Pooling layers reduce the dimensions of feature maps by combining the outputs of neuron clusters at one layer into a single neuron in the next layer.
Describes pooling as dimensionality reduction via localized aggregation.
RELATED TERMS
Pooling Layer Convolutional Neural Network Global Average Pooling Activation Function Batch Normalization Feature Map Stride Filter Receptive Field
COMPETING TERMS
Strided Convolution
RELATIONS
- Narrower: Average Pooling Max Pooling
KNOWLEDGE AREAS
TARGET AUDIENCE
AI Engineer Data Scientist MLOps Engineer Software Developer
EXTERNAL SOURCES
- Wikipedia - Convolutional neural network
- PyTorch - Max pooling API and semantics
- Keras - Pooling layer APIs in Keras
- Google Developers - Glossary definition of pooling
TOP QUESTIONS
Why is Pooling used in CNNs?
Pooling reduces spatial dimensions and computation while providing translational invariance. It helps control overfitting and improves efficiency in deep architectures.
Category: Relevancy
What’s the difference between max and average Pooling?
Max pooling selects the largest activation in a region, emphasizing strong features. Average pooling computes the mean, smoothing responses and retaining broader context.
Category: Explanation
When should I replace Pooling with strided convolutions?
Use strided convolutions when you want learned downsampling and richer representational capacity. They can improve performance but add parameters and computation.
Category: Opinion
How does Pooling affect overfitting?
By reducing parameters and summarizing activations, pooling helps prevent overfitting. However, excessive downsampling can remove important fine-grained details.
Category: Risks
What kernel size is common for Pooling?
2×2 with stride 2 is a frequent choice for halving spatial dimensions. Larger kernels increase downsampling but risk losing spatial information.
Category: HowTo
Is Pooling still common in modern CNNs?
Yes, though some architectures prefer strided or global average pooling. Design choices depend on task, model size, and performance trade-offs.
Category: Topic
Can Pooling be used outside vision tasks?
Yes. Temporal pooling appears in audio and sequence models to aggregate over time, reducing sequence length and focusing on salient signals.
Category: Example
Does Pooling harm localization tasks?
Aggressive pooling can degrade spatial precision needed for detection or segmentation. Use smaller strides or dilations to preserve detail.
Category: Risks
What’s global average Pooling?
It averages each feature map into a single value, often replacing fully connected layers and reducing parameters while maintaining class-discriminative signals.
Category: Explanation