DataTerminology.comNEW
Temporary storage layer that keeps frequently accessed data close to compute, reducing latency and backend load.
DESCRIPTION
Caching stores copies of data for faster subsequent access, reducing round trips to slower systems. Common strategies include in-memory caches, CDNs, and application-level caches. Policies like TTL, eviction (LRU/LFU), and consistency (write-through/write-back) govern behavior. Cache invalidation ensures freshness but is notoriously hard. Proper sizing, partitioning, and hit-rate monitoring are essential. In distributed systems, cache coherence and stampede mitigation matter. Applied correctly, caching dramatically improves latency and scalability.
ALTERNATIVE DEFINITIONS
Cloudflare
Caching is the process of storing copies of files in a temporary storage location so they can be accessed more quickly.
Targets performance benefits with temporary storage copies.
MDN Web Docs
Caching is a technique that stores copies of a resource so that it can be served more quickly.
Focuses on web/HTTP resource caching and speed.
AWS
Caching improves application performance by storing data in-memory for fast retrieval.
Highlights in-memory approach and application performance.
RELATED TERMS
Memory Hierarchy Delays Throughput Content Delivery Network HTTP Caching Dynamic Programming Database Cache TTL Write-through Write-back
COMPETING TERMS
RELATIONS
- Narrower: KV Cache
KNOWLEDGE AREAS
Infrastructure Software Engineering Data Storage & Operations Observability & Telemetry
TARGET AUDIENCE
Software Developer DevOps Engineer Cloud Architect Data Engineer
EXTERNAL SOURCES
- Wikipedia - Cache (computing)
- Cloudflare - Caching basics in networking
- MDN Web Docs - HTTP caching concepts and headers
- AWS - Managed in-memory caching overview
- Microsoft Learn - Caching best practices in Azure
TOP QUESTIONS
Why is Cache important for performance?
Caching reduces expensive calls to slow systems by storing frequently needed data close to compute, cutting latency and improving throughput.
Category: Relevancy
What are common Cache eviction policies?
LRU, LFU, FIFO, and TTL-based policies determine which items to remove when space is limited.
Category: Example
What is a common mistake with Cache?
Ignoring invalidation and coherence leads to stale data, inconsistency, and confusing bugs.
Category: Mistakes
What risks does Cache introduce?
Cache stampedes, thundering herds, and data staleness can degrade performance or correctness if not mitigated.
Category: Risk
What is a competing term for Cache?
Buffering is related but distinct, focusing on smoothing data flow rather than reusing prior results.
Category: Alternatives
How to manage Cache in microservices?
Use per-service caches with clear TTLs, cache-aside patterns, and distributed cache solutions where needed.
Category: Requirements
What is cache-aside vs write-through?
Cache-aside loads on demand and writes to the cache explicitly; write-through updates cache and backend atomically.
Category: Example
How do CDNs leverage Cache?
CDNs cache content at edge nodes using HTTP directives to accelerate delivery globally.
Category: Overview
Where to start learning about Cache?
Read MDN on HTTP caching, Cloudflare learning center, and platform docs like AWS ElastiCache.
Category: Overview