NEW
Missing, unavailable, or uncollected information required for analysis or operations.
DESCRIPTION
Data gaps arise when expected fields or records are missing due to collection issues, ETL failures, permissions, or design limitations. They degrade analyses, introduce bias, and can break downstream pipelines. Profiling and completeness metrics help detect gaps early. Imputation, backfilling, and redesign of capture processes reduce recurrence. Governance practices and data contracts formalize expectations and escalation paths. Addressing gaps improves trust, reproducibility, and decision quality.
ALTERNATIVE DEFINITIONS
Wikipedia
In statistics, missing data, or missing values, occur when no data value is stored for the variable in an observation.
Focuses on the statistical notion of missing observations.
Wikipedia
In statistics, imputation is the process of replacing missing data with substituted values.
Highlights a core remediation method for data gaps.
RELATED TERMS
Data Quality Completeness Imputation Data Profiling Schema Enforcement Lineage Systematic Error Sampling Governance Data Discovery Platform
COMPETING TERMS
KNOWLEDGE AREAS
Data Quality Data Management Data Governance Data Science
TARGET AUDIENCE
Data Steward Data Analyst Data Engineer Data Scientist Data Governance Manager
EXTERNAL SOURCES
- Wikipedia - Missing data
- scikit-learn - Techniques for missing-data imputation
- W3C - Standard guidance on missing values
TOP QUESTIONS
What are Data Gaps in data management?
Data Gaps are missing or uncollected values or records that prevent complete analysis or operations.
Category: Definition
Why do Data Gaps occur?
They arise from capture issues, optional fields, ETL errors, schema changes, access restrictions, or manual processes.
Category: Causes
How do Data Gaps impact analytics?
They bias results, reduce statistical power, and break transformations, dashboards, or models.
Category: Impact
How can Data Gaps be detected?
Use profiling, completeness KPIs, constraints, and observability checks to flag missingness patterns.
Category: Detection
How are Data Gaps remediated?
Apply imputation, backfill from sources of truth, or redesign capture and contracts to prevent recurrence.
Category: Remediation
What’s a common mistake with Data Gaps?
Imputing without analyzing missingness mechanism (MCAR, MAR, MNAR) can introduce bias.
Category: Mistakes
What risks do Data Gaps pose?
They can cause compliance issues, wrong decisions, and broken SLAs if left unmanaged.
Category: Risks
How do Data Gaps relate to Data Completeness?
Completeness measures the absence of gaps relative to expectations; gaps reduce completeness.
Category: Relation
Who is accountable for Data Gaps?
Data owners and stewards coordinate fixes, while engineers and source teams implement controls.
Category: Responsibility