DataTerminology.comNEW
Also known as: Data Cleanliness
Ongoing practices that keep datasets accurate, consistent, de-duplicated, and up to date throughout their lifecycle.
DESCRIPTION
Data hygiene combines policies, processes, and tools to prevent quality degradation. It includes proactive validation, deduplication, standardization, and enrichment. Routine audits and profiling detect anomalies and drift. Governance sets ownership and accountability for remediation. Automation integrates rules into pipelines and applications. Hygiene reduces compliance risk and improves analytics and customer experience. It complements one-time cleansing with continuous controls. Metrics track accuracy, completeness, and timeliness. Education and data literacy reinforce good entry and maintenance habits. Sustained hygiene lowers long-term costs of poor-quality data.
RELATED TERMS
Data Quality Data Profiling Data Validation Data Enrichment Data Deduplication Address Standardization Governance Data Stewardship Contact Data Management
COMPETING TERMS
Data Cleaning Data Decay
KNOWLEDGE AREAS
Data Quality Data Management Data Governance
TARGET AUDIENCE
Data Steward Data Analyst Data Engineer Data Governance Manager BI Specialist
EXTERNAL SOURCES
- Wikipedia - Data cleansing
- W3C - Best practices for data on the web
- Great Expectations - Data validation and quality framework docs
- Google Cloud - Managed data quality checks in Dataplex
- OpenRefine - Open-source data cleaning tool docs
TOP QUESTIONS
Why does Data Hygiene matter long term?
Consistent hygiene reduces errors, improves decisions, and lowers remediation costs. It sustains trust in data products over time.
Category: Relevancy
What activities constitute Data Hygiene?
Validation, standardization, deduplication, enrichment, and routine profiling integrated into data pipelines and entry points.
Category: Overview
How is Data Hygiene different from one-time Data Cleansing?
Cleansing fixes existing issues once; hygiene builds continuous controls to prevent reintroduction of problems.
Category: Misunderstanding
What metrics track Data Hygiene effectiveness?
Accuracy, completeness, timeliness, duplicates rate, and rule conformance trends indicate improvement or decay.
Category: Observability
What are common Data Hygiene mistakes?
Relying solely on manual cleanup, ignoring ownership, and lacking automated checks lead to recurring quality issues.
Category: Mistakes
How do privacy and compliance affect Data Hygiene?
Hygiene must include consent enforcement, minimization, and retention controls to meet regulatory obligations.
Category: Compliance
Which tools help automate Data Hygiene?
Validation frameworks, deduplication services, address standardization, and managed data quality platforms streamline hygiene.
Category: Tooling
How often should Data Hygiene checks run?
Continuously for streaming and at each batch frequency for batch pipelines, aligned to SLAs and risk.
Category: Requirements
What’s the biggest misconception about Data Hygiene?
That it’s a one-off project; sustained hygiene is an ongoing operational discipline.
Category: Misunderstanding