🗂️Unity Catalog

NEW

A centralized governance solution for data and AI assets in Databricks.

DESCRIPTION

Unity Catalog provides centralized governance across Databricks workspaces for tables, files, models, and other assets. It delivers fine-grained access control, audit logging, lineage, and data discovery. Unity Catalog standardizes securable objects via catalogs, schemas, and tables, enabling consistent policies. It supports sharing across clouds and accounts and integrates with lakehouse architectures. Teams use it to enforce compliance and manage permissions at scale.

ALTERNATIVE DEFINITIONS

Databricks Documentation

Unity Catalog is the centralized governance solution for data and AI assets in Databricks.

Vendor definition highlighting centralized governance across data and AI assets.

Source

Databricks

Unity Catalog provides unified governance for all data and AI assets on the Databricks Lakehouse.

Emphasizes unified governance on the Lakehouse platform.

Source

RELATED TERMS

Data Discovery Platform Governance Access Control Lineage Delta Lake Data Lakehouse Metadata Repositories Table ACLs Apache Spark Feature Store

COMPETING TERMS

AWS Glue Data Catalog Apache Atlas Microsoft Purview

KNOWLEDGE AREAS

Data Governance Metadata Management Data Management Platform & Tooling Data Services

TARGET AUDIENCE

Data Steward Data Engineer Data Architect Cloud Architect Security Architect Data Governance Manager MLOps Engineer

EXTERNAL SOURCES

• Wikipedia - Databricks
• Databricks Documentation - Official Unity Catalog documentation
• Microsoft Learn - Azure Databricks Unity Catalog guide
• Terraform Registry - Infrastructure-as-code for Unity Catalog

TOP QUESTIONS

What problems does Unity Catalog solve?

It centralizes governance, access control, lineage, and auditing across Databricks workspaces, reducing fragmentation and manual policy management.

Category: Overview

How does Unity Catalog enforce permissions?

It uses securable objects (catalogs, schemas, tables) with role-based access control and fine-grained privileges.

Category: Management

Does Unity Catalog support cross-account data sharing?

Yes, it enables secure data sharing across clouds and accounts using Lakehouse-native mechanisms.

Category: Capabilities

How does Unity Catalog handle lineage?

It tracks lineage across queries and jobs to show data dependencies and transformations, aiding compliance and debugging.

Category: Observability

What is the relationship between Unity Catalog and Delta Lake?

Unity Catalog governs Delta Lake tables, integrating permissions, auditing, and metadata with Lakehouse storage formats.

Category: Architecture

Who primarily maintains Unity Catalog configurations?

Data stewards, data architects, and platform engineers typically manage catalogs, schemas, and policies.

Category: Roles

What are common mistakes with Unity Catalog?

Overly granular policies that complicate management, inconsistent naming, and insufficient auditing are frequent pitfalls.

Category: Mistakes

How does Unity Catalog integrate with CI/CD?

Infrastructure-as-code tools like Terraform manage catalog objects and policies to promote consistent environments.

Category: Collaboration

Is Unity Catalog only for structured data?

No, it supports governance for files, tables, ML models, and other artifacts within Databricks.

Category: Misunderstanding