🐝Apache Hive

NEW

Also known as: Hive

A data warehouse system that enables SQL-like querying and management of large datasets stored in distributed filesystems.

DESCRIPTION

Apache Hive provides SQL-like querying (HiveQL) over data in HDFS or compatible storage. It supports batch and interactive execution via engines like Tez and LLAP. The metastore manages schema and table metadata for interoperability across tools. Storage formats like ORC and Parquet provide columnar performance. Hive underpins many on-prem data lakes and integrates with ecosystem tools. Engines such as Trino and Impala compete for faster interactive SQL.

ALTERNATIVE DEFINITIONS

Apache Hive

The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL.

Official definition stressing SQL access over distributed storage.

Source

Wikipedia

Apache Hive is a data warehouse software project built on top of Apache Hadoop for providing data query and analysis.

Positions Hive as a Hadoop-based SQL and analytics engine.

Source

Cloudera

Apache Hive enables SQL-based access to data stored in Hadoop and other compatible file systems, with a shared metastore for interoperability.

Highlights metastore and broader storage compatibility.

Source

RELATED TERMS

HiveQL Metadata Repositories Apache Tez MapReduce LLAP Partitioning Binning ORC Parquet

COMPETING TERMS

Trino Presto Apache Impala

KNOWLEDGE AREAS

Data Warehousing & BI Data Engineering Data Storage & Operations Platform & Tooling

TARGET AUDIENCE

Data Engineer BI Specialist Data Analyst Data Architect

EXTERNAL SOURCES

• Wikipedia - Apache Hive
• Apache Hive - HiveQL language manual
• Apache Hive - Hive overview and downloads
• Cloudera - Vendor overview and operations

TOP QUESTIONS

What execution engines does Apache Hive use?

Hive can run on Tez, MapReduce, and LLAP for low-latency analytics.

Category: Features

How does the Hive Metastore help?

It stores table schemas and metadata, enabling multiple engines to share consistent definitions.

Category: Concept

Which file formats are common with Hive?

ORC and Parquet are columnar formats that improve compression and query performance.

Category: Best practices

Is Hive suitable for interactive analytics?

With LLAP or engines like Trino/Impala, interactive performance improves; classic MapReduce mode is batch-oriented.

Category: Opinion

How do partitions and buckets help in Hive?

Partitions prune data by keys; buckets cluster data to improve joins and sampling.

Category: Performance

What are common mistakes using Hive?

Ignoring partitioning, misusing small files, and not matching file format to workload degrade performance.

Category: Mistakes

How does Hive compare to Trino and Impala?

Trino and Impala often provide faster interactive SQL; Hive excels for batch ETL and compatibility.

Category: Alternatives

Can Hive query cloud object storage?

Yes, via connectors and compatible file systems such as Amazon S3 and Azure Blob Storage.

Category: Requirements

How to start with Apache Hive?

Install Hive with a metastore, create external tables over data in HDFS or object storage, and run HiveQL queries.

Category: Getting Started