NEW
Also known as: Pub/Sub
A globally distributed messaging service for asynchronous communication between services.
DESCRIPTION
Google Cloud Pub/Sub enables publish-subscribe messaging with topics and subscriptions for decoupled systems. It provides durable storage, high throughput, and at-least-once delivery, with features like push/pull, filtering, ordering, and dead-letter queues. Pub/Sub integrates with Dataflow, Functions, and other GCP services to power event-driven pipelines. It scales globally and supports cross-region replication. Typical uses include streaming ingestion, microservice decoupling, and real-time notifications.
ALTERNATIVE DEFINITIONS
Google Cloud
Pub/Sub is a fully managed real-time messaging service that allows you to send and receive messages between independent applications.
Emphasizes fully managed and decoupled applications communication.
Wikipedia
Google Cloud Pub/Sub is a messaging service that sends and receives messages between applications.
Concise description of core messaging capabilities.
RELATED TERMS
Event-Driven Architecture Messaging Topic Subscription Cloud Dataflow Streaming Queue Exactly-once At-least-once
COMPETING TERMS
Apache Kafka Amazon SNS/SQS
KNOWLEDGE AREAS
Real-time & Streaming Data Cloud Data Engineering Data Integration & Interoperability
TARGET AUDIENCE
Data Engineer Software Developer Cloud Architect DevOps Engineer MLOps Engineer
EXTERNAL SOURCES
- Wikipedia - Google Cloud Pub/Sub
- Google Cloud - Overview of Pub/Sub
- Google Cloud Architecture - Push vs. pull patterns
- Google Cloud - Subscriber documentation
TOP QUESTIONS
How does Google Cloud Pub/Sub support decoupling?
Publishers and subscribers communicate via topics, allowing independent scaling, failure isolation, and asynchronous workflows.
Category: Definition
What delivery semantics does Google Cloud Pub/Sub provide?
It provides at-least-once delivery by default, with ordering keys and exactly-once processing options using Dataflow patterns.
Category: Requirements
What are common mistakes with Google Cloud Pub/Sub?
Ignoring backpressure, insufficient acknowledgment deadlines, and unbatched processing can cause timeouts and increased costs.
Category: Mistakes
How does Google Cloud Pub/Sub compare to Apache Kafka?
Pub/Sub is managed, globally available, and integrates with GCP; Kafka offers fine-grained control and on-prem options but needs ops expertise.
Category: Comparison
What is currently a hot topic around Google Cloud Pub/Sub?
Using Pub/Sub with Dataflow and BigQuery for streaming analytics pipelines is increasingly popular.
Category: Topic
How can I filter messages in Google Cloud Pub/Sub?
Subscription filters allow attribute-based message selection, reducing downstream processing.
Category: HowTo
What’s the risk of mismanaging Google Cloud Pub/Sub subscriptions?
Poor acknowledgment handling can cause message redelivery, increased latency, and higher resource consumption.
Category: Risks
How do push and pull subscriptions differ in Google Cloud Pub/Sub?
Push delivers messages via HTTPS to endpoints; pull requires clients to fetch messages, offering more control.
Category: Comparison
How is Google Cloud Pub/Sub secured?
Use IAM for topic/subscription access, VPC Service Controls, and authenticated endpoints for push.
Category: Management