Custom Google Pub/Sub Integration

Stack 9.0.0 Serverless Observability Serverless Security

The custom Google Pub/Sub input package is used to ingest data from a Google Pub/Sub topic subscription that is not covered by our GCP Integration.

This integration could, for example, be used to receive Stackdriver logs that have been exported to a Google Pub/Sub topic.

Multiple Elastic Agent instances can be configured to read from the same subscription to achieve high availability or increased throughput.

1. Create a user-managed service account (you can skip this if Elastic Agent is running in a VM with a service account attached). See: Service Accounts

2. Create a Pub/Sub topic and subscription. See:Topics and Subscriptions

3. Configure this integration to read from the Pub/Sub subscription using the service account credentials.

4. Write logs into the Pub/Sub topic yourself or configure a log sink to export GCP logs to the topic. See: Managing Sinks