Loading

Google Cloud Storage connector

The Google Cloud Storage connector enables searching and accessing objects in Google Cloud Storage buckets.

You can create connectors in Stack Management > Connectors.

Google Cloud Storage connectors have the following configuration property:

Bearer Token
A Google OAuth 2.0 access token with Cloud Storage and Resource Manager API scopes. Refer to Get API credentials for instructions.

You can test connectors when you create or edit the connector in Kibana. The test verifies connectivity by calling the Google Cloud Storage API with the provided token.

The Google Cloud Storage connector has the following actions:

List projects

List Google Cloud projects accessible to the configured credentials. Use this to discover project IDs needed by the List buckets action.

  • pageSize (optional): Maximum number of projects to return (default: 100, max: 1000).
  • pageToken (optional): Token for pagination from a previous response.
  • filter (optional): Filter expression, for example lifecycleState:ACTIVE.
List buckets

List all Google Cloud Storage buckets in a project.

  • project (required): Google Cloud project ID. Use the List projects action to discover available project IDs.
  • maxResults (optional): Maximum number of buckets to return (default: 100, max: 1000).
  • pageToken (optional): Token for pagination from a previous response.
  • prefix (optional): Filter to only return buckets whose names begin with this prefix.
List objects

List objects in a GCS bucket. Supports prefix-based filtering to navigate folder-like hierarchies.

  • bucket (required): Name of the GCS bucket to list objects from.
  • prefix (optional): Filter objects whose names begin with this prefix. Use to navigate virtual folders, for example reports/2024/.
  • delimiter (optional): Character used to group object names. Use / to list only the current folder level.
  • maxResults (optional): Maximum number of objects to return (default: 100, max: 1000).
  • pageToken (optional): Token for pagination from a previous response.
Get object metadata

Retrieve detailed metadata for a specific GCS object, including content type, size, checksums, and timestamps.

  • bucket (required): Name of the bucket.
  • object (required): Full name or path of the object, for example reports/2024/january.pdf.
Download object

Download an object's content from GCS as base64-encoded data, suitable for text extraction and analysis.

  • bucket (required): Name of the bucket.
  • object (required): Full name or path of the object to download, for example reports/2024/january.pdf.

Use the Action configuration settings to customize connector networking, such as proxies, certificates, or TLS settings. You can set configurations that apply to all your connectors or use xpack.actions.customHostSettings to set per-host configurations.

To use the Google Cloud Storage connector, you need a Google OAuth 2.0 access token with Cloud Storage and Resource Manager API scopes. You can obtain one using the Google OAuth 2.0 Playground:

  1. Open the OAuth 2.0 Playground.
  2. In the list of APIs, select Cloud Storage JSON API v1 and select the https://www.googleapis.com/auth/devstorage.read_only scope. Then also select Cloud Resource Manager API v1 and select the https://www.googleapis.com/auth/cloudplatformprojects.readonly scope.
  3. Select Authorize APIs and sign in with your Google account.
  4. Select Exchange authorization code for tokens.
  5. Copy the Access token and enter it as the Bearer Token when configuring the connector in Kibana.