gcs

README

Google Cloud Storage Input Plugin

The Google Cloud Storage plugin will collect metrics on the given Google Cloud Storage Buckets.

Global configuration options

In addition to the plugin-specific configuration settings, plugins support additional global and plugin configuration settings. These settings are used to modify metrics, tags, and field or create aliases and configure ordering, etc. See the CONFIGURATION.md for more details.

Configuration

# Gather metrics by iterating the files located on a Cloud Storage Bucket.
[[inputs.google_cloud_storage]]
  ## Required. Name of Cloud Storage bucket to ingest metrics from.
  bucket = "my-bucket"

  ## Optional. Prefix of Cloud Storage bucket keys to list metrics from.
  # key_prefix = "my-bucket"

  ## Key that will store the offsets in order to pick up where the ingestion was left.
  offset_key = "offset_key"

  ## Key that will store the offsets in order to pick up where the ingestion was left.
  objects_per_iteration = 10

  ## Required. Data format to consume.
  ## Each data format has its own unique set of configuration options.
  ## Read more about them here:
  ## https://github.com/influxdata/telegraf/blob/master/docs/DATA_FORMATS_INPUT.md
  data_format = "influx"

  ## Optional. Filepath for GCP credentials JSON file to authorize calls to
  ## Google Cloud Storage APIs. If not set explicitly, Telegraf will attempt to use
  ## Application Default Credentials, which is preferred.
  # credentials_file = "path/to/my/creds.json"

Metrics

• Measurements will reside on Google Cloud Storage with the format specified

• example when [[inputs.google_cloud_storage.data_format]] is json

{
  "metrics": [
    {
      "fields": {
        "cosine": 10,
        "sine": -1.0975806427415925e-12
      },
      "name": "cpu",
      "tags": {
        "datacenter": "us-east-1",
        "host": "localhost"
      },
      "timestamp": 1604148850990
    }
  ]
}

Example Output

google_cloud_storage,datacenter=us-east-1,host=localhost cosine=10,sine=-1.0975806427415925e-12 1604148850990000000

Documentation

Index

• type GCS
  • func (gcs *GCS) Gather(acc telegraf.Accumulator) error
  • func (gcs *GCS) Init() error
  • func (gcs *GCS) SampleConfig() string
  • func (gcs *GCS) SetParser(parser telegraf.Parser)
• type OffSet
  • func NewEmptyOffset() *OffSet
  • func NewOffset(offset string) *OffSet

Types

type GCS

type GCS struct {
	CredentialsFile string `toml:"credentials_file"`
	Bucket          string `toml:"bucket"`

	Prefix              string `toml:"key_prefix"`
	OffsetKey           string `toml:"offset_key"`
	ObjectsPerIteration int    `toml:"objects_per_iteration"`

	Log telegraf.Logger
	// contains filtered or unexported fields
}

func (*GCS) Gather

func (gcs *GCS) Gather(acc telegraf.Accumulator) error

func (*GCS) Init

func (gcs *GCS) Init() error

func (*GCS) SampleConfig

func (gcs *GCS) SampleConfig() string

func (*GCS) SetParser

func (gcs *GCS) SetParser(parser telegraf.Parser)

type OffSet

type OffSet struct {
	OffSet string `json:"offSet"`
}

func NewEmptyOffset

func NewEmptyOffset() *OffSet

func NewOffset

func NewOffset(offset string) *OffSet