The highest tagged major version is
README
¶
S3 Plugin
The S3 plugin archives every flush to S3 as a separate S3 object.
This plugin is still in an experimental state.
Config Options to connect to S3
Mandatory parameters below.
- aws_s3_bucket:
string - aws_region:
string
Optional parameters below.
- aws_access_key_id
string - aws_secret_access_key
string
The Go AWS SDK will load up Credentials in the following order. https://docs.aws.amazon.com/sdk-for-go/api/aws/session/
- Environment Variables
AWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY,AWS_SESSION_TOKEN,AWS_PROFILE,AWS_REGION - Shared Credentials file
~/.aws/credentials - Shared Configuration file (if SharedConfig is enabled)
export AWS_SDK_LOAD_CONFIG=1 - EC2 Instance Metadata (credentials only).
Documentation
¶
Index ¶
- Constants
- Variables
- func EncodeInterMetricCSV(d samplers.InterMetric, w *csv.Writer, partitionDate *time.Time, ...) error
- func EncodeInterMetricsCSV(metrics []samplers.InterMetric, delimiter rune, includeHeaders bool, ...) (io.ReadSeeker, error)
- func S3Path(hostname string, ft filetype) *string
- type S3Plugin
Constants ¶
const ( // the order in which these appear determines the // order of the fields in the resultant TSV TsvName tsvField = iota TsvTags TsvMetricType // The hostName of the server flushing the data TsvVeneurHostname TsvInterval TsvTimestamp TsvValue // This is the _partition field // required by the Redshift IncrementalLoader. // For our purposes, the current date is a good partition. TsvPartition )
const PartitionDateFormat = "20060102"
const RedshiftDateFormat = "2006-01-02 03:04:05"
Variables ¶
var S3ClientUninitializedError = errors.New("s3 client has not been initialized")
Functions ¶
func EncodeInterMetricCSV ¶ added in v1.7.0
func EncodeInterMetricCSV(d samplers.InterMetric, w *csv.Writer, partitionDate *time.Time, hostName string, interval int) error
EncodeInterMetricCSV generates a newline-terminated CSV row that describes the data represented by the InterMetric. The caller is responsible for setting w.Comma as the appropriate delimiter. For performance, encodeCSV does not flush after every call; the caller is expected to flush at the end of the operation cycle
func EncodeInterMetricsCSV ¶ added in v1.7.0
func EncodeInterMetricsCSV(metrics []samplers.InterMetric, delimiter rune, includeHeaders bool, hostname string, interval int) (io.ReadSeeker, error)
EncodeInterMetricsCSV returns a reader containing the gzipped CSV representation of the InterMetric data, one row per InterMetric. the AWS sdk requires seekable input, so we return a ReadSeeker here
Source Files
Directories