gorelka

command module
v0.0.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 29, 2017 License: Apache-2.0 Imports: 14 Imported by: 0

README

Graphite To Multiple Transports

This project provides a relay that can accept metrics in various formats (initially Graphite Line protocol) and send them through various ways.

Status

Early Proof of Concept. Compiles, but not tested extensively

Features

General:

  • Don't store metrics forever in queues in case destination is unavailable
  • Internal stats
  • Extended stats

Calculator:

  • Calculate real metric frequency
  • Detect semi-frequent metrics

Input:

  • TCP
  • UDP
  • Unix Socket
  • TLS
  • Configurable encoding

Input Encoders:

  • Graphite Line Protocol
  • Graphite Line Protocol with tags
  • Metrics 2.0
  • InfluxDB Line Protocol

Output Encoders:

  • Graphite Line Protocol
  • JSON
  • Protobuf
  • kafkamdm

Output:

  • Kafka
  • TCP
  • UDP
  • Unix Socket

Routing:

  • Regexp matching (Re2-based)
  • Rewrites
  • Prefix Matching
  • Blackhole sender
  • Log on receive
  • PCRE Regexp Matching

LoadBalancing:

Documentation:

  • At least some docs
  • Design documentation
  • Extended docs

Known issues

  • Some internal queues (if you can call it queues) have no limit so malformed or unthrottled input might lead to OOM issues
  • If backend go down, first point in queue will be lost
  • Performance is untested, at least RegExps matching can be very slow
  • Config format is far from perfect (readability, easy of modification, easy of generation)
  • Unstable config format

Acknowledgement

This program was originally developed for Booking.com. With approval from Booking.com, the code was generalised and published as Open Source on GitHub, for which the author would like to express his gratitude.

License

This code is licensed under the Apache2 license.

Documentation

The Go Gopher

There is no documentation for this package.

Directories

Path Synopsis
Package carbon is a generated protocol buffer package.
Package carbon is a generated protocol buffer package.
encoders

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL