README
¶
logs-agent
logs-agent collects logs and submits them to datadog's infrastructure.
Structure
logs reads the config files, and instantiates what's needed.
Each log line comes from a source (e.g. file, network, docker), and then enters one of the available pipeline - tailer|listener|container -> decoder -> processor -> sender -> auditor
Tailer tails a file and submits data to the processors
Listener listens on local network (TCP, UDP, Unix) and submits data to the processors
Container scans docker logs from stdout/stderr and submits data to the processors
Decoder converts bytes arrays into messages
Processor updates the messages, filtering, redacting or adding metadata, and submits to the forwarder
Sender submits the messages to the intake, and notifies the auditor
Auditor notes that messages were properly submitted, stores offsets for agent restarts
Tests
# Run the unit tests
inv test --targets=./pkg/logs --timeout=10
Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func GetScheduler ¶
GetScheduler returns the logs-config scheduler if set.
func IsAgentRunning ¶
func IsAgentRunning() bool
IsAgentRunning returns true if the logs-agent is running.
Types ¶
type Agent ¶
type Agent struct {
// contains filtered or unexported fields
}
Agent represents the data pipeline that collects, decodes, processes and sends logs to the backend + ------------------------------------------------------ + | | | Collector -> Decoder -> Processor -> Sender -> Auditor | | | + ------------------------------------------------------ +
func NewAgent ¶
func NewAgent(sources *config.LogSources, services *service.Services, processingRules []*config.ProcessingRule, endpoints *config.Endpoints) *Agent
NewAgent returns a new Agent
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
input
|
|
|
Package pb is a generated protocol buffer package.
|
Package pb is a generated protocol buffer package. |