stream

package

v0.0.0-...-f50f273 Latest Latest Go to latest Published: Jan 21, 2021 License: MIT Imports: 6 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/spy16/fusion

Links

Open Source Insights

Documentation ¶

Index ¶

type Kafka
- func (ks Kafka) Out(ctx context.Context) (<-chan fusion.Msg, error)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Kafka ¶

type Kafka struct {
	Workers  int           `json:"workers"`
	Topic    string        `json:"topic"`
	Brokers  []string      `json:"brokers"`
	GroupID  string        `json:"group_id"`
	MinBytes int           `json:"min_bytes"`
	MaxBytes int           `json:"max_bytes"`
	MaxWait  time.Duration `json:"max_wait"`
	// contains filtered or unexported fields
}

Kafka implements fusion stream using the Kafka system as the backend with support for consumer groups. This implementation uses manual commit based on the Ack function to ensure at-least once delivery. Downstream consumers must take care of idempotency.

func (Kafka) Out ¶

func (ks Kafka) Out(ctx context.Context) (<-chan fusion.Msg, error)

Out validates the Kafka config, creates a kafka consumer connection to the cluster and returns a fusion message channel where it streams the messages from Kafka.

Source Files ¶

View all Source files

kafka.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL