kafka

package module

v0.1.2 Latest Latest Go to latest Published: Dec 20, 2020 License: MIT Imports: 10 Imported by: 1

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Package kafka implements the Apache Kafka connector.

This section is empty.

This section is empty.

This section is empty.

type GroupHandler struct {
	// contains filtered or unexported fields
}

GroupHandler represents a Sarama consumer group handler

func (handler *GroupHandler) Cleanup(sarama.ConsumerGroupSession) error

Cleanup is run at the end of a session, once all ConsumeClaim goroutines have exited

func (handler *GroupHandler) ConsumeClaim(session sarama.ConsumerGroupSession, claim sarama.ConsumerGroupClaim) error

ConsumeClaim must start a consumer loop of ConsumerGroupClaim's Messages().

func (handler *GroupHandler) Setup(sarama.ConsumerGroupSession) error

Setup is run at the beginning of a new session, before ConsumeClaim

type KafkaSink struct {
	// contains filtered or unexported fields
}

KafkaSink connector

func NewKafkaSink(addrs []string, config *sarama.Config, topic string) *KafkaSink

NewKafkaSink returns a new KafkaSink instance

func (ks *KafkaSink) In() chan<- interface{}

In returns an input channel for receiving data

type KafkaSource struct {
	// contains filtered or unexported fields
}

KafkaSource connector

func NewKafkaSource(ctx context.Context, addrs []string, groupID string,
	config *sarama.Config, topics ...string) *KafkaSource

NewKafkaSource returns a new KafkaSource instance

func (ks *KafkaSource) Out() <-chan interface{}

Out returns an output channel for sending data

func (ks *KafkaSource) Via(_flow streams.Flow) streams.Flow

Via streams data through the given flow