kafka

package

v0.0.0-...-1b33b2a Latest Latest Go to latest Published: Mar 5, 2024 License: Apache-2.0 Imports: 21 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/tikv/migration

Links

Open Source Insights

Documentation ¶

Index ¶

Variables
func CompleteConfigsAndOpts(sinkURI *url.URL, producerConfig *Config, replicaConfig *config.ReplicaConfig, ...) error
func NewKafkaSaramaProducer(ctx context.Context, topic string, config *Config, opts map[string]string, ...) (*kafkaSaramaProducer, error)
type Config
- func NewConfig() *Config

Constants ¶

This section is empty.

Variables ¶

View Source

var (
	NewSaramaConfigImpl                                 = newSaramaConfig
	NewAdminClientImpl  kafka.ClusterAdminClientCreator = kafka.NewSaramaAdminClient
)

Functions ¶

func CompleteConfigsAndOpts ¶

func CompleteConfigsAndOpts(sinkURI *url.URL, producerConfig *Config, replicaConfig *config.ReplicaConfig, opts map[string]string) error

CompleteConfigsAndOpts the kafka producer configuration, replication configuration and opts.

func NewKafkaSaramaProducer ¶

func NewKafkaSaramaProducer(ctx context.Context, topic string, config *Config, opts map[string]string, errCh chan error) (*kafkaSaramaProducer, error)

NewKafkaSaramaProducer creates a kafka sarama producer

Types ¶

type Config ¶

type Config struct {
	BrokerEndpoints []string
	PartitionNum    int32

	// User should make sure that `replication-factor` not greater than the number of kafka brokers.
	ReplicationFactor int16

	Version         string
	MaxMessageBytes int
	Compression     string
	ClientID        string
	Credential      *security.Credential
	SaslScram       *security.SaslScram
	// control whether to create topic
	AutoCreate bool
	// Whether to enable idempotent producer
	Idempotent bool
}

Config stores user specified Kafka producer configuration

func NewConfig ¶

func NewConfig() *Config

NewConfig returns a default Kafka configuration

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL