consumer

type Consumer ¶

type Consumer struct {
	// contains filtered or unexported fields
}

Consumer reads segments from the queue, and replicates merged segments to the rest of the cluster. It's implemented as a state machine: gather segments, replicate, commit, and repeat. All failures invalidate the entire batch.

func New(
	client *http.Client,
	queue queue.Queue,
	log audit.Log,
	frequency time.Duration,
	consumedSegments, consumedRecords metrics.Counter,
	replicatedSegments, replicatedRecords metrics.Counter,
	failedSegments, failedRecords metrics.Counter,
	logger log.Logger,
) *Consumer

func (c *Consumer) Run()

func (c *Consumer) Stop()