publishers

package
v0.0.0-...-9c2cc9a Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 26, 2019 License: Apache-2.0 Imports: 11 Imported by: 0

Documentation

Overview

Package publishers ...

Copyright © 2019 hajime-terasawa <terako.studio@gmail.com>

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Package publishers ...

Copyright © 2019 hajime-terasawa <terako.studio@gmail.com>

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Index

Constants

View Source
const (
	// 500 records
	LIMIT_RECORDS_PER_REQUEST = 500
	// 1 MB
	LIMIT_SIZE_PER_RECORD = 1000000
	// 5 MB
	LIMIT_SIZE_PER_REQUEST = 5000000
	// 4 MB
	PUBLISH_READINESS_THRESHOLD = 4000000
)

Variables

This section is empty.

Functions

This section is empty.

Types

type KinesisDataStreamsPublisher

type KinesisDataStreamsPublisher struct {
	*kinesis.Kinesis
	// contains filtered or unexported fields
}

KinesisDataStreamsPublisher implements Publisher for KinesisDataStreams

func BuildKinesisDataStreamsPublisher

func BuildKinesisDataStreamsPublisher() (*KinesisDataStreamsPublisher, error)

BuildKinesisDataStreamsPublisher builds KinesisDataStreams specific Publisher

func (*KinesisDataStreamsPublisher) Publish

Publish publishes events to the destination. KinesisDataStreamsPublisher works like events buffer for performance. it returns num of events being published when actually call Kinesis PutRecords API.

type Publisher

type Publisher interface {
	Publish(event *converters.InternalRow) (int, error)
}

Publisher provides event publishing

func BuildPublisher

func BuildPublisher() (Publisher, error)

BuildPublisher builds Publisher for abstraction

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL