ingestion

package

v0.0.0-...-bbf0bf7 Latest Latest Go to latest Published: Jul 3, 2023 License: Apache-2.0 Imports: 10 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/spaghettifunk/norman

Links

Open Source Insights

Documentation ¶

Index ¶

type Ingestion
type Job
- func NewJob(cfg *cingestion.IngestionJobConfiguration, table *entities.Table) (*Job, error)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Ingestion ¶

type Ingestion interface {
	Initialize() error
	GetEvents() error
	Shutdown(failure bool) error
}

type Job ¶

type Job struct {
	ID              uuid.UUID
	IngestionClient Ingestion
	Configuration   *cingestion.IngestionJobConfiguration
	JobStatus       cingestion.JobStatus
	// contains filtered or unexported fields
}

func NewJob ¶

func NewJob(cfg *cingestion.IngestionJobConfiguration, table *entities.Table) (*Job, error)

NewJob creates a new Job based on the configuration in input

func (*Job) Execute ¶

func (j *Job) Execute() error

func (*Job) Initialize ¶

func (j *Job) Initialize() error

Initialize initiate the client and prepare for data reading process

func (*Job) OnFailure ¶

func (j *Job) OnFailure(e error)

func (*Job) Shutdown ¶

func (j *Job) Shutdown(failure bool) error

Shutdown terminate the process of data incoming

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
offline
blob
file
realtime
kafka
kinesis

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL