storage

package

v0.0.0-...-b01b166 Latest Latest Go to latest Published: Nov 27, 2021 License: Apache-2.0 Imports: 9 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/sheacloud/surithena

Links

Open Source Insights

Documentation ¶

Index ¶

type DateHourKey
type ParquetS3FileWriter
- func NewParquetS3FileWriter(api s3v2.S3API, bucket string, prefix string, key DateHourKey, ...) (*ParquetS3FileWriter, error)
type Rotatable
type RotatingWriter
- func NewRotatingWriter(api s3v2.S3API, bucket string, prefix string, ...) *RotatingWriter

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type DateHourKey ¶

type DateHourKey struct {
	Date string
	Hour int
}

type ParquetS3FileWriter ¶

type ParquetS3FileWriter struct {
	// contains filtered or unexported fields
}

func NewParquetS3FileWriter ¶

func NewParquetS3FileWriter(api s3v2.S3API, bucket string, prefix string, key DateHourKey, sampleObj interface{}) (*ParquetS3FileWriter, error)

func (*ParquetS3FileWriter) Close ¶

func (w *ParquetS3FileWriter) Close() error

func (*ParquetS3FileWriter) RotateFile ¶

func (w *ParquetS3FileWriter) RotateFile() error

func (*ParquetS3FileWriter) Write ¶

func (w *ParquetS3FileWriter) Write(obj interface{}) error

type Rotatable ¶

type Rotatable interface {
	GetDateHourKey() DateHourKey
	UpdateFields() error
}

type RotatingWriter ¶

type RotatingWriter struct {
	// contains filtered or unexported fields
}

func NewRotatingWriter ¶

func NewRotatingWriter(api s3v2.S3API, bucket string, prefix string, fileTimeoutMinutes, fileMaxAgeMinutes int, fileMaxSizeBytes int64) *RotatingWriter

func (*RotatingWriter) CleanFiles ¶

func (r *RotatingWriter) CleanFiles() error

func (*RotatingWriter) Close ¶

func (r *RotatingWriter) Close() error

func (*RotatingWriter) Write ¶

func (r *RotatingWriter) Write(obj Rotatable) error

Source Files ¶

View all Source files

parquet_s3.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL