bigquery

package

v1.6.1 Latest Latest Go to latest Published: Aug 1, 2023 License: MIT Imports: 20 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/kelindar/talaria

Links

Open Source Insights

README ¶

Google Big Query

This sink implements Google Big Query protocol. It can can be enabled by adding the following configuration in the tables section:

tables:
  eventlog:
    compact:                               # enable compaction
      interval: 60                         # compact every 60 seconds
      nameFunc: "s3://bucket/namefunc.lua" # file name function
      bigquery:                            # sink to use
        project: "project-id-1"            # project ID
        dataset: "mydataset"               # big query dataset ID
        table: "mytable"                   # big query table ID
...

Documentation ¶

Index ¶

type Writer
- func New(project, dataset, table, encoding, filter string, monitor monitor.Monitor) (*Writer, error)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type Writer ¶

type Writer struct {
	*base.Writer
	// contains filtered or unexported fields
}

Writer represents a writer for Google Cloud Storage.

func New ¶

func New(project, dataset, table, encoding, filter string, monitor monitor.Monitor) (*Writer, error)

New creates a new writer.

func (*Writer) Close ¶

func (w *Writer) Close() error

Close closes the writer.

func (*Writer) Stream ¶ added in v1.6.0

func (w *Writer) Stream(row block.Row) error

Stream publishes the rows in real-time.

func (*Writer) Write ¶

func (w *Writer) Write(key key.Key, blocks []block.Block) error

Write writes the data to the sink.

Source Files ¶

View all Source files

bigquery.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL