beam: github.com/apache/beam/sdks/go/pkg/beam/io/avroio Index | Files

package avroio

import "github.com/apache/beam/sdks/go/pkg/beam/io/avroio"

Package avroio contains transforms for reading and writing avro files.

Index

Package Files

avroio.go

func Read Uses

func Read(s beam.Scope, glob string, t reflect.Type) beam.PCollection

Read reads a set of files and returns lines as a PCollection<elem> based on the internal avro schema of the file. A type - reflect.TypeOf( YourType{} ) - with JSON tags can be defined or if you wish to return the raw JSON string, use - reflect.TypeOf("") -

func Write Uses

func Write(s beam.Scope, filename, schema string, col beam.PCollection)

Write writes a PCollection<string> to an AVRO file. Write expects a JSON string with a matching AVRO schema. the process will fail if the schema does not match the JSON provided

Package avroio imports 8 packages (graph) and is imported by 1 packages. Updated 2018-10-12. Refresh now. Tools for package owners.