package textio

import "github.com/apache/beam/sdks/go/pkg/beam/io/textio"

Package textio contains transforms for reading and writing text files.

Index ¶

• func Immediate(s beam.Scope, filename string) (beam.PCollection, error)
• func Read(s beam.Scope, glob string) beam.PCollection
• func ReadAll(s beam.Scope, col beam.PCollection) beam.PCollection
• func Write(s beam.Scope, filename string, col beam.PCollection)

Package Files ¶

textio.go

func Immediate ¶ Uses

func Immediate(s beam.Scope, filename string) (beam.PCollection, error)

Immediate reads a local file at pipeline construction-time and embeds the data into a I/O-free pipeline source. Should be used for small files only.

func Read ¶ Uses

func Read(s beam.Scope, glob string) beam.PCollection

Read reads a set of file and returns the lines as a PCollection<string>. The newlines are not part of the lines.

func ReadAll ¶ Uses

func ReadAll(s beam.Scope, col beam.PCollection) beam.PCollection

ReadAll expands and reads the filename given as globs by the incoming PCollection<string>. It returns the lines of all files as a single PCollection<string>. The newlines are not part of the lines.

func Write ¶ Uses

func Write(s beam.Scope, filename string, col beam.PCollection)

Write writes a PCollection<string> to a file as separate lines. The writer add a newline after each element.