parquet

package
v0.40.4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 19, 2022 License: Apache-2.0 Imports: 15 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type ParquetReader

type ParquetReader struct {
	// contains filtered or unexported fields
}

ParquetReader implements TableReader. It reads parquet files and returns rows.

func NewParquetReader

func NewParquetReader(vrw types.ValueReadWriter, fr source.ParquetFile, sche schema.Schema) (*ParquetReader, error)

NewParquetReader creates a ParquetReader from a given fileReader. The ParquetFileInfo should describe the parquet file being read.

func OpenParquetReader

func OpenParquetReader(vrw types.ValueReadWriter, path string, sch schema.Schema) (*ParquetReader, error)

OpenParquetReader opens a reader at a given path within local filesystem.

func (*ParquetReader) Close

func (pr *ParquetReader) Close(ctx context.Context) error

Close should release resources being held

func (*ParquetReader) GetSchema

func (pr *ParquetReader) GetSchema() schema.Schema

func (*ParquetReader) ReadRow

func (pr *ParquetReader) ReadRow(ctx context.Context) (row.Row, error)

func (*ParquetReader) ReadSqlRow

func (pr *ParquetReader) ReadSqlRow(ctx context.Context) (sql.Row, error)

type ParquetWriter

type ParquetWriter struct {
	// contains filtered or unexported fields
}

func NewParquetWriter

func NewParquetWriter(outSch schema.Schema, destName string) (*ParquetWriter, error)

func (*ParquetWriter) Close

func (pwr *ParquetWriter) Close(ctx context.Context) error

Close should flush all writes, release resources being held

func (*ParquetWriter) GetSchema

func (pwr *ParquetWriter) GetSchema() schema.Schema

func (*ParquetWriter) WriteRow

func (pwr *ParquetWriter) WriteRow(ctx context.Context, r row.Row) error

WriteRow will write a row to a table

func (*ParquetWriter) WriteSqlRow

func (pwr *ParquetWriter) WriteSqlRow(ctx context.Context, r sql.Row) error

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL