ParquetFile

package

v0.0.0-...-7fe110c Latest Latest Go to latest Published: May 3, 2019 License: Apache-2.0 Imports: 4 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/krehermann/parquet-go

Documentation ¶

Index ¶

func ConvertToThriftReader(file ParquetFile, offset int64, size int64) *thrift.TBufferedTransport
type BufferFile
type LocalFile
type ParquetFile
type WriterFile

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func ConvertToThriftReader ¶

func ConvertToThriftReader(file ParquetFile, offset int64, size int64) *thrift.TBufferedTransport

Convert a file reater to Thrift reader

Types ¶

type BufferFile ¶

type BufferFile struct {
	Reader *bytes.Reader
	Writer *bytes.Buffer
	// contains filtered or unexported fields
}

BufferFile allows reading parquet messages from a memory buffer.

func (BufferFile) Bytes ¶

func (bf BufferFile) Bytes() []byte

func (BufferFile) Close ¶

func (bf BufferFile) Close() error

Close is a no-op for a memory buffer.

func (BufferFile) Create ¶

func (bf BufferFile) Create(name string) (ParquetFile, error)

func (BufferFile) Open ¶

func (bf BufferFile) Open(name string) (ParquetFile, error)

func (BufferFile) Read ¶

func (bf BufferFile) Read(p []byte) (cnt int, err error)

Read reads data form BufferFile into p.

func (BufferFile) Seek ¶

func (bf BufferFile) Seek(offset int64, pos int) (int64, error)

Seek seeks in the underlying memory buffer.

func (BufferFile) Write ¶

func (bf BufferFile) Write(p []byte) (int, error)

Write writes data from p into BufferFile.

type LocalFile ¶

type LocalFile struct {
	FilePath string
	File     *os.File
}

func (*LocalFile) Close ¶

func (self *LocalFile) Close() error

func (*LocalFile) Create ¶

func (self *LocalFile) Create(name string) (ParquetFile, error)

func (*LocalFile) Open ¶

func (self *LocalFile) Open(name string) (ParquetFile, error)

func (*LocalFile) Read ¶

func (self *LocalFile) Read(b []byte) (cnt int, err error)

func (*LocalFile) Seek ¶

func (self *LocalFile) Seek(offset int64, pos int) (int64, error)

func (*LocalFile) Write ¶

func (self *LocalFile) Write(b []byte) (n int, err error)

type ParquetFile ¶

type ParquetFile interface {
	io.Seeker
	io.Reader
	io.Writer
	io.Closer
	Open(name string) (ParquetFile, error)
	Create(name string) (ParquetFile, error)
}

func NewBufferFile ¶

func NewBufferFile(b []byte) (ParquetFile, error)

NewBufferFile creates new in memory parquet buffer.

func NewLocalFileReader ¶

func NewLocalFileReader(name string) (ParquetFile, error)

func NewLocalFileWriter ¶

func NewLocalFileWriter(name string) (ParquetFile, error)

func NewWriterFile ¶

func NewWriterFile(writer io.Writer) ParquetFile

type WriterFile ¶

type WriterFile struct {
	Writer io.Writer
}

func (*WriterFile) Close ¶

func (self *WriterFile) Close() error

func (*WriterFile) Create ¶

func (self *WriterFile) Create(name string) (ParquetFile, error)

func (*WriterFile) Open ¶

func (self *WriterFile) Open(name string) (ParquetFile, error)

func (*WriterFile) Read ¶

func (self *WriterFile) Read(b []byte) (int, error)

func (*WriterFile) Seek ¶

func (self *WriterFile) Seek(offset int64, pos int) (int64, error)

func (*WriterFile) Write ¶

func (self *WriterFile) Write(b []byte) (int, error)

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL