Documentation
¶
Index ¶
- func GetMemFileFs() afero.Fs
- func NewMemFileWriter(name string, f OnCloseFunc) (source.ParquetFile, error)
- func SetInMemFileFs(fs *afero.Fs)
- type MemFile
- func (fs *MemFile) Close() error
- func (fs *MemFile) Create(name string) (source.ParquetFile, error)
- func (fs *MemFile) Open(name string) (source.ParquetFile, error)
- func (fs *MemFile) Read(b []byte) (cnt int, err error)
- func (fs *MemFile) Seek(offset int64, pos int) (int64, error)
- func (fs *MemFile) Write(b []byte) (n int, err error)
- type OnCloseFunc
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func GetMemFileFs ¶
GetMemFileFs - returns the current memory file-system being used by ParquetFile
func NewMemFileWriter ¶
func NewMemFileWriter(name string, f OnCloseFunc) (source.ParquetFile, error)
NewMemFileWriter - intiates and creates an instance of MemFiles NOTE: there is no NewMemFileReader as this particular type was written to handle in-memory conversions and offloading. The results of conversion can then be stored and read via HDFS, LocalFS, etc without the need for loading the file back into memory directly
func SetInMemFileFs ¶
SetInMemFileFs - overrides local in-memory fileSystem NOTE: this is set by NewMemFileWriter is created and memFs is still nil
Types ¶
type MemFile ¶
type MemFile struct {
FilePath string
File afero.File
OnClose OnCloseFunc
}
MemFile - ParquetFile type for in-memory file operations
func (*MemFile) Create ¶
func (fs *MemFile) Create(name string) (source.ParquetFile, error)
Create - create in-memory file
func (*MemFile) Open ¶
func (fs *MemFile) Open(name string) (source.ParquetFile, error)
Open - open file in-memory
Source Files
Click to show internal directories.
Click to hide internal directories.