azblob

package
v0.0.0-...-eef0557 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 4, 2021 License: Apache-2.0 Imports: 7 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func NewAzBlobFileReader

func NewAzBlobFileReader(ctx context.Context, URL string, credential azblob.Credential, options ReaderOptions) (source.ParquetFile, error)

NewAzBlobFileReader creates an Azure Blob FileReader, to be used with NewParquetReader

func NewAzBlobFileWriter

func NewAzBlobFileWriter(ctx context.Context, URL string, credential azblob.Credential, options WriterOptions) (source.ParquetFile, error)

NewAzBlobFileWriter creates an Azure Blob FileWriter, to be used with NewParquetWriter

Types

type AzBlockBlob

type AzBlockBlob struct {
	URL *url.URL
	// contains filtered or unexported fields
}

AzBlockBlob is ParquetFile for azblob

func (*AzBlockBlob) Close

func (s *AzBlockBlob) Close() error

Close signals write completion and cleans up any open streams. Will block until pending uploads are complete.

func (*AzBlockBlob) Create

func (s *AzBlockBlob) Create(URL string) (source.ParquetFile, error)

Create a new blob url to perform writes

func (*AzBlockBlob) Open

func (s *AzBlockBlob) Open(URL string) (source.ParquetFile, error)

Open creates a new block blob to perform reads

func (*AzBlockBlob) Read

func (s *AzBlockBlob) Read(p []byte) (n int, err error)

Read up to len(p) bytes into p and return the number of bytes read

func (*AzBlockBlob) Seek

func (s *AzBlockBlob) Seek(offset int64, whence int) (int64, error)

Seek tracks the offset for the next Read. Has no effect on Write.

func (*AzBlockBlob) Write

func (s *AzBlockBlob) Write(p []byte) (n int, err error)

Write len(p) bytes from p

type ReaderOptions

type ReaderOptions struct {
	// HTTPSender configures the sender of HTTP requests
	HTTPSender pipeline.Factory
	// Retry configures the built-in retry policy behavior.
	RetryOptions azblob.RetryOptions
	// Log configures the pipeline's logging infrastructure indicating what information is logged and where.
	Log pipeline.LogOptions
}

ReaderOptions is used to configure azblob read behavior, including HTTP, retry, and logging settings

type WriterOptions

type WriterOptions struct {
	// HTTPSender configures the sender of HTTP requests
	HTTPSender pipeline.Factory
	// Retry configures the built-in retry policy behavior.
	RetryOptions azblob.RetryOptions
	// Log configures the pipeline's logging infrastructure indicating what information is logged and where.
	Log pipeline.LogOptions
	// Parallelism limits the number of go routines created to read blob content (0 = default)
	Parallelism int
}

WriterOptions is used to configure azblob write behavior, including HTTP, retry, and logging settings

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL