Documentation
¶
Overview ¶
Package filesystem provides a client with the ability to import data into Kusto via a variety of fileystems such as local storage or blobstore.
Index ¶
Constants ¶
const ( BlockSize = 8 * _1MiB Concurrency = 50 )
Variables ¶
This section is empty.
Functions ¶
func CompressionDiscovery ¶
func CompressionDiscovery(fName string) properties.CompressionType
CompressionDiscovery looks at the file extension. If it is one we support, we return that CompressionType that represents that value. Otherwise we return CTNone to indicate that the file should not be compressed.
func IsLocalPath ¶ added in v0.2.0
IsLocalPath detects whether a path points to a file system accessiable file If this file requires another protocol http protocol it will return false If the file requires another protocol(ftp, https, etc) it will return an error
Types ¶
type Ingestion ¶
type Ingestion struct {
// contains filtered or unexported fields
}
Ingestion provides methods for taking data from a filesystem of some type and ingesting it into Kusto. This object is scoped for a single database and table.
func (*Ingestion) Blob ¶
func (i *Ingestion) Blob(ctx context.Context, from string, fileSize int64, props properties.All) error
Blob ingests a file from Azure Blob Storage into Kusto.
type Option ¶ added in v0.5.0
type Option func(s *Ingestion)
Option is an optional argument to New().
func WithStaticBuffer ¶ added in v0.5.0
WithStaticBuffer sets a static buffer with a buffer size and max amount of buffers for uploading blobs to kusto.
Source Files