v1datatransfer

package

v1.0.2 Latest Latest Go to latest Published: Sep 27, 2018 License: Apache-2.0 Imports: 20 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/nerdalize/nerd

Links

Open Source Insights

Documentation ¶

Index ¶

func Download(ctx context.Context, conf DownloadConfig) error
func GetLocalDatasetSize(ctx context.Context, dataPath string) (int64, error)
func GetRemoteDatasetSize(ctx context.Context, batchClient *v1batch.Client, dataOps v1data.DataOps, ...) (int64, error)
func Upload(ctx context.Context, conf UploadConfig) (*v1payload.DatasetSummary, error)
type DownloadConfig
type UploadConfig

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func Download ¶

func Download(ctx context.Context, conf DownloadConfig) error

Download downloads a dataset or fails if it is still being uploaded

func GetLocalDatasetSize ¶

func GetLocalDatasetSize(ctx context.Context, dataPath string) (int64, error)

GetLocalDatasetSize calculates the total size in bytes of the archived version of a directory on disk

func GetRemoteDatasetSize ¶

func GetRemoteDatasetSize(ctx context.Context, batchClient *v1batch.Client, dataOps v1data.DataOps, projectID, datasetID string) (int64, error)

GetRemoteDatasetSize gets the size of a dataset from the metadata object

func Upload ¶

func Upload(ctx context.Context, conf UploadConfig) (*v1payload.DatasetSummary, error)

Upload uploads a dataset

Types ¶

type DownloadConfig ¶

type DownloadConfig struct {
	BatchClient v1batch.ClientInterface
	DataOps     v1data.DataOps
	LocalDir    string
	ProjectID   string
	DatasetID   string
	Concurrency int
	ProgressCh  chan<- int64
}

DownloadConfig is the config for Download operations

type UploadConfig ¶

type UploadConfig struct {
	BatchClient *v1batch.Client
	DataOps     v1data.DataOps
	LocalDir    string
	ProjectID   string
	Concurrency int
	ProgressCh  chan<- int64
}

UploadConfig is the config for Upload operations

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
client
payload

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL