gcsproxy

package
v2.31.2+incompatible Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 30, 2021 License: Apache-2.0, BSD-3-Clause, MIT Imports: 13 Imported by: 0

Documentation

Overview

Package gcsproxy contains artifact staging and retrieval servers backed by GCS.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func ReadProxyManifest

func ReadProxyManifest(ctx context.Context, object string) (*jobpb.ProxyManifest, error)

ReadProxyManifest reads and parses the proxy manifest from GCS.

Types

type RetrievalServer

type RetrievalServer struct {
	// contains filtered or unexported fields
}

RetrievalServer is a artifact retrieval server backed by Google Cloud Storage (GCS). It serves a single manifest and ignores the worker id. The server performs no caching or pre-fetching.

func NewRetrievalServer

func NewRetrievalServer(md *jobpb.ProxyManifest) (*RetrievalServer, error)

NewRetrievalServer creates a artifact retrieval server for the given manifest. It requires that the locations are in GCS.

func (*RetrievalServer) GetArtifact

GetArtifact returns a given artifact.

func (*RetrievalServer) GetManifest

GetManifest returns the manifest for all artifacts.

type StagingServer

type StagingServer struct {
	// contains filtered or unexported fields
}

StagingServer is a artifact staging server backed by Google Cloud Storage (GCS). It commits a single manifest and ignores the staging id.

func NewStagingServer

func NewStagingServer(manifest string) (*StagingServer, error)

NewStagingServer creates a artifact staging server for the given manifest. It requires that the manifest is in GCS and will stage the supplied artifacts next to it.

func (*StagingServer) CommitManifest

CommitManifest commits the given artifact manifest to GCS.

func (*StagingServer) PutArtifact

PutArtifact stores the given artifact in GCS.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL