storage

package

v2.10.0 Latest Latest Go to latest Published: May 15, 2024 License: Apache-2.0 Imports: 29 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/pachyderm/pachyderm

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
func GlobLiteralPrefix(glob string) string
func ValidateFilename(p string) error
type Env
type Server
- func New(ctx context.Context, env Env) (*Server, error)

Constants ¶

View Source

const (
	ChunkPrefix = "chunk/"
)

Variables ¶

This section is empty.

Functions ¶

func GlobLiteralPrefix ¶ added in v2.10.0

func GlobLiteralPrefix(glob string) string

func ValidateFilename ¶ added in v2.10.0

func ValidateFilename(p string) error

Types ¶

type Env ¶

type Env struct {
	DB *pachsql.DB
	// ObjectStore is a client from the obj package
	ObjectStore obj.Client

	// Bucket is an object storage bucket from the Go CDK packages.
	// If set, it takes priority over ObjectStore
	Bucket *blob.Bucket
	Config pachconfig.StorageConfiguration
}

type Server ¶

type Server struct {
	storage.UnimplementedFilesetServer
	Filesets *fileset.Storage
	Chunks   *chunk.Storage
	Tracker  track.Tracker
}

Server contains the storage layer servers.

func New ¶

func New(ctx context.Context, env Env) (*Server, error)

New creates a new Server

func (*Server) ComposeFileset ¶ added in v2.10.0

func (s *Server) ComposeFileset(ctx context.Context, request *storage.ComposeFilesetRequest) (*storage.ComposeFilesetResponse, error)

func (*Server) CreateFileset ¶ added in v2.10.0

func (s *Server) CreateFileset(server storage.Fileset_CreateFilesetServer) error

TODO: Copy file.

func (*Server) ReadFileset ¶ added in v2.10.0

func (s *Server) ReadFileset(request *storage.ReadFilesetRequest, server storage.Fileset_ReadFilesetServer) error

TODO: Add file filter error types.

func (*Server) RenewFileset ¶ added in v2.10.0

func (s *Server) RenewFileset(ctx context.Context, request *storage.RenewFilesetRequest) (*emptypb.Empty, error)

TODO: We should be able to use this and potentially others directly in PFS.

func (*Server) ShardFileset ¶ added in v2.10.0

func (s *Server) ShardFileset(ctx context.Context, request *storage.ShardFilesetRequest) (*storage.ShardFilesetResponse, error)

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
chunk Package chunk provides access to data through content-addressed chunks.	Package chunk provides access to data through content-addressed chunks.
fileset Package fileset provides access to files through file sets.	Package fileset provides access to files through file sets.
index Package index provides access to files through multilevel indexes.	Package index provides access to files through multilevel indexes.
kv Package kv provides a Key-Value Store interface and a few implementations.	Package kv provides a Key-Value Store interface and a few implementations.
metrics
renew
track

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL