pachyderm: github.com/pachyderm/pachyderm/src/server/pfs/server Index | Files

package server

import "github.com/pachyderm/pachyderm/src/server/pfs/server"

Index

Package Files

api_server.go cache_stats.go driver.go obj_block_api_server.go server.go testing.go transaction_defer.go

Constants

const (
    MinioBackendEnvVar     = "MINIO"
    AmazonBackendEnvVar    = "AMAZON"
    GoogleBackendEnvVar    = "GOOGLE"
    MicrosoftBackendEnvVar = "MICROSOFT"
    LocalBackendEnvVar     = "LOCAL"
)

Valid object storage backends

func GetPachClient Uses

func GetPachClient(t testing.TB) *client.APIClient

GetPachClient initializes a new PFSAPIServer and blockAPIServer and begins serving requests for them on a new port, and then returns a client connected to the new servers (allows PFS tests to run in parallel without conflict)

func IsPermissionError Uses

func IsPermissionError(err error) bool

IsPermissionError returns true if a given error is a permission error.

func RegisterCacheStats Uses

func RegisterCacheStats(cacheName string, groupCacheStats *groupcache.Stats)

RegisterCacheStats creates a new wrapper for groupcache stats that implements the prometheus.Collector interface, and registers it

type APIServer Uses

type APIServer interface {
    pfsclient.APIServer
    txnenv.PfsTransactionServer
}

APIServer represents an api server.

func NewAPIServer Uses

func NewAPIServer(
    env *serviceenv.ServiceEnv,
    txnEnv *txnenv.TransactionEnv,
    etcdPrefix string,
    treeCache *hashtree.Cache,
    storageRoot string,
    memoryRequest int64,
) (APIServer, error)

NewAPIServer creates an APIServer.

type BlockAPIServer Uses

type BlockAPIServer interface {
    pfsclient.ObjectAPIServer
}

BlockAPIServer combines BlockAPIServer and ObjectAPIServer.

func NewBlockAPIServer Uses

func NewBlockAPIServer(dir string, cacheBytes int64, backend string, etcdAddress string) (BlockAPIServer, error)

NewBlockAPIServer creates a BlockAPIServer using the credentials it finds in the environment

type CommitEvent Uses

type CommitEvent struct {
    Err   error
    Value *pfs.CommitInfo
}

CommitEvent is an event that contains a CommitInfo or an error

type CommitStream Uses

type CommitStream interface {
    Stream() <-chan CommitEvent
    Close()
}

CommitStream is a stream of CommitInfos

type ErrBranchInfoNotFound Uses

type ErrBranchInfoNotFound struct {
    Branch *pfs.Branch
}

ErrBranchInfoNotFound Branch info could not be found. Typically because of an incomplete deletion of a branch. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrBranchInfoNotFound) Error Uses

func (e ErrBranchInfoNotFound) Error() string

type ErrBranchProvenanceTransitivity Uses

type ErrBranchProvenanceTransitivity struct {
    BranchInfo     *pfs.BranchInfo
    FullProvenance []*pfs.Branch
}

ErrBranchProvenanceTransitivity Branch provenance is not transitively closed. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrBranchProvenanceTransitivity) Error Uses

func (e ErrBranchProvenanceTransitivity) Error() string

type ErrCommitInfoNotFound Uses

type ErrCommitInfoNotFound struct {
    Location string
    Commit   *pfs.Commit
}

ErrCommitInfoNotFound Commit info could not be found. Typically because of an incomplete deletion of a commit. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrCommitInfoNotFound) Error Uses

func (e ErrCommitInfoNotFound) Error() string

type ErrHeadProvenanceInconsistentWithBranch Uses

type ErrHeadProvenanceInconsistentWithBranch struct {
    BranchInfo     *pfs.BranchInfo
    ProvBranchInfo *pfs.BranchInfo
    HeadCommitInfo *pfs.CommitInfo
}

ErrHeadProvenanceInconsistentWithBranch The head provenance of a branch does not match the branch's provenance This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrHeadProvenanceInconsistentWithBranch) Error Uses

func (e ErrHeadProvenanceInconsistentWithBranch) Error() string

type ErrInconsistentCommitProvenance Uses

type ErrInconsistentCommitProvenance struct {
    CommitProvenance *pfs.CommitProvenance
}

ErrInconsistentCommitProvenance Commit provenance somehow has a branch and commit from different repos. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrInconsistentCommitProvenance) Error Uses

func (e ErrInconsistentCommitProvenance) Error() string

type ErrNilCommitInSubvenance Uses

type ErrNilCommitInSubvenance struct {
    CommitInfo      *pfs.CommitInfo
    SubvenanceRange *pfs.CommitRange
}

ErrNilCommitInSubvenance Commit provenance somehow has a branch and commit from different repos. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrNilCommitInSubvenance) Error Uses

func (e ErrNilCommitInSubvenance) Error() string

type ErrProvenanceOfSubvenance Uses

type ErrProvenanceOfSubvenance struct {
    CommitInfo     *pfs.CommitInfo
    SubvCommitInfo *pfs.CommitInfo
}

ErrProvenanceOfSubvenance The commit was not found in its subvenance's provenance This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrProvenanceOfSubvenance) Error Uses

func (e ErrProvenanceOfSubvenance) Error() string

type ErrProvenanceTransitivity Uses

type ErrProvenanceTransitivity struct {
    CommitInfo     *pfs.CommitInfo
    FullProvenance []*pfs.Commit
}

ErrProvenanceTransitivity Commit provenance is not transitively closed. This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrProvenanceTransitivity) Error Uses

func (e ErrProvenanceTransitivity) Error() string

type ErrSubvenanceOfProvenance Uses

type ErrSubvenanceOfProvenance struct {
    CommitInfo     *pfs.CommitInfo
    ProvCommitInfo *pfs.CommitInfo
}

ErrSubvenanceOfProvenance The commit was not found in its provenance's subvenance This struct contains all the information that was used to demonstrate that this invariant is not being satisfied.

func (ErrSubvenanceOfProvenance) Error Uses

func (e ErrSubvenanceOfProvenance) Error() string

type Propagater Uses

type Propagater struct {
    // contains filtered or unexported fields
}

Propagater is an object that is used to propagate PFS branches at the end of a transaction. The transactionenv package provides the interface for this and will call the Run function at the end of a transaction.

func (*Propagater) PropagateCommit Uses

func (t *Propagater) PropagateCommit(branch *pfs.Branch, isNewCommit bool) error

PropagateCommit marks a branch as needing propagation once the transaction successfully ends. This will be performed by the Run function.

func (*Propagater) Run Uses

func (t *Propagater) Run() error

Run performs any final tasks and cleanup tasks in the STM, such as propagating branches

Package server imports 62 packages (graph) and is imported by 3 packages. Updated 2019-08-21. Refresh now. Tools for package owners.