pachyderm: github.com/pachyderm/pachyderm/src/server/worker Index | Files | Directories

package worker

import "github.com/pachyderm/pachyderm/src/server/worker"

Index

Package Files

worker.go

type Worker Uses

type Worker struct {
    APIServer *server.APIServer // Provides rpcs for other nodes in the cluster
    // contains filtered or unexported fields
}

The Worker object represents

func NewWorker Uses

func NewWorker(
    pachClient *client.APIClient,
    etcdClient *etcd.Client,
    etcdPrefix string,
    pipelineInfo *pps.PipelineInfo,
    workerName string,
    namespace string,
    hashtreePath string,
    rootPath string,
) (*Worker, error)

NewWorker constructs a Worker object that provides all worker functionality:

1. a master goroutine that attempts to obtain the master lock for the pipeline workers and direct jobs
2. a worker goroutine that gets tasks from the master and processes them
3. an api server that serves requests for status or cross-worker communication
4. a driver that provides common functionality between the above components

Directories

PathSynopsis
cache
common
datum
driver
logs
server
stats

Package worker imports 24 packages (graph) and is imported by 3 packages. Updated 2020-08-09. Refresh now. Tools for package owners.