worker

package

v0.0.0-...-6b04d54 Latest Latest Go to latest Published: Apr 13, 2020 License: Apache-2.0 Imports: 15 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/hyper-ml/hyperml

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
func InvalidFlowTaskError() error
func InvalidFlowTaskStatus(status tsk.TaskStatus) error
type WorkHorse
- func NewWorkHorse(client *WorkerClient, serverAddr string, flowId string, taskId string, ...) *WorkHorse

Constants ¶

View Source

const (
	FileOpsConcurrency int = 5
	DefaultOutPath         = "/out"
	DefaultModelPath       = "/saved_models"
	DefaultSrcPath         = "/src"

	DefaultWorkSpacePerm = 0755
	DefaultModelPerm     = 0755
	DefaultOutPerm       = 0755

	IgnoreEmptyTask  bool = true
	IgnoreMountError bool = true

	DefaultWorkspaceDir = "workspace"

	CondaSpecName   = "environment.yml"
	DefaultCondaEnv = "python"
	PipReqFileName  = "requirements.txt"
)

Variables ¶

This section is empty.

Functions ¶

func InvalidFlowTaskError ¶

func InvalidFlowTaskError() error

func InvalidFlowTaskStatus ¶

func InvalidFlowTaskStatus(status tsk.TaskStatus) error

Types ¶

type WorkHorse ¶

type WorkHorse struct {
	Id string
	// contains filtered or unexported fields
}

func NewWorkHorse ¶

func NewWorkHorse(client *WorkerClient, serverAddr string, flowId string, taskId string, workerIp string, appDir string, logHandlr *utils.LogHandler) *WorkHorse

func (*WorkHorse) DoWork ¶

func (w *WorkHorse) DoWork() error

func (*WorkHorse) Init ¶

func (w *WorkHorse) Init() error

func (*WorkHorse) InitEnvironment ¶

func (w *WorkHorse) InitEnvironment() error

func (*WorkHorse) MountVolumes ¶

func (w *WorkHorse) MountVolumes() error

func (*WorkHorse) PushTaskStatus ¶

func (w *WorkHorse) PushTaskStatus(status tsk.TaskStatus) error

func (*WorkHorse) PushTaskStatusWithMessage ¶

func (w *WorkHorse) PushTaskStatusWithMessage(status tsk.TaskStatus, msg string) error

func (*WorkHorse) Shutdown ¶

func (w *WorkHorse) Shutdown() error

Source Files ¶

View all Source files

worker.go

Directories ¶

Path	Synopsis
api_client
cmd
workhorse
config
file_system
fuse
pkg
exec
rest_client
schema
test
utils
env_util
env_util/parsers
structs
worker_server

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL