Discover Packages
github.com/phacops/pfs
lib
mapreduce
package
Version:
v0.7.1
Opens a new window with list of versions in this module.
Published: May 22, 2015
License: Apache-2.0
Opens a new window with license information.
Imports: 15
Opens a new window with list of imports.
Imported by: 0
Opens a new window with list of known importers.
Jump to ...
Documentation
Index
Constants
Variables
Functions
Map(job, jobName, m, shard, modulos)
Materialize(in_repo, branch, commit, outRepo, jobDir, shard, modulos)
PrepJob(job, jobName, m)
Reduce(job, jobName, m, shard, modulos)
WaitJob(outRepo, branch, commit, job)
Types
Source Files
Documentation
¶
func Map(job Job, jobName string, m materializeInfo, shard, modulos uint64)
func Materialize(in_repo, branch, commit, outRepo, jobDir string, shard, modulos uint64) error
func PrepJob(job Job, jobName string, m materializeInfo) error
func Reduce(job Job, jobName string, m materializeInfo, shard, modulos uint64)
func WaitJob(outRepo, branch, commit, job string) error
type Job
type Proto
func Map(job Job , jobName string , m materializeInfo, shard, modulos uint64 )
func Materialize(in_repo, branch, commit, outRepo, jobDir string , shard, modulos uint64 ) error
Materialize parses the jobs found in `in_repo`/`commit`/`jobDir` runs them
with `in_repo/commit` as input, outputs the results to `outRepo`/`branch`
and commits them as `outRepo`/`commit`
func Reduce(job Job , jobName string , m materializeInfo, shard, modulos uint64 )
func WaitJob(outRepo, branch, commit, job string ) error
type Job struct {
Type string `json:"type"`
Input string `json:"input"`
Image string `json:"image"`
Cmd []string `json:"command"`
Limit int `json:"limit"`
Parallel int `json:"parallel"`
TimeOut int `json:"timeout"`
CpuShares int `json:"cpu-shares"`
Memory int `json:"memory"`
}
¶
Click to show internal directories.
Click to hide internal directories.
Documentation
¶
Source Files