mr

package

v0.0.0-...-2717372 Latest Latest Go to latest Published: Sep 22, 2021 License: Apache-2.0 Imports: 15 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

View Source

const TaskInterval = 200

View Source

const TaskTimeout = 10

View Source

const TempDir = "tmp"

This section is empty.

func Worker(mapf func(string, string) []KeyValue,
	reducef func(string, []string) string)

main/mrworker.go calls this function.

type GetReduceCountArgs struct {
}

example to show how to declare the arguments and reply for an RPC.

type GetReduceCountReply struct {
	ReduceCount int
}

type JobStage int

type KeyValue struct {
	Key   string
	Value string
}

Map functions return a slice of KeyValue.

type Master struct {
	// contains filtered or unexported fields
}

func MakeMaster(files []string, nReduce int) *Master

create a Master. main/mrmaster.go calls this function. nReduce is the number of reduce tasks to use.

func (m *Master) Done() bool

main/mrmaster.go calls Done() periodically to find out if the entire job has finished.

func (m *Master) GetReduceCount(args *GetReduceCountArgs, reply *GetReduceCountReply) error

GetReduceCount RPC handler.

func (m *Master) ReportTaskDone(args *ReportTaskArgs, reply *ReportTaskReply) error

RequestTask RPC handler.

func (m *Master) RequestTask(args *RequestTaskArgs, reply *RequestTaskReply) error

RequestTask RPC handler.

type ReportTaskArgs struct {
	WorkerId int
	TaskType TaskType
	TaskId   int
}

type ReportTaskReply struct {
	CanExit bool
}

type RequestTaskArgs struct {
	WorkerId int
}

type RequestTaskReply struct {
	TaskType TaskType
	TaskId   int
	TaskFile string
}

type Task struct {
	Type     TaskType
	Status   TaskStatus
	Index    int
	File     string
	WorkerId int
}

type TaskStatus int

const (
	NotStarted TaskStatus = iota
	Executing
	Finished
)

type TaskType int

const (
	MapTask TaskType = iota
	ReduceTask
	NoTask
	ExitTask
)