mr

package

v0.0.0-...-3691d1c Latest Latest Go to latest Published: Mar 1, 2024 License: MIT Imports: 13 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/littlecat-git/map_reduce

Links

Open Source Insights

Documentation ¶

Index ¶

func Worker(mapf func(string, string) []KeyValue, reducef func(string, []string) string)
type ByKey
type CallArgs
type CallReply
type Coordinator
- func MakeCoordinator(files []string, nReduce int) *Coordinator
type KeyValue
type Task
type TaskStatus
type TaskType

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func Worker ¶

func Worker(mapf func(string, string) []KeyValue,
	reducef func(string, []string) string)

main/mrworker.go calls this function.

Types ¶

type ByKey ¶

type ByKey []KeyValue

func (ByKey) Len ¶

func (a ByKey) Len() int

for sorting by key.

func (ByKey) Less ¶

func (a ByKey) Less(i, j int) bool

func (ByKey) Swap ¶

func (a ByKey) Swap(i, j int)

type CallArgs ¶

type CallArgs struct {
	TaskIndex             int
	TaskType              int
	IntermediateFileNames []string
}

Add your RPC definitions here.

type CallReply ¶

type CallReply struct {
	TaskType              int
	TaskIndex             int
	FileName              string
	NReduce               int
	IntermediateFileNames []string
}

type Coordinator ¶

type Coordinator struct {
	// contains filtered or unexported fields
}

func MakeCoordinator ¶

func MakeCoordinator(files []string, nReduce int) *Coordinator

create a Coordinator. main/mrcoordinator.go calls this function. nReduce is the number of reduce tasks to use.

func (*Coordinator) Done ¶

func (c *Coordinator) Done() bool

main/mrcoordinator.go calls Done() periodically to find out if the entire job has finished.

func (*Coordinator) FinishTask ¶

func (c *Coordinator) FinishTask(args *CallArgs, reply *CallReply) error

func (*Coordinator) GetTask ¶

func (c *Coordinator) GetTask(args *CallArgs, reply *CallReply) error

type KeyValue ¶

type KeyValue struct {
	Key   string
	Value string
}

Map functions return a slice of KeyValue.

type Task ¶

type Task struct {
	// contains filtered or unexported fields
}

type TaskStatus ¶

type TaskStatus int

const (
	Idle       TaskStatus = 0
	InProgress TaskStatus = 1
	Completed  TaskStatus = 2
)

type TaskType ¶

type TaskType int

const (
	MapTask    TaskType = 0
	ReduceTask TaskType = 1
	Done       TaskType = 2
	Goose      TaskType = 3
)

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL