mr

package

v0.0.0-...-496dcb2 Latest Latest Go to latest Published: Apr 30, 2023 License: MIT Imports: 13 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/jerry-gk/mit-6.824

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
func CallExample()
func DPrintf(format string, v ...interface{})
func Worker(mapf func(string, string) []KeyValue, reducef func(string, []string) string)
type ByKey
- func (a ByKey) Len() int
- func (a ByKey) Less(i, j int) bool
- func (a ByKey) Swap(i, j int)
type ExampleArgs
type ExampleReply
type KeyValue
type Master
- func MakeMaster(files []string, nReduce int) *Master
- func (m *Master) Done() bool
- func (m *Master) Example(args *ExampleArgs, reply *ExampleReply) error
- func (m *Master) GenerateOneTask(taskSeq int) Task
- func (m *Master) GetOneTask(args *TaskArgs, reply *TaskReply) error
- func (m *Master) InitMapTasks()
- func (m *Master) InitReduceTasks()
- func (m *Master) RegOneTask(args *TaskArgs, task *Task)
- func (m *Master) RegWorker(args *RegisterArgs, reply *RegisterReply) error
- func (m *Master) ReportTask(args *ReportTaskArgs, reply *ReportTaskReply) error
- func (m *Master) Schedule()
- func (m *Master) TickSchedule()
type RegisterArgs
type RegisterReply
type ReportTaskArgs
type ReportTaskReply
type Task
type TaskArgs
type TaskPhase
type TaskReply
type TaskStatus

Constants ¶

View Source

const (
	TaskStatusReady   = 0 //just created, waited to be put into tack Channel of the master
	TaskStatusQueue   = 1 //waiting for an idle worker's request to execute it
	TaskStatusRunning = 2 //running in some worker
	TaskStatusDone    = 3 //done by the worker
	TaskStatusErr     = 4 //err in the worker
)

View Source

const (
	MaxTaskRunTime   = time.Second * 10
	ScheduleInterval = time.Millisecond * 500
)

View Source

const Debug = false

common

Variables ¶

This section is empty.

Functions ¶

func CallExample ¶

func CallExample()

example function to show how to make an RPC call to the master.

the RPC argument and reply types are defined in rpc.go.

func DPrintf ¶

func DPrintf(format string, v ...interface{})

func Worker ¶

func Worker(mapf func(string, string) []KeyValue,
	reducef func(string, []string) string)

main/mrworker.go calls this function.

Types ¶

type ByKey ¶

type ByKey []KeyValue

for sorting by key.

func (ByKey) Len ¶

func (a ByKey) Len() int

for sorting by key.

func (ByKey) Less ¶

func (a ByKey) Less(i, j int) bool

func (ByKey) Swap ¶

func (a ByKey) Swap(i, j int)

type ExampleArgs ¶

type ExampleArgs struct {
	X int
}

type ExampleReply ¶

type ExampleReply struct {
	Y int
}

type KeyValue ¶

type KeyValue struct {
	Key   string
	Value string
}

Map functions return a slice of KeyValue.

type Master ¶

type Master struct {
	TotalNumReduce int
	// contains filtered or unexported fields
}

func MakeMaster ¶

func MakeMaster(files []string, nReduce int) *Master

create a Master. main/mrmaster.go calls this function. nReduce is the number of reduce tasks to use.

func (*Master) Done ¶

func (m *Master) Done() bool

main/mrmaster.go calls Done() periodically to find out if the entire job has finished.

func (*Master) Example ¶

func (m *Master) Example(args *ExampleArgs, reply *ExampleReply) error

an example RPC handler.

the RPC argument and reply types are defined in rpc.go.

func (*Master) GenerateOneTask ¶

func (m *Master) GenerateOneTask(taskSeq int) Task

func (*Master) GetOneTask ¶

func (m *Master) GetOneTask(args *TaskArgs, reply *TaskReply) error

func (*Master) InitMapTasks ¶

func (m *Master) InitMapTasks()

func (*Master) InitReduceTasks ¶

func (m *Master) InitReduceTasks()

func (*Master) RegOneTask ¶

func (m *Master) RegOneTask(args *TaskArgs, task *Task)

func (*Master) RegWorker ¶

func (m *Master) RegWorker(args *RegisterArgs, reply *RegisterReply) error

func (*Master) ReportTask ¶

func (m *Master) ReportTask(args *ReportTaskArgs, reply *ReportTaskReply) error

func (*Master) Schedule ¶

func (m *Master) Schedule()

maintain taskArray, assign tasks to workers called at regular time, called when a worker sends a report

func (*Master) TickSchedule ¶

func (m *Master) TickSchedule()

type RegisterArgs ¶

type RegisterArgs struct {
}

type RegisterReply ¶

type RegisterReply struct {
	WorkerId int
}

type ReportTaskArgs ¶

type ReportTaskArgs struct {
	Status   TaskStatus
	Seq      int
	Phase    TaskPhase
	WorkerId int
}

type ReportTaskReply ¶

type ReportTaskReply struct {
}

type Task ¶

type Task struct {
	FileName  string //empty for reduce tasks
	NumMap    int
	NumReduce int
	Seq       int
	Phase     TaskPhase
	Active    bool

	Status    TaskStatus
	WorkerId  int //-1 if not assigned yet
	StartTime time.Time
}

type TaskArgs ¶

type TaskArgs struct {
	WorkerId int
}

Add your RPC definitions here.

type TaskPhase ¶

type TaskPhase int

const (
	MapPhase    TaskPhase = 0
	ReducePhase TaskPhase = 1
)

type TaskReply ¶

type TaskReply struct {
	TaskRep *Task
}

type TaskStatus ¶

type TaskStatus int

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL