mr

package

v0.0.0-...-40d0814 Latest Latest Go to latest Published: Jul 25, 2020 License: MIT Imports: 14 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/rickard1117/kv-raft

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
func CallExample()
func FinishJob(job Job)
func Worker(mapf func(string, string) []KeyValue, reducef func(string, []string) string)
type ByKey
- func (a ByKey) Len() int
- func (a ByKey) Less(i, j int) bool
- func (a ByKey) Swap(i, j int)
type ExampleArgs
type ExampleReply
type FinishReply
type Job
- func TakeJob() Job
type JobDoneReply
type JobType
type KeyValue
type Master
- func MakeMaster(files []string, nReduce int) *Master
- func NewMaster(files []string, maxJobNum int, to int64, nreduce int) *Master
- func (m *Master) Done() bool
- func (m *Master) Example(args *ExampleArgs, reply *ExampleReply) error
- func (m *Master) Finish(job Job, reply *FinishReply) error
- func (m *Master) TakeJob(args *TakeJobArgs, job *Job) error
- func (m *Master) WaitAll()
type MasterPhase
type TakeJobArgs
type WorkerJob

Constants ¶

View Source

const (
	MapPhase = iota
	ReducePhase
)

Variables ¶

This section is empty.

Functions ¶

func CallExample ¶

func CallExample()

example function to show how to make an RPC call to the master.

the RPC argument and reply types are defined in rpc.go.

func FinishJob ¶

func FinishJob(job Job)

func Worker ¶

func Worker(mapf func(string, string) []KeyValue,
	reducef func(string, []string) string)

main/mrworker.go calls this function.

Types ¶

type ByKey ¶

type ByKey []KeyValue

for sorting by key.

func (ByKey) Len ¶

func (a ByKey) Len() int

for sorting by key.

func (ByKey) Less ¶

func (a ByKey) Less(i, j int) bool

func (ByKey) Swap ¶

func (a ByKey) Swap(i, j int)

type ExampleArgs ¶

type ExampleArgs struct {
	X int
}

type ExampleReply ¶

type ExampleReply struct {
	Y int
}

type FinishReply ¶

type FinishReply struct {
	Succeed bool
}

type Job ¶

type Job struct {
	Type        JobType
	MapFileName string
	// Result string
	Index   int
	NReduce int
	NMap    int
}

func TakeJob ¶

func TakeJob() Job

TakeJob takes a job from master, it could be map or reduce job.

type JobDoneReply ¶

type JobDoneReply struct {
}

type JobType ¶

type JobType int

const (
	ShutdownJob JobType = iota
	MapJob
	ReduceJob
)

type KeyValue ¶

type KeyValue struct {
	Key   string `json:"key"`
	Value string `json:"value"`
}

Map functions return a slice of KeyValue.

type Master ¶

type Master struct {
	// contains filtered or unexported fields
}

func MakeMaster ¶

func MakeMaster(files []string, nReduce int) *Master

create a Master. main/mrmaster.go calls this function. nReduce is the number of reduce tasks to use.

func NewMaster ¶

func NewMaster(files []string, maxJobNum int, to int64, nreduce int) *Master

func (*Master) Done ¶

func (m *Master) Done() bool

main/mrmaster.go calls Done() periodically to find out if the entire job has finished.

func (*Master) Example ¶

func (m *Master) Example(args *ExampleArgs, reply *ExampleReply) error

an example RPC handler.

the RPC argument and reply types are defined in rpc.go.

func (*Master) Finish ¶

func (m *Master) Finish(job Job, reply *FinishReply) error

func (*Master) TakeJob ¶

func (m *Master) TakeJob(args *TakeJobArgs, job *Job) error

func (*Master) WaitAll ¶

func (m *Master) WaitAll()

WaitAll only for testing

type MasterPhase ¶

type MasterPhase int

type TakeJobArgs ¶

type TakeJobArgs struct {
}

type WorkerJob ¶

type WorkerJob struct {
	Type JobType
	Name string
}

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL