chunker

package

v1.0.2 Latest Latest Go to latest Published: Feb 22, 2023 License: Apache-2.0 Imports: 4 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

View Source

const (
	MIN_CHUNK = 256 << 10
	MAX_CHUNK = 4 << 20
	POL       = restic.Pol(0x39fc525c05db35)
)

View Source

const (
	AVG_CHUNK = 256 << 10
)

View Source

var ErrInvalidChunker = fmt.Errorf("Invalid chunker string")

Invalid chunker string error

This section is empty.

type Chunk struct {
	Data        []byte
	Size        int64
	Offset      int64
	Fingerprint uint64
}

Defines a chunk of data

type Chunker interface {
	Name() string
	Next() (*Chunk, error)
}

Chunker interface wraps the Next() method Next() gives the next chunk

func GetChunker(cStr string, reader io.Reader) (Chunker, error)

Returns the appropriate chunker implementation based on the input string

func NewFastCDCChunker(r io.Reader) (Chunker, error)

func NewRabinFPChunker(r io.Reader) (Chunker, error)

type FastCDCChunker struct {
	*fastcdc.Chunker
}

Implements the FastCDC algorithm

func (fc *FastCDCChunker) Name() string

func (fc *FastCDCChunker) Next() (*Chunk, error)

type RabinFPChunker struct {
	*restic.Chunker
}

Implements the Rabin-fingerprint based CDC algorithm

func (rc *RabinFPChunker) Name() string

func (rc *RabinFPChunker) Next() (*Chunk, error)