dedup

package

v0.0.0-...-68b92b3 Latest Latest Go to latest Published: Jul 29, 2020 License: MIT Imports: 9 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

View Source

const (
	SpatioTemporalKey byte = 0x01
)

This section is empty.

This section is empty.

type Event struct {
	Time time.Time `json:"time"`
	Lat  float64   `json:"lat"`
	Lng  float64   `json:"lng"`
}

Event is a demo event type.

type Filter interface {
	// Filter processes event and returns true, if it is unique.
	Filter(Event) (isUnique bool, err error)
}

Filter interface is implemented by event deduplication filters.

func NewSpatioTemporalFilter(db *badger.DB, distance float64, interval time.Duration) (Filter, error)

NewSpatioTemporalFilter creates and returns an instance of the deduplication Filter.

type SpatioTemporalFilter struct {
	// contains filtered or unexported fields
}

SpatioTemporalFilter implements spatio-temporal deduplication filter.

func (f *SpatioTemporalFilter) Cells(ll s2.LatLng) s2.CellUnion

Cells returns s2.CellUnion of cells to search for earlier indexed locations.

func (f *SpatioTemporalFilter) Distance() float64

Distance returns distance tolerance in meters.

func (f *SpatioTemporalFilter) Filter(ev Event) (isUnique bool, err error)

func (f *SpatioTemporalFilter) IndexedLocations(fn func(lat, lng float64) error) error

IndexedLocations iterates over indexed locations and calls fn with latitude and longitude.

func (f *SpatioTemporalFilter) Interval() time.Duration

Interval returns time tolerance.

func (f *SpatioTemporalFilter) Level() int

Level returns filter cell level.