utils

package

v0.0.36 Latest Latest Go to latest Published: Apr 30, 2024 License: Apache-2.0 Imports: 13 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/sei-protocol/sei-db

Links

Open Source Insights

Documentation ¶

Index ¶

Constants
func CalculatePercentile(latencies []time.Duration, percentile float64) time.Duration
func CreateFile(outputDir string, fileName string) (*os.File, error)
func ListAllFiles(dir string) ([]string, error)
func OpenDB(dir string) (dbm.DB, error)
func PickRandomKVFile(inputKVDir string, processedFiles *sync.Map) string
func RandomShuffle(kvPairs []KeyValuePair)
func ReadTree(db dbm.DB, version int, prefix []byte) (*iavl.MutableTree, error)
func WriteTreeDataToFile(tree *iavl.MutableTree, filenamePattern string, chunkSize int)
type KeyValuePair
- func LoadAndShuffleKV(inputDir string) ([]KeyValuePair, error)
- func ReadKVEntriesFromFile(filename string) ([]KeyValuePair, error)

Constants ¶

View Source

const (
	DefaultCacheSize int = 10000
)

Variables ¶

This section is empty.

Functions ¶

func CalculatePercentile ¶

func CalculatePercentile(latencies []time.Duration, percentile float64) time.Duration

NOTE: Assumes latencies is sorted CalculatePercentile calculates latencies percentile

func CreateFile ¶

func CreateFile(outputDir string, fileName string) (*os.File, error)

func ListAllFiles ¶

func ListAllFiles(dir string) ([]string, error)

func PickRandomKVFile ¶

func PickRandomKVFile(inputKVDir string, processedFiles *sync.Map) string

Picks random file from input kv dir and updates processedFiles Map with it

func ReadTree ¶

func ReadTree(db dbm.DB, version int, prefix []byte) (*iavl.MutableTree, error)

ReadTree loads an iavl tree from the directory If version is 0, load latest, otherwise, load named version The prefix represents which iavl tree you want to read. The iaviwer will always set a prefix.

func WriteTreeDataToFile ¶

func WriteTreeDataToFile(tree *iavl.MutableTree, filenamePattern string, chunkSize int)

Writes raw key / values from a tree to a file Writes a chunkSize number of keys/values to separate files per module

Types ¶

type KeyValuePair ¶

type KeyValuePair struct {
	Key   []byte `json:"key"`
	Value []byte `json:"value"`
}

func LoadAndShuffleKV ¶

func LoadAndShuffleKV(inputDir string) ([]KeyValuePair, error)

func ReadKVEntriesFromFile ¶

func ReadKVEntriesFromFile(filename string) ([]KeyValuePair, error)

Reads raw keys / values from a file

Source Files ¶

View all Source files

utils.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL