Documentation
¶
Index ¶
- Constants
- type Storage
- func (s *Storage) Close() error
- func (s *Storage) CompileFilters(txn *badger.Txn, scan *v1.Scan, r *bitmaps.Bitmap, o *visit.All)
- func (s *Storage) MaxTs() uint64
- func (s *Storage) MinTs() uint64
- func (s *Storage) Save(data *v1.Data) error
- func (s *Storage) Scan(scan *v1.Scan) (result *v1.Data, err error)
- func (s *Storage) Start(ctx context.Context)
Constants ¶
View Source
const ( DataCacheSize = 256 << 20 BitmapCacheSize = DataCacheSize * 2 )
View Source
const (
DefaultTimeRange = 15 * time.Minute
)
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Storage ¶
type Storage struct {
// contains filtered or unexported fields
}
func (*Storage) CompileFilters ¶
func (*Storage) Save ¶
Save indexes and saves compressed data into badger key/value store. See transform package on which metadata is extracted from data for indexing.
data is assigned a SampleID and two indexes are built for this SampleID lookup.
Metadata Index ¶
This tracks minTs,maxTs observed in data. For efficiency we use LSM tree containing arrow.Record of *v1.Meta. This index is kept in memory and persisted for durability but all computation are done in memory using arrow compute package.
Roaring Bitmap Index ¶
A label to bitmap of samples mapping. This is kept in bitmap cache and persisted on tha key value store upon eviction.
Source Files
Click to show internal directories.
Click to hide internal directories.