Documentation
¶
Index ¶
- Constants
- func CamelToSnake(str string) string
- func CheckValidDCIDs(dcids []string) bool
- func EncodeProto(m proto.Message) (string, error)
- func GetContainedIn(typeRelationJSONFilePath string) (map[TypePair][]string, error)
- func GetMetadataHash(m *pb.StatMetadata) uint32
- func KeyToDcid(key string) (string, error)
- func KeysToSlice(m map[string]bool) []string
- func MergeDedupe(strLists ...[]string) []string
- func ParseBigtableGroup(s string) []string
- func PrintMemUsage()
- func RandomString() string
- func RemoveKeyPrefix(key string) (string, error)
- func Sample(m proto.Message, strategy *SamplingStrategy) proto.Message
- func SnakeToCamel(s string) string
- func StringContainedIn(target string, strs []string) bool
- func StringList(strs []string) string
- func TimeTrack(start time.Time, name string)
- func UnzipAndDecode(contents string) ([]byte, error)
- func ZipAndEncode(contents []byte) (string, error)
- type PlaceStatVar
- type SamplingStrategy
- type TypePair
Constants ¶
const ( // LimitFactor is the amount to multiply the limit by to make sure certain // triples are returned by the BQ query. LimitFactor = 1 // TextType represents text type. TextType = "Text" // String to represent in arc direction DirectionIn = "in" // String to represent out arc direction DirectionOut = "out" )
Variables ¶
This section is empty.
Functions ¶
func CamelToSnake ¶
CamelToSnake converts a camel case string to snake case string.
func CheckValidDCIDs ¶
CheckValidDCIDs checks if DCIDs are valid. More criteria will be added as being discovered.
func EncodeProto ¶ added in v1.35.1
EncodeProto encodes a protobuf message into a compressed string
func GetContainedIn ¶
GetContainedIn returns the contained in relation change given two types.
func GetMetadataHash ¶ added in v1.34.0
func GetMetadataHash(m *pb.StatMetadata) uint32
GetMetadataHash retrieves a hash string for a given protobuf message. Note this should be restrict to a request scope.
func KeysToSlice ¶ added in v1.32.0
KeysToSlice stores the keys of a map in a slice.
func MergeDedupe ¶ added in v1.14.0
MergeDedupe merges a list of string lists and remove duplicate elements.
func ParseBigtableGroup ¶ added in v1.33.1
ParseBigtableGroup retrieves Bigtable names for import group from newline separated list.
func PrintMemUsage ¶
func PrintMemUsage()
PrintMemUsage outputs the current, total and OS memory being used. As well as the number of garage collection cycles completed.
func RemoveKeyPrefix ¶
RemoveKeyPrefix removes the prefix of a big query key
func Sample ¶ added in v1.20.3
func Sample(m proto.Message, strategy *SamplingStrategy) proto.Message
Sample constructs a sampled protobuf message based on the sampling strategy. The output is deterministic given the same strategy.
func SnakeToCamel ¶
SnakeToCamel converts a snake case string to camel case string.
func StringContainedIn ¶
StringContainedIn returns true if TARGET is contained in STRS
func StringList ¶
StringList formats a list of strings into a comma-separated list with each surrounded with quotes.
func UnzipAndDecode ¶
UnzipAndDecode decompresses the given contents using gzip and decodes it from base64
func ZipAndEncode ¶
ZipAndEncode Compresses the given contents using gzip and encodes it in base64
Types ¶
type PlaceStatVar ¶ added in v1.30.0
PlaceStatVar holds a place and a stat var dcid.
type SamplingStrategy ¶ added in v1.20.3
type SamplingStrategy struct {
// Maximum number of samples.
//
// -1 means sample all the data. A positive integer indicates the maximum
// number of samples.
MaxSample int
// Sampling strategy for the child fields.
Children map[string]*SamplingStrategy
// Proto fields or map keys that are not sampled at all.
Exclude []string
}
SamplingStrategy represents the strategy to sample a JSON object.
Sampling is performed uniform acroos the items for list, or the keys for map.For example, when MaxSample=4, sampling of [1,2,3,4,5,6,7,8,9] would give [3,5,7,9]
Source Files