Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type HopProcessor ¶ added in v0.3.0
type HopProcessor struct {
// contains filtered or unexported fields
}
Processor maintains state for reprocessing annotation archives.
func NewHopProcessor ¶ added in v0.3.0
func NewHopProcessor(client *storage.Client, outBucket string, rv4, rv6, asnames *url.URL) *HopProcessor
NewHopProcessor creates a new annotation processor.
func (*HopProcessor) File ¶ added in v0.3.0
File processes the given file header and file contents. File returns the new file content or process.ErrCorrupt.
func (*HopProcessor) Finish ¶ added in v0.3.0
Finish completes processing of the given output archive by uploading to GCS to an alternate bucket and object name.
type Processor ¶
type Processor struct {
// contains filtered or unexported fields
}
Processor maintains state for reprocessing annotation archives.
func NewProcessor ¶
NewProcessor creates a new annotation processor.
func (*Processor) File ¶
File processes the given file header and file contents. File returns the new file content or process.ErrCorrupt.
func (*Processor) Finish ¶
Finish completes processing of the given output archive by uploading to GCS to an alternate bucket and object name.
type Renamer ¶
type Renamer struct {
// contains filtered or unexported fields
}
Renamer manages GCS operations to rename objects from one datatype to a new datatype.
func NewRenamer ¶
func NewRenamer(client *storage.Client, bucket, experiment, fromDatatype, newDatatype string) *Renamer
NewRenamer creates a new Renamer. Objects are listed from bucket and written to bucket.
type Result ¶
type Result struct {
// ArchiveURL is the GCS URL of the archive that contains Files.
ArchiveURL string
// Files is an array of tuples for annotation Filename and client DstIP addresses.
Files []struct {
DstIP string
Filename string
}
}
Result is a structure to read BigQuery result rows.
Source Files