Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type ConfluentSource ¶
ConfluentSource implements pdk.Source using Kafka and the Confluent schema registry.
func NewConfluentSource ¶
func NewConfluentSource() *ConfluentSource
NewConfluentSource returns a new ConfluentSource.
func (*ConfluentSource) Record ¶
func (s *ConfluentSource) Record() (interface{}, error)
Record returns the next value from kafka.
type Main ¶
type Main struct { Hosts []string `help:"Comma separated list of Kafka hosts and ports"` Topics []string `help:"Comma separated list of Kafka topics"` Group string `help:"Kafka group"` RegistryURL string `help:"URL of the confluent schema registry. Pass an empty string to use JSON instead of Avro."` Framer pdk.DashField PilosaHosts []string `help:"Comma separated list of Pilosa hosts and ports."` Index string `help:"Pilosa index."` BatchSize uint `help:"Batch size for Pilosa imports (latency/throughput tradeoff)."` SubjectPath []string `help:"Comma separated path to value in each record that should be mapped to column ID. Blank gets a sequential ID"` Proxy string `help:"Bind to this address to proxy and translate requests to Pilosa"` AllowedFields []string `help:"If any are passed, only frame names in this comma separated list will be indexed."` MaxRecords int `help:"Maximum number of records to ingest from kafka before stopping."` // contains filtered or unexported fields }
Main holds the options for running Pilosa ingestion from Kafka.
type Schema ¶
type Schema struct { Schema string `json:"schema"` // The actual AVRO schema Subject string `json:"subject"` // Subject where the schema is registered for Version int `json:"version"` // Version within this subject ID int `json:"id"` // Registry's unique id }
The Schema type is an object produced by the schema registry.
Click to show internal directories.
Click to hide internal directories.