gluetables

package
v1.16.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 10, 2021 License: AGPL-3.0 Imports: 8 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func DeployedLogTypes added in v1.11.0

func DeployedLogTypes(ctx context.Context, glueClient glueiface.GlueAPI, logTypes []string) ([]string, error)

DeployedLogTypes scans glue API to filter log types with deployed tables

func LogTypeTableMeta added in v1.14.0

func LogTypeTableMeta(entry logtypes.Entry) *awsglue.GlueTableMetadata

func ResolveTables added in v1.14.0

func ResolveTables(ctx context.Context, resolver logtypes.Resolver, logTypes ...string) ([]*awsglue.GlueTableMetadata, error)

ResolveTables is a helper to resolve all glue table metadata for all log types

Types

type TablesForLogType added in v1.10.0

type TablesForLogType struct {
	LogTable       *awsglue.GlueTableMetadata
	RuleTable      *awsglue.GlueTableMetadata
	RuleErrorTable *awsglue.GlueTableMetadata
}

func CreateOrUpdateGlueTables

func CreateOrUpdateGlueTables(glueClient glueiface.GlueAPI, bucket string,
	logTable *awsglue.GlueTableMetadata) (*TablesForLogType, error)

CreateOrUpdateGlueTables, given a log meta data table, creates all tables related to this log table in the glue catalog.

func CreateTablesIfNotExist added in v1.15.0

func CreateTablesIfNotExist(ctx context.Context, glueClient glueiface.GlueAPI, bucket string,
	logTable *awsglue.GlueTableMetadata) (*TablesForLogType, error)

CreateTablesIfNotExist creates all tables related to a log table in the glue catalog if they don't already exist.

func UpdateTablesIfExist added in v1.15.0

func UpdateTablesIfExist(ctx context.Context, glueAPI glueiface.GlueAPI, bucket string,
	logTable *awsglue.GlueTableMetadata) (*TablesForLogType, error)

UpdateTablesIfExist updates all tables related to this log table in the glue catalog if they already exist.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL