etl

package
v0.0.0-...-59ff9c4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 24, 2022 License: MIT Imports: 5 Imported by: 0

Documentation

Index

Constants

View Source
const MAX_DEPTH = 3

MAX_DEPTH is 3 to reduce total comments searched

Variables

This section is empty.

Functions

func RunEtl

func RunEtl(input *EtlInputs) error

Types

type AwsEtlConfig

type AwsEtlConfig struct {
	Config aws.Config
}

type DatabaseEtlConfig

type DatabaseEtlConfig struct {
	Connection *db.Connection
}

type EtlInputs

type EtlInputs struct {
	RunId          int
	RedditConfig   RedditEtlConfig
	AwsConfig      AwsEtlConfig
	DatabaseConfig DatabaseEtlConfig
}

type RedditEtlConfig

type RedditEtlConfig struct {
	Subreddit string
	Client    *reddit.Client
	Limit     int
}

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL