downloaders

package
v0.0.0-...-4cfa141 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 28, 2018 License: Apache-2.0 Imports: 14 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func FTPDownload

func FTPDownload(logger *logging.Logger, config types.SystemConfig, dbInstance db.Storage, jobID string) error

FTPDownload downloads the file from FTP. Job Source should be in format: ftp://login:password@host/path

func HTTPDownload

func HTTPDownload(logger *logging.Logger, config types.SystemConfig, dbInstance db.Storage, jobID string) error

HTTPDownload function downloads sources using http protocol.

func S3Download

func S3Download(logger *logging.Logger, config types.SystemConfig, dbInstance db.Storage, jobID string) error

S3Download downloads the file from S3 bucket. Job Source should be in format: http://AWSKEY:AWSSECRET@BUCKET.s3.amazonaws.com/OBJECT

Types

type DownloadFunc

type DownloadFunc func(logger *logging.Logger, config types.SystemConfig, dbInstance db.Storage, jobID string) error

DownloadFunc is a function type for the multiple possible ways to download the source file

func GetDownloadFunc

func GetDownloadFunc(jobSource string) DownloadFunc

GetDownloadFunc returns the download function based on the job source.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL