athena_s3

package module

v0.0.0-...-a759b4d Latest Latest Go to latest Published: Aug 30, 2017 License: GPL-3.0 Imports: 9 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Use Amazon AWS SDK to upload data to S3 bucket and query by Athena

go get -u github.com/aws/aws-sdk-go

This section is empty.

This section is empty.

This section is empty.

type Athena struct {
	C *athena.Athena
}

func NewAthenaClient(k string, sk string, r string) (*Athena, error)

Create New Athena Client with accessKey , secretAccessKey, region info

func (a *Athena) ProcessResultRows(queryExecutionId *string, fn ProcessRow) error

func (a *Athena) SubmitAthenaQuery(db *string, query *string, o *string) (*string, error)

Submit Query Request db: target db to query query: standard sql o : output location. s3 output path

func (a *Athena) WaitForQueryToComplete(queryExecutionId *string) error

Wait for an Athena query to complete, fail or is canceled. If a query fails or is canceled, then Error Query finish will return nil

type ProcessRow func(page *athena.GetQueryResultsOutput, lastPage bool) bool

Define function for executing data

type S3 struct {
	C *s3.S3
}

func NewS3(k string, sk string, r string) (*S3, error)

Create New S3 Client with accessKey , secretAccessKey, region info

func (c *S3) Upload(srcPath string, bucket string, desPath string) error

Upload file from local to s3 Local file path: srcPath S3 bucket : bucket S3 destination path: desPath

Path	Synopsis
example