s3downloader

command module
v0.0.0-...-9e76345 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jan 5, 2016 License: MIT Imports: 3 Imported by: 0

README

S3downloader

Build Status GoDoc

Download data from s3 to a local dir

Install

go get -t -u github.com/motain/s3downloader

Usage

  • Enter your s3 credentials in config file

cp config.json.dist config.json

  • For available options run s3downloader -h
Example 1
// download all data from s3://mybucket - data will be stored in downloads-s3 dir next to binary  
s3downloader -bucket=mybucket

// list s3://mybucket contents  
s3downloader -bucket=mybucket -dry-run
Example 2
// download all files from s3://mybucket/docs/backup to /localdir  
s3downloader -bucket=mybucket -prefix=docs/backup -dir=/localdir

// download all files from s3://mybucket/docs/backup to /localdir, prepend filenames with lastmodified timestamp (for repeated filename)  
s3downloader -bucket=mybucket -prefix=docs/backup -dir=/localdir -p
Example 3
// download only files with "txt" extention from s3://mybucket  
s3downloader -bucket=mybucket -regexp=^*\\.txt$

License

See the LICENSE file for license rights and limitations (MIT).

Documentation

Overview

s3downloader cmd is an aws go sdk wrapper which utilizes go concurrency patterns for efficient and fast AWS s3 data search and download

Directories

Path Synopsis
Package cfg handles s3downloader app config load logic
Package cfg handles s3downloader app config load logic
Package s3loader wraps up aws sdk s3manager functionality
Package s3loader wraps up aws sdk s3manager functionality

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL