Documentation
¶
Overview ¶
Package s3loader wraps up aws sdk s3manager functionality
Index ¶
Constants ¶
This section is empty.
Variables ¶
View Source
var (
ErrInvalidArgs = errors.New("invalid arguments")
)
Functions ¶
func NewS3DownloadManager ¶
func NewS3DownloadManager(c client.ConfigProvider) *s3manager.Downloader
NewS3DownloadManager inits with defaults and returns a *s3manager.Downloader
Types ¶
type DownloadManager ¶
type DownloadManager interface {
Download(io.WriterAt, *s3.GetObjectInput, ...func(*s3manager.Downloader)) (int64, error)
}
DownloadManager describes logic for saving an s3 item to disc
type Downloader ¶
type Downloader struct {
// contains filtered or unexported fields
}
Downloader is a wrapper for DownloadManager Downloader handles additional input parameter and concurrency logic
func NewDownloader ¶
NewDownloader inits and returns a Downloader pointer
func (*Downloader) Run ¶
func (d *Downloader) Run() error
Run starts a downloader - s3 file download or search
type PageIterator ¶
type PageIterator interface {
Iterate(*s3.ListObjectsOutput, bool) bool
}
PageIterator describes logic for every s3 item
type PageIteratorFunc ¶
type PageIteratorFunc func(*s3.ListObjectsOutput, bool) bool
PageIteratorFunc is a PageIterator wrapper
func (PageIteratorFunc) Iterate ¶
func (f PageIteratorFunc) Iterate(page *s3.ListObjectsOutput, more bool) bool
Iterate calls f(page, more)
type PageLister ¶
type PageLister interface {
ListObjectsPages(params *s3.ListObjectsInput, pageIterator func(*s3.ListObjectsOutput, bool) bool) error
}
PageLister describes logic for handling s3 page items
Source Files
Click to show internal directories.
Click to hide internal directories.