The highest tagged major version is
Documentation
¶
Index ¶
- Constants
- func CheckEndpoint(endpoint string) bool
- func IsExist(name string) (bool, error)
- type Dir
- type Downloader
- type ExternalStorage
- type Local
- func (l *Local) Download(ctx context.Context, localPath, externalUri string, recursively bool) error
- func (l *Local) EnsureDir(ctx context.Context, uri string, recursively bool) error
- func (l *Local) ExistDir(ctx context.Context, uri string) bool
- func (l *Local) GetDir(ctx context.Context, uri string) (*pb.Backend, error)
- func (l *Local) IncrUpload(ctx context.Context, externalUri, localPath string, ...) error
- func (l *Local) ListDir(ctx context.Context, uri string) ([]string, error)
- func (l *Local) RemoveDir(ctx context.Context, uri string) error
- func (l *Local) Upload(ctx context.Context, externalUri, localPath string, recursively bool) error
- type S3
- func (s *S3) Download(ctx context.Context, localPath, externalUri string, recursively bool) error
- func (s *S3) EnsureDir(ctx context.Context, uri string, recursively bool) error
- func (s *S3) ExistDir(ctx context.Context, uri string) bool
- func (s *S3) GetDir(ctx context.Context, uri string) (*pb.Backend, error)
- func (s *S3) GetObjectSize(bucket, key string) (int64, error)
- func (s *S3) IncrUpload(ctx context.Context, externalUri, localPath string, ...) error
- func (s *S3) ListDir(ctx context.Context, uri string) ([]string, error)
- func (s *S3) RemoveDir(ctx context.Context, uri string) error
- func (s *S3) Upload(ctx context.Context, externalUri, localPath string, recursively bool) error
- type Uploader
Constants ¶
const (
SessionKey = "storage-session-id"
)
Variables ¶
This section is empty.
Functions ¶
func CheckEndpoint ¶ added in v0.2.0
CheckEndpoint check whether endpoint is combine with ip:port example: http://127.0.0.1:9999/xxx
Types ¶
type Dir ¶
type Dir interface {
ExistDir(ctx context.Context, uri string) bool
EnsureDir(ctx context.Context, uri string, recursively bool) error
// GetDir return Backend with specified uri and authentication information stored in storage
GetDir(ctx context.Context, uri string) (*pb.Backend, error)
// ListDir only list get dir names in given dir, not recursively
ListDir(ctx context.Context, uri string) ([]string, error)
// RemoveDir remove all files recursively
RemoveDir(ctx context.Context, uri string) error
}
Dir means we treat the storage organized as tree hierarchy
type Downloader ¶
type Downloader interface {
Download(ctx context.Context, localPath, externalUri string, recursively bool) error
}
Downloader download data from externalUri in ExternalStorage to the localPath If localPath not exist, create it; If it exist, overwrite it when it is file, copy to it when it is folder
type ExternalStorage ¶
type ExternalStorage interface {
Downloader
Uploader
Dir
}
ExternalStorage will keep the authentication information and other configuration for the storage Then the functions only need uri as the parameter
type Local ¶
type Local struct {
}
func (*Local) IncrUpload ¶ added in v0.2.0
type S3 ¶
type S3 struct {
// contains filtered or unexported fields
}
func (*S3) GetObjectSize ¶ added in v0.2.0
GetObjectSize get s3 object size for rate-limit
func (*S3) IncrUpload ¶ added in v0.2.0
type Uploader ¶
type Uploader interface {
Upload(ctx context.Context, externalUri, localPath string, recursively bool) error
IncrUpload(ctx context.Context, externalUri, localPath string, commitLogId, lastLogId int64) error
}
Uploader upload data from localPath to the externalUri in ExternalStorage When recursively is false, upload file from localPath to externalUri Else upload files in localPath folder to externalUri folder
Source Files