s3rm
Delete tons of s3 objects efficiently.
This utility makes use of the Multi-Object Delete
S3 endpoint and the concurrency primitives of go
to quickly and efficiently delete large numbers of objects. Object lists
can be specified in a file or fetched recursively based on a bucket prefix.
Installation
go get github.com/fullscreen/s3rm
Usage
$ s3rm -h
Usage: s3rm [options]
Options:
-bucket The target S3 bucket name
-dryrun Run through object list without actually deleting anything
-file A file containing the object keys to be deleted
-help Print this message and exit
-output A file to write deleted object keys to
-pool Max worker pool size (default: 10)
-prefix List and delete all objects with this prefix
-region The AWS region of the target bucket
Output statistics update in real-time
$ s3rm -bucket mybucket -file objects_to_delete.txt -pool 30
delete: 43000 of 202000 objects (30 workers, 6142 obj/s)
Planned Features
- AWS credentials profile support