pget

package module

v0.0.0-...-06cd7a9 Latest Latest Go to latest Published: Dec 23, 2023 License: BSD-3-Clause Imports: 21 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/yuzhichang/pget

Links

Open Source Insights

README ¶

pget

Parallel, continuable HTTP/HTTPS download tool, inspired by lftp's "pget -c -n" and "mget -n".

Usage:

$ pget -h
Parallel, continuable HTTP/HTTPS download tool, inspired by lftp's "pget -c -n" and "mget -n".
Requires the website support the "Range" header(https://www.rfc-editor.org/rfc/rfc7233#section-3.1).
Homepage: https://github.com/yuzhichang/pget

pget [-d] [-n maxconn] [-O <base>] <file_urls> [checksum_files]
file_urls       comma-separated http or https urls
checksum_files  comma-separated checksum files name, empty one means the checksum is encoded as url segment, or not provided
  -O string
        base directory where files should be placed, default is current directory (default ".")
  -d    Set log level to DEBUG.
  -n int
        max connections (default 5)

Example:

$ pget https://mirrors.aliyun.com/alpine/v3.8/releases/x86_64/alpine-minirootfs-3.8.0-x86_64.tar.gz alpine-minirootfs-3.8.0-x86_64.tar.gz.sha512
$ pget http://mirrors.ustc.edu.cn/debian-cd/current/amd64/iso-cd/debian-9.5.0-amd64-netinst.iso SHA256SUMS
$ pget https://pypi.tuna.tsinghua.edu.cn/packages/58/0a/2ba9c2ae852f2b03b3fba0c8815158809d0f8b4b699d212f85cb065efc96/grpcio-1.51.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=3709048fe0aa23dda09b3e69849a12055790171dab9e399a72ea8f9dfbf9ac80,https://pypi.tuna.tsinghua.edu.cn/packages/8b/ba/a0994523e2dd3d6747ef1dc9458aba8c907953bed062f809fcbdd5f32020/grpcio-1.51.3-cp310-cp310-manylinux_2_17_aarch64.whl#sha256=82b0ad8ac825d4bb31bff9f638557c045f4a6d824d84b21e893968286f88246b

Installation

Please use the following steps to build and install pget on Linux.

$ go install github.com/yuzhichang/pget/cmd/pget@latest

Build from source

Checkout code, run following to build.

$ go build -o . ./...

Documentation ¶

Index ¶

Constants
func FileMmap(f *os.File) (data []byte, err error)
func FileMunmap(data []byte) (err error)
type MGet
- func NewMGet(fileURLs, ckmFileNames []string, outDir string, maxconn int) (mg *MGet)
- func (mg *MGet) DoParallel(ctx context.Context, cont bool) (filePaths []string, err error)
- func (mg *MGet) WithLogger(l *zap.Logger) *MGet
type PGet
- func NewPGet(fileURL, ckmFileName, outDir string, maxconn int) (pg *PGet)

Constants ¶

View Source

const (
	BufSize   = 1 * 1024 * 1024
	MaxCntErr = 10
)

Variables ¶

This section is empty.

Functions ¶

func FileMmap ¶

func FileMmap(f *os.File) (data []byte, err error)

FileMmap mmaps the given file. https://medium.com/@arpith/adventures-with-mmap-463b33405223

func FileMunmap ¶

func FileMunmap(data []byte) (err error)

FileMunmap unmaps the given file.

Types ¶

type MGet ¶

type MGet struct {
	// contains filtered or unexported fields
}

func NewMGet ¶

func NewMGet(fileURLs, ckmFileNames []string, outDir string, maxconn int) (mg *MGet)

func (*MGet) DoParallel ¶

func (mg *MGet) DoParallel(ctx context.Context, cont bool) (filePaths []string, err error)

func (*MGet) WithLogger ¶

func (mg *MGet) WithLogger(l *zap.Logger) *MGet

type PGet ¶

type PGet struct {
	// contains filtered or unexported fields
}

func NewPGet ¶

func NewPGet(fileURL, ckmFileName, outDir string, maxconn int) (pg *PGet)

func (*PGet) DoParallel ¶

func (pg *PGet) DoParallel(ctx context.Context, cont bool) (filePath string, err error)

func (*PGet) WithLogger ¶

func (pg *PGet) WithLogger(l *zap.Logger) *PGet

func (*PGet) WithSemaphore ¶

func (pg *PGet) WithSemaphore(sem *semaphore.Weighted) *PGet

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
cmd
pget

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL