utils

package
v0.0.0-...-b1321d0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 25, 2018 License: MIT Imports: 12 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func DownloadURLs 

func DownloadURLs(urls []url.URL, concurrencyLevel int, outputDirectory string) error

DownloadURLs downloads all provided URLs concurrently. It limits the number of concurrent downloads to the provided concurrencyLevel.

func ReadLines 

func ReadLines(filename string) ([]string, error)

ReadLines attempts to open the file indicated by filename and read it. It returns a slice containing all lines in the file and any error encountered.

func StringToURL 

func StringToURL(rawurls []string) ([]url.URL, error)

StringToURL accepts a slice of raw URL strings and attempts to convert them to URL structures. It returns an error if the URL scheme is not supported. It returns a slice of URL structures and any error encountered.

Types

type ProgressPrinter 

type ProgressPrinter struct {
	// contains filtered or unexported fields
}

func NewProgressPrinter 

func NewProgressPrinter(numWriters int) ProgressPrinter

func (*ProgressPrinter) PrintProgress 

func (pp *ProgressPrinter) PrintProgress()

type ProgressWriter 

type ProgressWriter struct {
	// contains filtered or unexported fields
}

func (*ProgressWriter) Write 

func (pw *ProgressWriter) Write(p []byte) (int, error)

type Semaphore 

type Semaphore interface {
	Down()
	Up()
}

func NewSemaphore 

func NewSemaphore(capacity int) Semaphore

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.