Documentation ¶
Index ¶
Constants ¶
View Source
const ( MAX_DOWNLOADS = 30000 MAX_WORKERS = 30000 WORKER_TIMEOUT_SECONDS = 5 )
Variables ¶
View Source
var InvalidArgs error = errors.New("numWorkers/numDownloads too high")
///////////////////////////// / Public API /////////////////////////////
Functions ¶
This section is empty.
Types ¶
type CrawlPolicy ¶
Click to show internal directories.
Click to hide internal directories.