crawl

package

v0.0.0-...-703572f Latest Latest Go to latest Published: Aug 24, 2018 License: MIT Imports: 2 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/tarent/techtalk-reactive-programming-in-go

Links

Open Source Insights

Documentation ¶

Index ¶

func StartCrawlWorker(numWorkers int) (chan CrawlerAction, chan CrawlerResult)
type CrawlerAction
type CrawlerResult

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func StartCrawlWorker ¶

func StartCrawlWorker(numWorkers int) (chan CrawlerAction, chan CrawlerResult)

StartRequestWorker starts a goroutine listening on its input channel, gets resources from the given url then passes the response bodies or errors via its output channel

Types ¶

type CrawlerAction ¶

type CrawlerAction struct {
	Url string
}

type CrawlerResult ¶

type CrawlerResult struct {
	Url   string
	Data  []string
	Error error
}

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL