spider

package
v0.0.0-...-3dac89b Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 24, 2017 License: Apache-2.0 Imports: 5 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

View Source
var Links = "github.com/crackcomm/crawl-links/spider.Links"

Links - Gather links from page.

Functions

This section is empty.

Types

type Result

type Result struct {
	// Results - List of resulted links.
	Results []string `json:"results,omitempty"`
	// Source - URL of the source.
	Source string `json:"source,omitempty"`
}

Result - Links crawl result.

type Spider

type Spider struct {
	crawl.Crawler
	Output func(*Result) error
}

Spider - Links spider.

func (spider *Spider) Links(ctx context.Context, resp *crawl.Response) (err error)

Links - Crawls Links.

func (*Spider) Register

func (spider *Spider) Register()

Register - Registers spider.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL