crawler

package
v0.0.0-...-5c77d7d Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 15, 2014 License: MIT Imports: 9 Imported by: 0

Documentation

Index

Constants

View Source
const (
	DEPTH = 3
)

Variables

This section is empty.

Functions

func Crawl

func Crawl(args map[string]interface{})

Types

type ExampleExtender

type ExampleExtender struct {
	gocrawl.DefaultExtender
	Id string
}

func (*ExampleExtender) Filter

func (this *ExampleExtender) Filter(ctx *gocrawl.URLContext, isVisited bool) bool

func (*ExampleExtender) Visit

func (this *ExampleExtender) Visit(ctx *gocrawl.URLContext, res *http.Response, doc *goquery.Document) (interface{}, bool)

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL