Documentation ¶
Index ¶
- func Depth(n uint) spider.Pipe
- func DoNormalizeUrl(url, base string) (string, error)
- func Download(mapper func(string) string, perm os.FileMode) spider.Pipe
- func FollowLinks(s *spider.Spider, t *spider.Task)
- func IfUri(pattern string, ifPipe, elsePipe spider.Pipe) spider.Pipe
- func IfUriRegexp(regexpString string, ifPipe, elsePipe spider.Pipe) spider.Pipe
- func Ignore(s *spider.Spider, t *spider.Task)
- func Max(n uint64) spider.Pipe
- func NormalizeUrl(s *spider.Spider, t *spider.Task)
- func Print(s *spider.Spider, t *spider.Task)
- func Request(s *spider.Spider, t *spider.Task)
- func Unique() spider.Pipe
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func DoNormalizeUrl ¶
func FollowLinks ¶
func FollowLinks(s *spider.Spider, t *spider.Task)
func IfUriRegexp ¶
func IfUriRegexp(regexpString string, ifPipe, elsePipe spider.Pipe) spider.Pipe
func NormalizeUrl ¶
func NormalizeUrl(s *spider.Spider, t *spider.Task)
Types ¶
This section is empty.
Click to show internal directories.
Click to hide internal directories.