Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Page ¶
type Page struct {
// contains filtered or unexported fields
}
Page represents a webpage
type Site ¶
type Site struct {
// contains filtered or unexported fields
}
Site represents the site to be crawled. It uses a concurrent map so that downloading can be done in parallel and each go routine can safely check if a link had been already visited
Click to show internal directories.
Click to hide internal directories.