Documentation ¶
Index ¶
- type Crawler
- func (c *Crawler) Close()
- func (c *Crawler) Detect() error
- func (c *Crawler) FromAuto() error
- func (c *Crawler) FromFile() error
- func (c *Crawler) FromHTTP() error
- func (c *Crawler) GetContentType() string
- func (c *Crawler) GetFeedLink() (string, string, error)
- func (c *Crawler) GetFeedLinkFromHTML() (string, string, error)
- func (c *Crawler) GetReadable() (ItemCrawled, error)
- func (c *Crawler) ParseFeed() (*gofeed.Feed, error)
- func (c *Crawler) Reset()
- func (c *Crawler) SetBasicAuth(username string, password string)
- func (c *Crawler) SetLocation(sourceLocation string) error
- type ItemCrawled
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Crawler ¶
type Crawler struct { UserAgent string // contains filtered or unexported fields }
func (*Crawler) GetContentType ¶
func (*Crawler) GetFeedLinkFromHTML ¶
func (*Crawler) GetReadable ¶
func (c *Crawler) GetReadable() (ItemCrawled, error)
func (*Crawler) SetBasicAuth ¶
func (*Crawler) SetLocation ¶
Click to show internal directories.
Click to hide internal directories.