Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Job ¶
type Scraper ¶
type Scraper struct {
// contains filtered or unexported fields
}
TODO: Add flags to pull in db creds, worker count,
func NewScraper ¶
func NewScraper(proxyClient *proxies.ProxyClient, uac *useragents.UserAgentClient, db *sql.DB, httpClient *http.Client) *Scraper
func (*Scraper) AddPropertyRecordToDB ¶
Click to show internal directories.
Click to hide internal directories.