Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Config ¶
type Config struct { UserAgent string `json:"userAgent"` // recommend UA from Chrome RequestTimeout int `json:"requestTimeout"` // seconds RequestInterval int `json:"requestInterval"` // milliseconds Search struct { City string `json:"city"` // the city Keywords []string `json:"keywords"` // how to search from lagou Company struct { ExcludeID []int `json:"excludeID"` // must exclude CompanyID } `json:"company"` Position struct { ExcludeID []int `json:"excludeID"` // must exclude PositionID Filter struct { Include []string `json:"include"` // must include words Exclude []string `json:"exclude"` // must exclude words } `json:"filter"` Salary struct { Min int `json:"min"` // min salary Max int `json:"max"` // max salary } `json:"salary"` } `json:"position"` } `json:"search"` Output struct { Files struct { JSON string `json:"json"` } `json:"files"` HTTP struct { Port int `json:"port"` } `json:"http"` } `json:"output"` }
Config the config.json file structure
func (*Config) ReadConfig ¶
ReadConfig Read the filename path file, and parse to Config.
type Filter ¶
type Filter struct { Company struct { ExcludeID map[int]bool // must exclude CompanyID } Position struct { ExcludeID map[int]bool // must exclude PositionID Filter struct { Include []string // must include words Exclude []string // must exclude words } Salary struct { Min int // min salary Max int // max salary } } }
Filter lagou jobs filter
type ResultCompany ¶
type ResultCompany struct { CompanyID int `json:"companyID"` CompanyName string `json:"companyName"` CompanyFullName string `json:"companyFullName"` CompanyURL string `json:"companyURL"` Positions []ResultPosition `json:"positions"` }
ResultCompany defines structure of lagou company result
type ResultPosition ¶
type ResultPosition struct { PositionID int `json:"positionID"` PositionName string `json:"positionName"` PositionURL string `json:"positionURL"` Salary string `json:"salary"` CreateTime string `json:"createTime"` }
ResultPosition defines structure of lagou position result
type Results ¶
type Results struct {
Companies []ResultCompany `json:"companies"`
}
Results defines all lagou results
type Spider ¶
type Spider struct { Config Filter Request Cookies string // contains filtered or unexported fields }
Spider defines lagou spider main body
func (*Spider) GetCookies ¶
GetCookies fetch and set cookies from a http request.
func (Spider) SearchPositionMap ¶
func (s Spider) SearchPositionMap(city, keyword string) (mobile.PositionMap, error)
SearchPositionMap search all positions via city and keyword, returns a PositionMap.
func (Spider) SearchPositionMaps ¶
SearchPositionMaps search all positions via city and some keywords, returns a PositionMap.
Source Files ¶
Click to show internal directories.
Click to hide internal directories.