Documentation
¶
Overview ¶
Package scrapper implements the scrapper library for the Crowler and the Crowler search engine.
Package scraper implements the scraper library for the Crowler and the Crowler search engine.
Index ¶
- func ApplyPostProcessingStep(step *rs.PostProcessingStep, data *[]byte)
- func ApplyRule(rule *rs.ScrapingRule, webPage *selenium.WebDriver) map[string]interface{}
- func ApplyRulesGroup(ruleGroup *rs.RuleGroup, url string, webPage *selenium.WebDriver) (map[string]interface{}, error)
- type ScraperRuleEngine
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func ApplyPostProcessingStep ¶
func ApplyPostProcessingStep(step *rs.PostProcessingStep, data *[]byte)
ApplyPostProcessingStep applies the provided post-processing step to the provided data.
Types ¶
type ScraperRuleEngine ¶
type ScraperRuleEngine struct {
*rs.RuleEngine // generic rule engine
}
ScraperRuleEngine extends RuleEngine from the ruleset package
Source Files
Click to show internal directories.
Click to hide internal directories.