scraper

package

v0.0.0-...-eccf244 Latest Latest Go to latest Published: May 3, 2017 License: Apache-2.0 Imports: 9 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/ssimunic/jsonscraper

Links

Open Source Insights

Documentation ¶

Index ¶

func JSONMarshalUnescaped(v interface{}) ([]byte, error)
type Config
type Scraper
- func New(configPath string) (*Scraper, error)
- func (s *Scraper) Start()

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func JSONMarshalUnescaped ¶

func JSONMarshalUnescaped(v interface{}) ([]byte, error)

JSONMarshalUnescaped does what json.Marshal does without escaping &, <, >.

Types ¶

type Config ¶

type Config struct {
	URLs    []string  `json:"urls"`
	Targets []*target `json:"targets"`
	Output  *output   `json:"output"`
	// contains filtered or unexported fields
}

Config holds information from config file.

type Scraper ¶

type Scraper struct {
	Config  *Config
	Results results
}

Scraper struct used for scraping activity.

func New ¶

func New(configPath string) (*Scraper, error)

New creates new Scraper and returns pointer to it, with error (if occurred).

func (*Scraper) Start ¶

func (s *Scraper) Start()

Start will start scraping in separate goroutine and save results when it is done in file that is defined in Config.

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL