htmlscrape

package module

v0.5.1-0...-feb9fc2 Latest Latest Go to latest Published: Jul 9, 2020 License: MIT Imports: 6 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

A dumping ground of utility functions for I make for scraping HTML pages

This section is empty.

This section is empty.

func FindNode(n *html.Node, matcher *NodeMatcher) *html.Node

FindNode recursively searches for a node which matches the given NodeMatcher

func New(url string) (*html.Node, error)

New returns an HTML document rooted at the HTML node

func Table(url string, matcher *NodeMatcher) (*html.Node, error)

Table returns an HTML table which matches the given NodeMatcher

func TableRows(url string, rows chan<- *html.Node, tableMatcher *NodeMatcher) error

TableRows sends to a channel the rows of the HTML table which matches the NodeMatcher

type NodeMatcher struct {
	// contains filtered or unexported fields
}

NodeMatcher allows you to build a set of criteria to match against a node

func NewNodeMatcher() *NodeMatcher

NewNodeMatcher initializes a new NodeMatcher object

func (m *NodeMatcher) Atom(v atom.Atom) *NodeMatcher

Atom allows you to add DataAtom as matching criteria

func (m *NodeMatcher) Attr(k, v string) *NodeMatcher

Attr allows you to add an attribute as matching criteria

func (m *NodeMatcher) Attrs(v map[string]string) *NodeMatcher

Attrs allows you to add a slice of attributes as matching criteria

func (m *NodeMatcher) Elem() *NodeMatcher

Elem specifies ElementNode as matching criteria

func (m *NodeMatcher) Text() *NodeMatcher

Text specifies TextNode as matching criteria

func (m *NodeMatcher) Type(v html.NodeType) *NodeMatcher

Type allows you to add NodeType as matching criteria