gcrawler

package
v0.0.0-...-bc4c757 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 26, 2023 License: GPL-3.0 Imports: 3 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func AddDomainToBlacklist

func AddDomainToBlacklist(domain string)

func AddPrefixToBlacklist

func AddPrefixToBlacklist(prefix string)

func IsBlacklisted

func IsBlacklisted(u PreparedUrl) bool

Types

type PreparedUrl

type PreparedUrl struct {
	Parsed    *url.URL
	NonParsed string
}

since we frequently need both the parsed and non-parsed form of the url, we'll be passing this url around so we only need to parse once, and not have to reassemble the parsed url either.

func (PreparedUrl) String

func (u PreparedUrl) String() string

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL