app

package

v0.0.0-...-c6bfbce Latest Latest Go to latest Published: Oct 1, 2019 License: MIT Imports: 13 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/teohrt/abrasion

Links

Open Source Insights

Documentation ¶

Index ¶

func Start(c *Config)
type Config
- func (c *Config) Process()
- func (c *Config) Scrape(URL string)

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func Start ¶

func Start(c *Config)

Types ¶

type Config ¶

type Config struct {
	SeedURL     string
	ScrapeLimit int
	GetEmails   bool
	Verbose     bool
	Debug       bool

	Client   http.Client
	Wg       *sync.WaitGroup
	DataChan chan string
	URLChan  chan string
	Logger   utils.Logger
	Regex    *regexp.Regexp
}

func (*Config) Process ¶

func (c *Config) Process()

Scrapes new URLs and logs them

func (*Config) Scrape ¶

func (c *Config) Scrape(URL string)

Extracts all links and emails from a page and sends them back to processor over channels

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL