libgcwl

package
v0.0.0-...-5982ae0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 21, 2018 License: GPL-3.0 Imports: 5 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func PrintBanner

func PrintBanner()

PrintBanner outputs the welcome banner to users using the tool

Types

type CrawlState

type CrawlState struct {
	FoundURLs       map[string]struct{}
	UnprocessedURLs map[string]struct{}
	FoundWords      map[string]struct{}
}

CrawlState is used to track information we need during the crawl

type FlagConfig

type FlagConfig struct {
	SeedURLs []string `json:"seed_urls",xml:"seed_urls"`
	Depth    int      `json:"depth",xml:"depth"`
	Verbose  bool     `json:"verbose",xml:"verbose"`
}

FlagConfig is used to contain the different flag values that we receive from the user on the command line. Including things like help, verbose, depth, etc.

func (*FlagConfig) RunCrawler

func (c *FlagConfig) RunCrawler()

RunCrawler begins the crawling tool

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL