crawler

package
v1.0.3 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 24, 2018 License: MIT Imports: 10 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func CrawlPage

func CrawlPage(output chan CCANItem)

CrawlPage crawls the entire listing and returns items in the channel

func DoRequest

func DoRequest(url string) (io.ReadCloser, error)

DoRequest opens the file at the specified url

Types

type CCANItem

type CCANItem struct {
	Name          string    `json:"name"`
	Date          time.Time `json:"date"`
	DownloadCount int       `json:"download_count"`
	Author        string    `json:"author"`
	Votes         int       `json:"votes"`
	Category      string    `json:"category"`
	Engine        string    `json:"engine"`
	DownloadLink  string    `json:"download_link"`
	DirectLink    string    `json:"direct_link"`
}

CCANItem is an item from the listing at `url`

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL