command
module
Version:
v0.0.0-...-3dac89b
Opens a new window with list of versions in this module.
Published: Mar 24, 2017
License: Apache-2.0
Opens a new window with license information.
Imports: 9
Opens a new window with list of imports.
Imported by: 0
Opens a new window with list of known importers.
README
¶
crawl-links
Links crawler.
Usage
Example usage from command line:
# Install command line application for crawl scheduling
$ go install github.com/crackcomm/crawl/nsq/crawl-schedule
# Schedule crawl of google search results
$ crawl-schedule \
--nsq-topic crawl_links \
--callback github.com/crackcomm/crawl-links/spider.Links \
"https://www.google.com/search?q=Github"
License
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
Authors
Documentation
¶
There is no documentation for this package.
Source Files
¶
Directories
¶
Click to show internal directories.
Click to hide internal directories.