package
module
Version:
v0.0.0-...-3990c93
Opens a new window with list of versions in this module.
Published: Jan 16, 2020
License: AGPL-3.0
Opens a new window with license information.
Imports: 0
Opens a new window with list of imports.
Imported by: 0
Opens a new window with list of known importers.
README
¶
xojoc.pw/crawl
crawl is a library written in golang for crawling the web.
Usage
See godoc for the complete documentation.
Who?
crawl was written by Alexandru Cojocaru.
License
crawl is Free Software and under the AGPLv3 or any later version license.
Documentation
¶
There is no documentation for this package.
Source Files
¶
Directories
¶
|
|
|
|
Package outline extracts information from html pages.
|
Package outline extracts information from html pages. |
Package robots parses a robots.txt file as specified by Wikipedia https://en.wikipedia.org/wiki/Robots.txt
|
Package robots parses a robots.txt file as specified by Wikipedia https://en.wikipedia.org/wiki/Robots.txt |
|
|
|
|
Click to show internal directories.
Click to hide internal directories.