web-links

command
v1.0.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Mar 13, 2019 License: MIT Imports: 10 Imported by: 0

README

This example is a simple web crawler that finds all anchor tags in a web page and follows the links to get to other pages. After a predefined number of pages are fetched, it creates a graph of the pages using graphviz.

The crawler only fetches URLs that are of the form github.com/user/repo. Here is a graph generated by this program starting from https://github.com/topics/go limited to 200 URLs:

Example graph image

Documentation

The Go Gopher

There is no documentation for this package.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL