press

press-archiver

press-archiver is a set of tools to crawl (and archive) press articles behind paywall(s).

cmd/press-archiver

press-archiver is a simple command to retrieve press articles as PDFs.

$> go install sbinet.org/x/press-archiver/cmd/press-archiver
$> press-archiver -h
press-archiver archives press articles.

Usage: press-archive [OPTIONS] URL

Example:

 $> press-archive https://example.org/interesting-article
 $> press-archive -o out.pdf https://example.org/interesting-article
 $> press-archive -cfg credentials.cfg -o out.pdf https://example.org/interesting-article

Options:
  -cfg string
    	path to configuration credentials
  -o string
    	path to output PDF to produce (default "out.pdf")

$> press-archiver -o out.pdf -cfg auth.cfg https://example.org/interesting-article
$> open out.pdf

The auth.cfg file contains credentials in the form:

example.org {
    user my-account
    pass s3cr3t
}

example.com {
    user my-other-account
    pass still-s3cr3t
}

cmd/press-archiver-srv

$> go install sbinet.org/x/press-archiver/cmd/press-archiver-srv
$> press-archiver-srv -h
press-archiver-srv serves PDFs from archived press articles.

Usage: press-archive-srv [OPTIONS]

Example:

 $> press-archive-srv
 $> press-archive-srv -addr :8080 -cfg ./credentials.cfg -cache ./cache -prefix /press

Options:
  -addr string
    	[host]:port to serve (default ":8080")
  -cache string
    	path to cache of articles
  -cfg string
    	path to credentials settings
  -prefix string
    	prefix of web server end-points (default "/")

$> press-archiver-srv -prefix /press &

$> open http://localhost:8080/press

License

• press-archive is released under the BSD-3 license.
• Newspaper by Smalllike from the Noun Project (CC BY 3.0).