README
¶
Go Download Web
A simple command-line application to download an entire online website, including CSS, JSS, and other assets. Coded with Go.
Project status
There are still some to-do's, and some refactoring is needed, but the app is already functional.
Installation
There is nothing special to do here, just download the code, build it as you would do with any other Go app, and you are set to go.
$ git clone https://github.com/CalderWhite/go-download-web
$ cd go-download-web
$ go build
Usage
# Default mode:
$ ./go-download-web -u https://example.com
# Setting the number of concurrent connections to 10:
$ ./go-download-web -u https://example.com -s 10
# Scrape a website without ignoring query params on URLs
$ ./go-download-web -u https://example.com -q
# Change the domain name of the downloaded copy:
$ ./go-download-web -u https://example.com -new https://newname.com
Contributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.
Author
License
Documentation
¶
Overview ¶
Copyright 2021 Antonio Sanchez (asanchez.dev). All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Source Files
Directories