prox
prox is a command line utility for quickly finding and testing proxies from the web.
Downloading
GO111MODULE=on go get github.com/nicksherron/prox
prox has been tested on Linux(ubuntu) and OSX
Example
Here's and example of downloading 20,000 proxies and returning the first 100 that returned 200 status code
during testing.
prox --workers 400 --limit 100
When using a high worker count you will usually need to increase your open file limit.
On OSX and Linux you can do this by running
ulimit -n 10000
Usage
prox --help
NAME:
prox - Find and test proxies from the web.
AUTHOR:
Nick Sherron <nsherron90@gmail.com>
OPTIONS:
--file value, -f value File name to write to instead of stdout.
--nocheck Download only and skip proxy checks. (default: false)
--limit value, -l value Limit number of good proxies to check before completing. (default: 0)
--timeout value, -t value Specify request time out for checking proxies. (default: 15s)
--workers value, -w value Number of (goroutines) concurrent requests to make for checking proxies. (default: 20)
--url value, -u value The url to test proxies against. (default: "https://httpbin.org/ip")
--help, -h show help (default: false)
--version, -v print the version (default: false)