convert_all

Convert all archives

A CLI tool to convert all archives from src bucket/directory to the dst bucket. It will send conversion requests to the cloud run endpoint in a controlled manner. It will try any conversion requests at most three times (with 30s backoff after each failed attempt).

Usage

$  go run cmd/utils/convert_all/main.go --src_bucket=routeviews-archives \
                                  --dst_bucket=routeviews-bigquery \
                                  --root_dir=bgpdata \
                                  --host=[Cloud Run URL] \
                                  --sa_key=[Path to service account key] \
                                  --num_workers=4