storetheindex

command module
v0.0.0-...-403c8b4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 18, 2022 License: Apache-2.0, MIT Imports: 8 Imported by: 0

README

StoreTheIndex 🗂️

Go Reference Coverage Status

The first place to go in order to find a CID stored in Filecoin

This repo provides an indexer implementation that can be used to index data stored by a range of participating storage providers.

Design

Current Status

Released for production: The current production release is running at https://cid.contact

This project and is currently under active development 🚧.

Install

This assumes go is already installed.

Install storetheindex:

go get github.com/maolin-sen/go-filecoin-market/apps/app/storetheindex

Initialize the storetheindex repository and configuration:

storetheindex init

Optionally, edit the configuration

edit ~/.storetheindex/config 

Running the Indexer Service

To run storetheindex as a service, run the daemon command. The service watches for providers to index, and exposes a query / content routing client interface.

The daemon is configured by the config file in the storetheindex repository. The config file and repo are created when storetheindex is initialized, using the init command. This repo is located in the local file system. By default, the repo is located at ~/.storetheindex. To change the repo location, set the $STORETHEINDEX_PATH environmental variable.

Indexer CLI Commands

There are a number of client commands included with storetheindex. Their purpose is to perform simple indexing and lookup actions against a running daemon. These can be helpful to test that an indexer is working. These include the following commands:

Informational:

  • find Find value by CID or multihash in indexer
  • providers Show information about providers known to the indexer
    • get Get information about a specified provider
    • list List the known providers

Administrative:

  • admin Perform admin activities with an indexer
    • allow Allow advertisements and content from peer
    • block Block advertisements and content from peer
    • import-providers Import provider information from another indexer
    • reload-config Reload various settings from the configuration file
    • sync Sync indexer with provider
  • init Initialize or upgrade indexer node config file

Testing:

  • import Imports data to indexer from different sources
  • register Register provider information with an indexer
  • synthetic Generate synthetic load to import in indexer

Help

To see a list of available commands, see storetheindex --help. For help with command usage, see storetheindex <command> --help.

Configuration

The storetheindex config file documentation

License

SPDX-License-Identifier: Apache-2.0 OR MIT

Documentation

The Go Gopher

There is no documentation for this package.

Directories

Path Synopsis
api
v0
v0/ingest/schema
Package schema defines the makeup of an advertisement.
Package schema defines the makeup of an advertisement.
v0/libp2pclient
Package libp2pclient provides general libp2p client functionality
Package libp2pclient provides general libp2p client functionality
internal
httpserver
Package httpserver provides functionality common to all storetheindex HTTP servers
Package httpserver provides functionality common to all storetheindex HTTP servers
metrics/pprof
Package pprof is separated out from metrics to isolate the 'init' functionality of pprof, so thatit is included when used by binaries, but not if other packages get used or integrated into clients that don't expect the pprof side effect to have taken effect.
Package pprof is separated out from metrics to isolate the 'init' functionality of pprof, so thatit is included when used by binaries, but not if other packages get used or integrated into clients that don't expect the pprof side effect to have taken effect.
version
Package version records versioning information about this module.
Package version records versioning information about this module.
Package peerutil provides utilities around peer ID values.
Package peerutil provides utilities around peer ID values.
server
test

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL