components

Package crawler is grouped around the Crawler component, crawling and indexing content from an AnnotatedResource.

Package extractor is grouped around the Extractor component, extracting metadata from an AnnotatedResource.

Package index is grouped around the Index component, representing an index which stores and retrieves document properties.

Package protocol is grouped around the Protocol component, the interface with one or multiple protocols.

Package queue provides queueing semantics.

Package sniffer contains sniffer components which can be wired into a libp2p dht node by proxying the datastore.