jivesearch

module

v0.0.0-...-73de0e8 Latest Latest Go to latest Published: Feb 2, 2018 License: Apache-2.0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/clanstyles/jivesearch

Links

Open Source Insights

README ¶

Jive Search is a completely open source search engine that respects your privacy.

Documentation

go get -u github.com/jivesearch/jivesearch

Crawler

cd $GOPATH/src/github.com/jivesearch/jivesearch/search/crawler && go run ./cmd/crawler.go --workers=75 --time=5m --debug=true

Frontend

cd $GOPATH/src/github.com/jivesearch/jivesearch/frontend && go run ./cmd/frontend.go --debug=true

Wikipedia Dump File

cd $GOPATH/src/github.com/jivesearch/jivesearch/wikipedia/cmd/dumper && go run dumper.go --workers=3 --dir=/path/to/wiki/files --text=true --data=true --truncate=400

Directories ¶

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL

Path	Synopsis
bangs Package bangs detects when queries should be redirected to 3rd party sites	Package bangs detects when queries should be redirected to 3rd party sites
cmd Sample bangs demonstrates how to run a simple !bangs server	Sample bangs demonstrates how to run a simple !bangs server
config Package config handles configuration settings	Package config handles configuration settings
frontend Package frontend provides the routing and middleware for the web app	Package frontend provides the routing and middleware for the web app
cmd Command frontend demonstrates how to run the web app	Command frontend demonstrates how to run the web app
instant Package instant provides instant answers	Package instant provides instant answers
cmd Sample instant demonstrates how to run a simple instant answers server.	Sample instant demonstrates how to run a simple instant answers server.
contributors Package contributors contains the contributors of the instant answers	Package contributors contains the contributors of the instant answers
log Package log handles logging for the crawler and frontend	Package log handles logging for the crawler and frontend
search Package search provides the core search results.	Package search provides the core search results.
crawler Package crawler is a distributed web crawler.	Package crawler is a distributed web crawler.
crawler/cmd Command crawler demonstrates how to run the crawler	Command crawler demonstrates how to run the crawler
crawler/queue Package queue manages the queue for a distributed crawler	Package queue manages the queue for a distributed crawler
crawler/robots Package robots handles caching robots.txt files	Package robots handles caching robots.txt files
document Package document parses URLs and the HTML of a webpage	Package document parses URLs and the HTML of a webpage
vote Package vote handles storing and retrieving user votes on urls	Package vote handles storing and retrieving user votes on urls
suggest Package suggest handles AutoComplete and Phrase Suggester (Did you mean?) queries	Package suggest handles AutoComplete and Phrase Suggester (Did you mean?) queries
wikipedia Package wikipedia fetches Wikipedia articles	Package wikipedia fetches Wikipedia articles
cmd/dumper Dumper downloads and dumps wikipedia/wikidata/wikiquotes data to a postgresql database.	Dumper downloads and dumps wikipedia/wikidata/wikiquotes data to a postgresql database.
cmd/wikipedia