README
¶
wikidump
Description
Package wikidump is a golang package that provides utility functions for downloading and extracting wikipedia dumps.
Installation
This package can be installed with the go get command:
go get github.com/negapedia/wikidump
Dependencies
This package depends on p7zip>=16.02 for 7zip files extraction.
Documentation
API documentation can be found in the associated godoc reference
Documentation
¶
Overview ¶
Package wikidump provides utility functions for downloading and extracting wikipedia dumps.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type Wikidump ¶
type Wikidump struct {
// contains filtered or unexported fields
}
Wikidump represent a hub from which request particular dump files of wikipedia.
func (Wikidump) Open ¶
Open returns an iterator over the resources associated with the current filename, the download can be stopped by the context. Once the iterator is depleted, it returns an io.EOF error. Once an error is returned by the iterator, any subsequent call will return the same error. It is the caller's responsibility to call Close on the Reader when done. Open takes care of checking SHA1 sum, retry download and decompressing files.
Source Files