decode

package
v0.0.0-...-876d392 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 20, 2020 License: Apache-2.0 Imports: 19 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Read

func Read(ctx context.Context, cncl context.CancelFunc, name string, fs *types.FileStore, dbconfig database.Database, tika string, gotenburg string)

Read generates meta data from the content of a filestore

func SentenceSplitter

func SentenceSplitter(data []byte, atEOF bool) (advance int, token []byte, err error)

SentenceSplitter uses Punkt Sentence Tokenizer to scan for sentences in text

Types

type ContextKey

type ContextKey byte

ContextKey is a type to differentiate values from this package from other values when used as a key in a context key-value pair

const (
	// PROCESSING is a key for a context value that should either be a buffered channel of struct{} or sync.Locker. These objects are used to limit the number of active processing threads. If unset processing run as soon as called.
	PROCESSING ContextKey = 'p'
	// TIMEOUT is a key for a context value that is expected to be a time.Duration. It is the time allotted to the processing of a file, if nil no time limit
	TIMEOUT ContextKey = 't'
)

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL