split

package module

v0.0.0-...-8bd1e13 Latest Latest Go to latest Published: Aug 12, 2021 License: BSD-2-Clause Imports: 14 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/tckz/go-split

Links

Open Source Insights

README ¶

go-split

Split text files into parts.

Usage: go-split [options] input-file...
  -compress string
        {gzip|other=without compression}
  -parallelism int
        Maximum number of files which read parallely (default 4)
  -prefix string
        Path prefix of outputs (default "out-")
  -split int
        Number of files that splitted (default 8)
  -verbose
        Verbose output
  -version
        Show version

Development

Requirements

Go 1.15
GNU Make

Prerequisites

Install stringer project locally.
```
$ make tools
```

Build

$ make
# -> go-split

License

BSD 2-Clause License

SEE LICENSE

My Environment

CentOS 8.3.2011
Go 1.15.11
GNU Make 4.2.1

Documentation ¶

Index ¶

type CompressionType
- func (i CompressionType) String() string
type Param
type Splitter
- func NewSplitter() *Splitter

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

This section is empty.

Types ¶

type CompressionType ¶

type CompressionType int

const (
	CompressionUnknown CompressionType = iota
	CompressionNone
	CompressionGzip
)

func (CompressionType) String ¶

func (i CompressionType) String() string

type Param ¶

type Param struct {
	Verbose     bool
	Split       int
	Parallelism int
	Prefix      string
	Compress    string
}

type Splitter ¶

type Splitter struct {
	// contains filtered or unexported fields
}

func NewSplitter ¶

func NewSplitter() *Splitter

func (*Splitter) Do ¶

func (s *Splitter) Do(ctx context.Context, files []string, param Param) (retErr error)

func (*Splitter) ParallelFileScan ¶

func (s *Splitter) ParallelFileScan(ctx context.Context, cancel func(), files []string, parallelism int, param Param, chOut chan<- line) (_ *errgroup.Group, retErr error)

func (*Splitter) ParallelScan ¶

func (s *Splitter) ParallelScan(ctx context.Context, cancel func(), chIn <-chan readTarget, parallelism int, param Param, chOut chan<- line) (_ *errgroup.Group, retErr error)

func (*Splitter) ParallelWrite ¶

func (s *Splitter) ParallelWrite(ctx context.Context, cancel func(), chIn <-chan line, parallelism int, param Param) (_ *errgroup.Group, retErr error)

Source Files ¶

View all Source files

Directories ¶

Path	Synopsis
cmd
go-split

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL