csv

Overview ¶

Package main will create a CSV dataset by reading the specified zip file.

Zip file is assumed to be created by generate-dataset.go, following this format:

TRAIN/labelA/foo.txt
VALIDATION/labelB/bar.txt
TEST/labelA/whatever.txt

aka <partition>/<label>/<name>, or alternatively leaving out the parition:

labelA/foo.txt
labelB/bar.txt
labelA/whatever.txt

The corresponding CSV file rows will look like:

TRAIN,"hello world",labelA
VALIDATION,"contents of bar",labelB
TEST,"more interesting stuff",labelA

aka <parition>,<content of file>,<label>, possibly leaving the partition column blank:

,"hello world",labelA
,"contents of bar",labelB
,"more interesting stuff",labelA