utils

func Contains ¶

func Contains(s []string, e string) bool

func CopyMap ¶

func CopyMap(o map[string]string) (r map[string]string)

func MarshalObjToStruct ¶

func MarshalObjToStruct(input interface{}) (*structpb.Struct, error)

TODO: Use the stdlib version in the future, or move there if not there. Don't use this if input is a proto Message.

func MarshalStruct ¶

func MarshalStruct(in proto.Message, out *structpb.Struct) error

func MarshalToString ¶

func MarshalToString(msg proto.Message) (string, error)

func ReplaceTemplateCommandArgs ¶

func ReplaceTemplateCommandArgs(ctx context.Context, command []string, in io.InputReader, out io.OutputFilePaths) ([]string, error)

Evaluates templates in each command with the equivalent value from passed args. Templates are case-insensitive Supported templates are:

• {{ .InputFile }} to receive the input file path. The protocol used will depend on the underlying system configuration. E.g. s3://bucket/key/to/file.pb or /var/run/local.pb are both valid.
• {{ .OutputPrefix }} to receive the path prefix for where to store the outputs.
• {{ .Inputs.myInput }} to receive the actual value of the input passed. See docs on LiteralMapToTemplateArgs for how what to expect each literal type to be serialized as.

If a command isn't a valid template or failed to evaluate, it'll be returned as is. NOTE: I wanted to do in-place replacement, until I realized that in-place replacement will alter the definition of the graph. This is not desirable, as we may have to retry and in that case the replacement will not work and we want to create a new location for outputs

func UnionMaps ¶

func UnionMaps(maps ...map[string]string) map[string]string

This function unions a list of maps (each can be nil or populated) by allocating a new map. Conflicting keys will always defer to the later input map's corresponding value.

func UnmarshalStruct ¶

func UnmarshalStruct(structObj *structpb.Struct, msg proto.Message) error