localclient

package

v0.4.7 Latest Latest Go to latest Published: Nov 24, 2023 License: MIT Imports: 3 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Package localclient provides a client for local LLMs.

This section is empty.

View Source

var ErrEmptyResponse = errors.New("empty response")

ErrEmptyResponse is returned when the OpenAI API returns an empty response.

This section is empty.

type Client struct {
	BinPath      string
	Args         []string
	GlobalAsArgs bool
}

Client is a client for a local LLM.

func New(binPath string, globalAsArgs bool, args ...string) (*Client, error)

New returns a new local client.

func (c *Client) CreateCompletion(ctx context.Context, r *CompletionRequest) (*Completion, error)

CreateCompletion creates a completion.

type Completion struct {
	Text string `json:"text"`
}

Completion is a completion.

type CompletionRequest struct {
	Prompt string `json:"prompt"`
}

CompletionRequest is a request to create a completion.