server

package
v0.0.0-...-93e72dd Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 4, 2023 License: MIT Imports: 15 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func AbortHandler

func AbortHandler(c echo.Context) error

func CreateCompletionHandler

func CreateCompletionHandler(c echo.Context) error

Create an Openai api for /v1/chat/completion

func ExecuteTaskHandler

func ExecuteTaskHandler(c echo.Context) error

func InferHandler

func InferHandler(c echo.Context) error

func LoadModelHandler

func LoadModelHandler(c echo.Context) error

func ModelsStateHandler

func ModelsStateHandler(c echo.Context) error

func OpenAiListModels

func OpenAiListModels(c echo.Context) error

func ParseInferParams

func ParseInferParams(m echo.Map) (string, string, types.ModelConf, types.InferenceParams, error)

func ReadTaskHandler

func ReadTaskHandler(c echo.Context) error

func ReadTasksHandler

func ReadTasksHandler(c echo.Context) error

func RunServer

func RunServer(origins []string, apiKey string, localMode bool, enableOai bool, disableApiKey bool)

func SaveTaskHandler

func SaveTaskHandler(c echo.Context) error

func UnloadModelHandler

func UnloadModelHandler(c echo.Context) error

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL