ollama-server

module
v0.0.0-...-a7dec08 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 30, 2024 License: MIT

README

Ollama-Server

旨在提供一个简单的、基于llama.cpp的服务端,提供模型管理API。

服务功能
  • 下载模型

  • API

  • llama.cpp project founded by Georgi Gerganov.

  • ollama get up and running with large language models locally.

Directories

Path Synopsis
Package api implements the client-side API for code wishing to interact with the ollama service.
Package api implements the client-side API for code wishing to interact with the ollama service.
app
examples
go-chat command
go-generate command
go-multimodal command
llm
openai package provides middleware for partial compatibility with the OpenAI REST API
openai package provides middleware for partial compatibility with the OpenAI REST API
types
errtypes
Package errtypes contains custom error types
Package errtypes contains custom error types
model
Package model contains types and utilities for parsing, validating, and working with model names and digests.
Package model contains types and utilities for parsing, validating, and working with model names and digests.
util

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL