ollama

Documentation

Overview

* ChatCLI - Command Line Interface for LLM interaction * Copyright (c) 2024 Edilson Freitas * License: Apache-2.0

Index

• type Client
  • func NewClient(baseURL, model string, logger *zap.Logger, maxAttempts int, ...) *Client
  • func (c *Client) GetModelName() string
  • func (c *Client) LastStopReason() string
  • func (c *Client) LastUsage() *models.UsageInfo
  • func (c *Client) ListModels(ctx context.Context) ([]client.ModelInfo, error)
  • func (c *Client) SendPrompt(ctx context.Context, prompt string, history []models.Message, maxTokens int) (string, error)

Types

type Client

type Client struct {
	// contains filtered or unexported fields
}

func NewClient

func NewClient(baseURL, model string, logger *zap.Logger, maxAttempts int, backoff time.Duration) *Client

NewClient cria uma nova instância de Client para Ollama. Agora sem fallback interno: usa apenas os params passados (vindos do manager/ENVs).

func (*Client) GetModelName

func (c *Client) GetModelName() string

func (*Client) LastStopReason

func (c *Client) LastStopReason() string

LastStopReason returns the stop reason from the most recent API call.

func (*Client) LastUsage

func (c *Client) LastUsage() *models.UsageInfo

LastUsage returns the token usage from the most recent API call.

func (*Client) ListModels

func (c *Client) ListModels(ctx context.Context) ([]client.ModelInfo, error)

ListModels fetches available models from the Ollama /api/tags endpoint.

func (*Client) SendPrompt

func (c *Client) SendPrompt(ctx context.Context, prompt string, history []models.Message, maxTokens int) (string, error)