usermodel

README

usermodel

Given a task string (like code-completion), return the user-configured Ollama model for this task.

The user-configured Ollama model is found by executing llm-manager.

If no user-configured model is available, return a default model.

Example use

package main

import (
    "fmt"

    "github.com/xyproto/usermodel"
)

func main() {
    fmt.Println(usermodel.GetVisionModel())
}

Exported types

type Task string

Exported constants

ChatTask           = "chat"
CodeTask           = "code"
CodeCompletionTask = "code-completion"
TestTask           = "test"
TextGenerationTask = "text-generation"
ToolUseTask        = "tool-use"
TranslationTask    = "translation"
VisionTask         = "vision"

Exported functions

func AvailableTasks() []Task
func GetChatModel() string
func GetCodeModel() string
func GetCodeCompletionModel() string
func GetTestModel() string
func GetTextGenerationModel() string
func GetToolUseModel() string
func GetTranslationModel() string
func GetVisionModel() string
func Get(task Task) string

General info

• Version: 1.2.2
• License: BSD-3
• Author: Alexander F. Rødseth <xyproto@archlinux.org>

Documentation

Index

• Constants
• Variables
• func Get(task Task) string
• func GetChatModel() string
• func GetCodeCompletionModel() string
• func GetCodeModel() string
• func GetTestModel() string
• func GetTextGenerationModel() string
• func GetToolUseModel() string
• func GetTranslationModel() string
• func GetVisionModel() string
• type Task
  • func AvailableTasks() []Task

Constants

const (

	// Tasks
	ChatTask           = "chat"
	CodeTask           = "code"
	CodeCompletionTask = "code-completion"
	TestTask           = "test"
	TextGenerationTask = "text-generation"
	ToolUseTask        = "tool-use"
	TranslationTask    = "translation"
	VisionTask         = "vision"
)

Variables

var (
	DefaultModels = map[Task]string{
		"chat":            "llama3.2:3b",
		"code":            "deepseek-coder:1.3b",
		"code-completion": "deepseek-coder:1.3b",
		"test":            "tinyllama:1b",
		"text-generation": "gemma2:2b",
		"tool-use":        "llama3.2:3b",
		"translation":     "mixtral:8x7b",
		"vision":          "llava:7b",
	}
)

Functions

func Get

func Get(task Task) string

Get attempts to retrieve the model name using llm-manager. If llm-manager is not available or the command fails, it falls back to the Default*Model variables.

func GetChatModel

func GetChatModel() string

func GetCodeCompletionModel

func GetCodeCompletionModel() string

func GetCodeModel

func GetCodeModel() string

func GetTestModel

func GetTestModel() string

func GetTextGenerationModel

func GetTextGenerationModel() string

func GetToolUseModel

func GetToolUseModel() string

func GetTranslationModel

func GetTranslationModel() string

func GetVisionModel

func GetVisionModel() string

Types

type Task

type Task string

func AvailableTasks

func AvailableTasks() []Task