lmspeedtest

command module
v0.3.7 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: May 22, 2026 License: MIT Imports: 19 Imported by: 0

README

LMSpeedTest

LMSpeedTest Logo

Go Version License Buy Me A Coffee

A beautiful, interactive CLI for benchmarking Ollama & LM Studio LLM inference speed

📸 Screenshots

Help output

Models list   Dashboard

Doctor diagnostics   Server info

✨ Features

  • 🎯 Interactive Model Selection — Beautiful TUI multi-select with filtering by size and name
  • 📊 Rich Metrics — Generation TPS, prompt eval TPS, TTFT, ITL, and model load time
  • 🎨 Styled Terminal Output — Powered by Lipgloss and Huh
  • 🔁 Multiple Epochs — Run N benchmarks per model, keep the best result
  • 📝 Configurable Prompts — Code generation, chat, long-form, or custom file-based prompts
  • 📈 Export Formats — CSV, JSON, or Go benchstat-compatible output
  • 🔥 Batch Mode — Benchmark all matching models without interactive selection
  • 🌡️ Automatic Warmup — Every model gets a lightweight warmup run before measurement
  • 📉 Stability Analysis — See variance, min/max across epochs
  • 🌐 Web Dashboard — Serve results over HTTP with lmspeedtest serve
  • 🔐 Auth Support — Bearer token authentication for remote Ollama/LM Studio instances
  • 🖥️ Remote-Friendly — Works with local or remote Ollama/LM Studio servers
  • 🏢 Multi-Server Support — Manage and benchmark multiple Ollama/LM Studio servers

🚀 Installation

Download the latest release for your platform from the releases page.

macOS (Intel)

curl -L https://github.com/notfixingit3/lmspeedtest/releases/latest/download/lmspeedtest_$(curl -s https://api.github.com/repos/notfixingit3/lmspeedtest/releases/latest | grep tag_name | cut -d '"' -f 4)_darwin_amd64.tar.gz | tar xz
mv lmspeedtest /usr/local/bin/

macOS (Apple Silicon)

curl -L https://github.com/notfixingit3/lmspeedtest/releases/latest/download/lmspeedtest_$(curl -s https://api.github.com/repos/notfixingit3/lmspeedtest/releases/latest | grep tag_name | cut -d '"' -f 4)_darwin_arm64.tar.gz | tar xz
mv lmspeedtest /usr/local/bin/

Linux (x86_64)

curl -L https://github.com/notfixingit3/lmspeedtest/releases/latest/download/lmspeedtest_$(curl -s https://api.github.com/repos/notfixingit3/lmspeedtest/releases/latest | grep tag_name | cut -d '"' -f 4)_linux_amd64.tar.gz | tar xz
sudo mv lmspeedtest /usr/local/bin/

Linux (ARM64)

curl -L https://github.com/notfixingit3/lmspeedtest/releases/latest/download/lmspeedtest_$(curl -s https://api.github.com/repos/notfixingit3/lmspeedtest/releases/latest | grep tag_name | cut -d '"' -f 4)_linux_arm64.tar.gz | tar xz
sudo mv lmspeedtest /usr/local/bin/

Windows (x86_64) Download lmspeedtest_*_windows_amd64.zip from the releases page, extract, and add to your PATH.

Windows (ARM64 - Snapdragon/Qualcomm) Download lmspeedtest_*_windows_arm64.zip from the releases page, extract, and add to your PATH.

Via Go Install
go install github.com/notfixingit3/lmspeedtest@latest
From Source
git clone https://github.com/notfixingit3/lmspeedtest.git
cd lmspeedtest
go build -o lmspeedtest
chmod +x lmspeedtest

🎬 Quick Start

# Configure your Ollama/LM Studio host
./lmspeedtest connect

# List available models
./lmspeedtest models

# Benchmark models ≤ 8 GB with interactive selection
./lmspeedtest test 8

# View your results dashboard
./lmspeedtest dashboard

📖 Usage

Commands
Command Description
connect Configure Ollama/LM Studio host and optional auth token
connect --add <name> Add a new server profile
connect --list List all configured server profiles
connect --default <name> Set the default server profile
connect --use <name> Switch to a different server profile
connect --remove <name> Remove a server profile
info Show server version, host, and auth status
doctor Run diagnostics: check config, connectivity, and permissions
models [max_gb] [name_filter] List models with metadata (params, quantization)
test <max_gb> [opts] Benchmark matching models
dashboard Show latest results per model
compare <model> Compare all context sizes for a model
export [--format fmt] Export results (csv, json, benchstat, markdown)
reset Clear all benchmark results
serve [--port N] Start web dashboard (default: 8080)
Test Options
./lmspeedtest test 8                    # Interactive TUI selection
./lmspeedtest test 8 64k                # Use 64k context window
./lmspeedtest test 8 32k qwen           # Filter by name + context
./lmspeedtest test 8 llama,gemma4       # Multi-filter: match any name
./lmspeedtest test 8 --all              # Benchmark all (skip TUI)
./lmspeedtest test 8 --epochs 3         # Run 3 epochs, keep best
./lmspeedtest test 8 --template code    # Code generation prompt
./lmspeedtest test 8 --template chat    # Short chat prompt
./lmspeedtest test 8 --template long    # Long-form writing (default)
./lmspeedtest test 8 --prompt-file path.txt  # Custom prompt from file
Real-World Examples
# Compare all your models at once
./lmspeedtest test 100 --all

# Deep benchmark: 5 epochs with long-form prompt
./lmspeedtest test 16 --epochs 5 --template long

# Quick code generation benchmark
./lmspeedtest test 8 --template code --epochs 3

# Deep benchmark with custom prompt
./lmspeedtest test 16 --epochs 5 --prompt-file prompt.txt

# Multi-filter: benchmark llama and gemma models only
./lmspeedtest test 16 llama,gemma --epochs 3

# Export for statistical analysis
./lmspeedtest export --format benchstat > results.bench
benchstat results.bench

# Start web dashboard
./lmspeedtest serve
./lmspeedtest serve --port 3000

# Clear all results
./lmspeedtest reset

# Connect to remote Ollama/LM Studio with auth
./lmspeedtest connect
# Host: https://ollama.example.com or http://10.1.6.30:1234
# Token: sk-abc123
./lmspeedtest info

# Multi-server: add and switch between servers
./lmspeedtest connect --add desktop --host http://192.168.1.10:11434
./lmspeedtest connect --add laptop --host http://192.168.1.11:11434 --token sk-abc
./lmspeedtest connect --list
# → default (http://localhost:11434) [active]
# → desktop (http://192.168.1.10:11434)
# → laptop (http://192.168.1.11:11434)
./lmspeedtest connect --use desktop
./lmspeedtest test 8 --all
./lmspeedtest connect --use laptop
./lmspeedtest test 8 --all
./lmspeedtest compare llama3.2:latest
# Shows results from all servers with server column

📊 Metrics Explained

Metric Description
Tokens/sec Generation speed — output tokens per second
Prompt TPS Input processing speed — prompt eval tokens per second
TTFT Time to first token — load + prompt eval duration
ITL Inter-token latency — time between consecutive tokens
Load Time Time to load model weights into GPU/CPU memory
Stability Variance across epochs (stddev, min, max)

⚙️ Configuration

State is stored in ~/.lmspeedtest/:

  • config.json — Server profiles (host URL, auth token, active profile)
  • results.json — Last 3 benchmark results per model per server (capped at 3)
Multi-Server Setup

Manage multiple Ollama/LM Studio servers with named profiles:

# Add servers
./lmspeedtest connect --add desktop --host http://192.168.1.10:11434
./lmspeedtest connect --add laptop --host http://192.168.1.11:11434 --token sk-abc

# List profiles
./lmspeedtest connect --list

# Switch active server
./lmspeedtest connect --use desktop

# Remove a profile
./lmspeedtest connect --remove laptop

Results are stored per-server, so you can benchmark the same model on different hardware and compare.

📋 Requirements

  • Go 1.25.8+
  • Ollama or LM Studio instance (local or remote)

🤝 Contributing

Contributions are welcome! The codebase is organized into logical files:

  • main.go — Entry point and command routing

  • types.go — Structs and data models

  • config.go — Configuration persistence and migration

  • styles.go — Terminal styling helpers

  • commands_connect.go — Server profile management

  • commands_models.go — Model listing and benchmarking

  • benchmark.go — Core benchmark logic

  • commands_other.go — Dashboard, compare, export, serve, reset

  • New subcommand → add case in main() switch

  • New API call → add helper in the relevant command file

  • New TUI form → use huh.NewForm(...) pattern

Please ensure your code passes golangci-lint and gosec.

☕ Support

If you find this tool useful, consider buying me a coffee:

Buy Me A Coffee

📄 License

MIT License — see LICENSE for details.

Made with a fucked-up back and extremely questionable sleep habits by @notfixingit3

Documentation

The Go Gopher

There is no documentation for this package.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.