bench

Documentation

Overview

Command bench runs a standardized benchmark harness for zerfoo models.

Usage:

bench --model /path/to/model.gguf [--backend cpu] [--tokens 100] [--concurrent 1] [--warmup 3] [--output bench_results.json] [--prompt "Once upon a time"]