05-custom-sampling

Documentation

Overview

Recipe 05: Custom Sampling Parameters

Demonstrate how temperature, top-K, top-P, and repetition penalty affect text generation. The program generates the same prompt three times with different sampling configurations so you can compare the outputs.

Usage:

go run ./docs/cookbook/05-custom-sampling/ --model path/to/model.gguf