progress

Documentation

Overview

Progress: index a folder of files and print how far the run has got.

IndexOptions.OnProgress is called as indexing advances, with the phase the run is in, how many files that phase has finished, and how many it set out to do. In the indexing phase those two numbers are the files scanned and, of those, the files actually processed — the scan finds every file, and only the ones whose content changed are read, chunked, and embedded.

Needs an OpenAI-compatible embedding server on http://127.0.0.1:1234 (e.g. LM Studio) serving EmbeddingGemma, and a C compiler (the SQLite backend uses cgo).

Run from the repository root:

go run ./examples/progress