Directories
¶
| Path | Synopsis |
|---|---|
|
Package cli implements the palan command surface.
|
Package cli implements the palan command surface. |
|
Command fakellama mimics llama-server's CLI and HTTP surface for tests: it accepts (and mostly ignores) llama-server flags, serves /health with a configurable loading delay, and answers OpenAI-style completion requests with deterministic fake content, including SSE streaming.
|
Command fakellama mimics llama-server's CLI and HTTP surface for tests: it accepts (and mostly ignores) llama-server flags, serves /health with a configurable loading delay, and answers OpenAI-style completion requests with deterministic fake content, including SSE streaming. |
|
Package gguf reads GGUF file headers: just enough metadata to fill the ModelPack config at pack time (architecture, quantization, context length...), in ~200 lines instead of a heavyweight dependency (see docs/adr/0004-implementation-language-go.md).
|
Package gguf reads GGUF file headers: just enough metadata to fill the ModelPack config at pack time (architecture, quantization, context length...), in ~200 lines instead of a heavyweight dependency (see docs/adr/0004-implementation-language-go.md). |
|
gguftest
Package gguftest synthesizes valid GGUF byte streams for tests: header parsing, pack determinism, and end-to-end flows all need real-shaped GGUF files without downloading model weights.
|
Package gguftest synthesizes valid GGUF byte streams for tests: header parsing, pack determinism, and end-to-end flows all need real-shaped GGUF files without downloading model weights. |
|
Package hf fetches model files from Hugging Face so they can be packed without a separate download step.
|
Package hf fetches model files from Hugging Face so they can be packed without a separate download step. |
|
Package modelmeta carries the model metadata pack records in an artifact, independently of the weight format it was read from.
|
Package modelmeta carries the model metadata pack records in an artifact, independently of the weight format it was read from. |
|
Package pack builds ModelPack artifacts from GGUF or safetensors weights.
|
Package pack builds ModelPack artifacts from GGUF or safetensors weights. |
|
Package refname normalizes model references.
|
Package refname normalizes model references. |
|
Package router is palan's multi-model serving core (see docs/architecture.md, "Serving layer"): one OpenAI-compatible endpoint that lazily spawns a llama-server per model, unloads idle ones, and evicts least-recently-used instances when the memory budget would overflow, so loading model B on a 10 GB GPU evicts model A instead of OOMing it.
|
Package router is palan's multi-model serving core (see docs/architecture.md, "Serving layer"): one OpenAI-compatible endpoint that lazily spawns a llama-server per model, unloads idle ones, and evicts least-recently-used instances when the memory budget would overflow, so loading model B on a 10 GB GPU evicts model A instead of OOMing it. |
|
Package runtime distributes and supervises inference runtimes.
|
Package runtime distributes and supervises inference runtimes. |
|
Package safetensors reads the metadata a safetensors model publishes: the per-file tensor header, the Hugging Face config.json, and the shard index.
|
Package safetensors reads the metadata a safetensors model publishes: the per-file tensor header, the Hugging Face config.json, and the shard index. |
|
safetensorstest
Package safetensorstest builds minimal .safetensors files for tests.
|
Package safetensorstest builds minimal .safetensors files for tests. |
|
Package signing implements cosign-compatible, key-based signing of model artifacts (see docs/architecture.md, "Security model").
|
Package signing implements cosign-compatible, key-based signing of model artifacts (see docs/architecture.md, "Security model"). |
|
Package store implements palan's local model store.
|
Package store implements palan's local model store. |
|
Package transfer moves model artifacts between OCI registries and the local store.
|
Package transfer moves model artifacts between OCI registries and the local store. |
|
Package ui decides whether terminal output is styled, and how.
|
Package ui decides whether terminal output is styled, and how. |
|
Package version exposes build-time version information stamped via ldflags.
|
Package version exposes build-time version information stamped via ldflags. |
Click to show internal directories.
Click to hide internal directories.