README
¶
llm-d-inference-payload-processor
Inference payload processor for llm-d.
Directories
¶
| Path | Synopsis |
|---|---|
|
apix
|
|
|
config/v1alpha1
Package v1alpha1 contains API Schema definitions for the llm-d.ai API group.
|
Package v1alpha1 contains API Schema definitions for the llm-d.ai API group. |
|
internal
|
|
|
pkg
|
|
|
common
Package common defines structs for referring to fully qualified k8s resources.
|
Package common defines structs for referring to fully qualified k8s resources. |
|
framework/plugins/modelselector/picker/random
Package random implements a modelselector picker that selects model uniformly at random, ignoring any scores calculated by scorer plugins.
|
Package random implements a modelselector picker that selects model uniformly at random, ignoring any scores calculated by scorer plugins. |
|
test
|
|
Click to show internal directories.
Click to hide internal directories.