pkg/

Details

Path	Synopsis
apis
networking/v1alpha1 +k8s:openai-gen=true +kubebuilder:object:generate=true +groupName=networking.serving.volcano.sh	+k8s:openai-gen=true +kubebuilder:object:generate=true +groupName=networking.serving.volcano.sh
workload/v1alpha1 +k8s:openai-gen=true +kubebuilder:object:generate=true +groupName=workload.serving.volcano.sh	+k8s:openai-gen=true +kubebuilder:object:generate=true +groupName=workload.serving.volcano.sh
autoscaler
algorithm
controller
datastructure
histogram
util
controller
kthena-router
accesslog
backend
backend/metrics
backend/sglang
backend/vllm
common
connectors
controller
datastore
debug
filters/auth Package auth provides JWT authentication and authorization functionality for the Kthena router.	Package auth provides JWT authentication and authorization functionality for the Kthena router.
filters/ratelimit
filters/tokenizer
handlers Request handler can be used to handle inference request, by reading the model name, and do ratelimt for input tokens.	Request handler can be used to handle inference request, by reading the model name, and do ratelimt for input tokens.
metrics
router
scheduler Model server scheduling	Model server scheduling
scheduler/framework
scheduler/plugins
scheduler/plugins/cache
scheduler/plugins/conf
scheduler/plugins/tokenization
utils
webhook
model-booster-controller
config
controller
convert
env
utils
webhook
model-serving-controller
controller
datastore
plugins
podgroupmanager
utils
utils/test
webhook
webhook
cert