ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
File Explorer
Download Latest Version (.zip)- devcontainer.json
- Dockerfile
- BUG_REPORT.md
- ENHANCEMENT.md
- SUPPORT.md
- benchmark.yaml
- dev-images.yaml
- openvex.yaml
- pages.yml
- pr-labeler.yml
- pr-push-validation.yml
- pr-validation.yml
- release.yaml
- sbom.yaml
- sync-dependabot.yaml
- sync-labels.yml
- CODEOWNERS
- dependabot.yml
- labeler.yml
- labels.yml
- PULL_REQUEST_TEMPLATE.md
- main.openvex.json
- ome.io_acceleratorclasses.yaml
- ome.io_basemodels.yaml
- ome.io_benchmarkjobs.yaml
- ome.io_clusterbasemodels.yaml
- ome.io_clusterservingruntimes.yaml
- ome.io_finetunedweights.yaml
- ome.io_inferencereplicas.yaml
- ome.io_inferenceservices.yaml
- ome.io_servingruntimes.yaml
- ome.io_workloadclusters.yaml
- .helmignore
- Chart.yaml
- README.md
- values.yaml
- clusterrole.yaml
- clusterrolebinding.yaml
- configmap.yaml
- daemonset.yaml
- serviceaccount.yaml
- auth_proxy_role.yaml
- auth_proxy_role_binding.yaml
- leader_election_role.yaml
- leader_election_role_binding.yaml
- metrics_auth_role.yaml
- metrics_auth_role_binding.yaml
- metrics_reader_role.yaml
- role.yaml
- role_binding.yaml
- basemodelvalidator.yaml
- benchmarkjobvalidator.yaml
- controllerrevisionvalidator.yaml
- inferencereplicavalidator.yaml
- isvcmutator.yaml
- isvcvalidator.yaml
- runtimevalidator.yaml
- certificate.yaml
- configmap.yaml
- deployment.yaml
- metadata-job-rbac.yaml
- service.yaml
- service_account.yaml
- _helpers.tpl
- .helmignore
- Chart.yaml
- README.md
- values.yaml
- _helpers.tpl
- basemodel.yaml
- clusterbasemodel.yaml
- clusterservingruntime.yaml
- inferenceservice.yaml
- .helmignore
- Chart.yaml
- README.md
- values.yaml
- main.go
- main_test.go
- main.go
- main_test.go
- main.go
- main.go
- main_test.go
- multicluster.go
- multicluster_test.go
- main.go
- main_test.go
- agent.go
- agent_test.go
- config.go
- enigma_agent.go
- fine_tuned_adapter.go
- hf_download_agent.go
- k8sclient.go
- main.go
- model_metadata_agent.go
- model_metadata_agent_test.go
- README.md
- replica_agent.go
- replica_agent_test.go
- serving_agent.go
- main.go
- clusterrole.yaml
- clusterrolebinding.yaml
- configmap.yaml
- deployment.yaml
- kustomization.yaml
- role.yaml
- rolebinding.yaml
- service.yaml
- serviceaccount.yaml
- certificate.yaml
- kustomization.yaml
- kustomization.yaml
- benchmarkjob.yaml
- inferenceservice.yaml
- kustomization.yaml
- kustomization.yaml
- ome.io_acceleratorclasses.yaml
- ome.io_basemodels.yaml
- ome.io_benchmarkjobs.yaml
- ome.io_clusterbasemodels.yaml
- ome.io_clusterservingruntimes.yaml
- ome.io_finetunedweights.yaml
- ome.io_inferencereplicas.yaml
- ome.io_inferenceservices.yaml
- ome.io_servingruntimes.yaml
- ome.io_workloadclusters.yaml
- kustomization.yaml
- ome.io_acceleratorclasses.yaml
- ome.io_basemodels.yaml
- ome.io_benchmarkjobs.yaml
- ome.io_clusterbasemodels.yaml
- ome.io_clusterservingruntimes.yaml
- ome.io_finetunedweights.yaml
- ome.io_inferencereplicas.yaml
- ome.io_inferenceservices.yaml
- ome.io_servingruntimes.yaml
- ome.io_workloadclusters.yaml
- kustomization.yaml
- basemodel_validatingwebhook_cainjection_patch.yaml
- benchmarkjob_validationwebhook_cainjection_patch.yaml
- cainjection_conversion_webhook.yaml
- clusterbasemodel_validatingwebhook_cainjection_patch.yaml
- clusterservingruntime_validatingwebhook_cainjection_patch.yaml
- controllerrevision_validatingwebhook_cainjection_patch.yaml
- isvc_conversion_webhook.yaml
- isvc_mutatingwebhook_cainjection_patch.yaml
- isvc_validatingwebhook_cainjection_patch.yaml
- kustomization.yaml
- manager_auth_proxy_patch.yaml
- manager_image_patch.yaml
- manager_prometheus_metrics_patch.yaml
- manager_resources_patch.yaml
- model_agent_image_patch.yaml
- servingruntime_validationwebhook_cainjection_patch.yaml
- kustomization.yaml
- manager.yaml
- service.yaml
- clusterrole.yaml
- clusterrolebinding.yaml
- configmap.yaml
- daemonset.yaml
- kustomization.yaml
- serviceaccount.yaml
- persimmon-8b-chat.yaml
- gme-Qwen2-VL-2B-Instruct.yaml
- gte-Qwen2-7B-instruct.yaml
- OLMo-2-1124-7B-Instruct.yaml
- OLMoE-1B-7B-0924.yaml
- AFM-4.5B-Base.yaml
- bge-large-en-v1.5.yaml
- bge-m3.yaml
- bge-reranker-v2-m3.yaml
- Baichuan2-13B-Chat.yaml
- Baichuan2-7B-Chat.yaml
- ERNIE-4.5-21B-A3B-PT.yaml
- starcoder2-15b.yaml
- starcoder2-3b.yaml
- starcoder2-7b.yaml
- bloomz-7b1.yaml
- Tele-FLM.yaml
- c4ai-command-r-v01.yaml
- dbrx-instruct.yaml
- dolly-v2-12b.yaml
- deepseek-coder-7b-instruct-v1.5.yaml
- deepseek-llm-7b-chat.yaml
- DeepSeek-R1-Distill-Llama-70B.yaml
- DeepSeek-R1-Distill-Llama-8B.yaml
- DeepSeek-R1-Distill-Qwen-1.5B.yaml
- DeepSeek-R1-Distill-Qwen-14B.yaml
- DeepSeek-R1-Distill-Qwen-32B.yaml
- DeepSeek-R1-Distill-Qwen-7B.yaml
- DeepSeek-R1-Zero.yaml
- DeepSeek-R1.yaml
- deepseek-v2-lite-chat.yaml
- DeepSeek-V2.5.yaml
- DeepSeek-V2.yaml
- DeepSeek-V3-0324.yaml
- DeepSeek-V3.yaml
- DeepSeek-V4-Flash.yaml
- DeepSeek-V4-Pro.yaml
- deepseek-vl2.yaml
- Janus-Pro-7B.yaml
- NVILA-8B.yaml
- gpt-j-6b.yaml
- gemma-2-27b-it.yaml
- gemma-2-27b.yaml
- gemma-2-2b-it.yaml
- gemma-2-2b.yaml
- gemma-2-9b-it.yaml
- gemma-2-9b.yaml
- gemma-2b.yaml
- gemma-3-12b-it.yaml
- gemma-3-1b-it.yaml
- gemma-3-27b-it.yaml
- gemma-3-4b-it.yaml
- gemma-7b.yaml
- SmolLM-1.7B.yaml
- SmolLM-135M.yaml
- SmolLM-360M.yaml
- SmolLM2-1.7B-Instruct.yaml
- granite-3.0-2b-instruct.yaml
- granite-3.0-3b-a800m-instruct.yaml
- granite-3.0-8b-instruct.yaml
- granite-3.1-2b-instruct.yaml
- granite-3.1-8b-instruct.yaml
- Ling-lite.yaml
- Ling-plus.yaml
- internlm2-20b.yaml
- internlm2-7b-reward.yaml
- internlm2-7b.yaml
- e5-mistral-7b-instruct.yaml
- Qwen2.5-1.5B-apeach.yaml
- Jet-Nemotron-2B.yaml
- EXAONE-3.5-7.8B-Instruct.yaml
- llava-v1.5-13b.yaml
- llava-v1.5-7b.yaml
- llava-v1.6-vicuna-13b.yaml
- llava-v1.6-vicuna-7b.yaml
- llava-next-72b.yaml
- llava-next-8b.yaml
- llava-onevision-qwen2-7b-ov.yaml
- vicuna-13b-v1-5.yaml
- vicuna-7b-v1-5.yaml
- Llama-2-13b-chat-hf.yaml
- Llama-2-13b-hf.yaml
- Llama-2-70b-chat-hf.yaml
- Llama-2-70b-hf.yaml
- Llama-2-7b-chat-hf.yaml
- Llama-2-7b-hf.yaml
- Llama-3-70B-Instruct.yaml
- Llama-3.1-405B-Instruct-FP8.yaml
- Llama-3.1-70B-Instruct.yaml
- Llama-3.1-8B-Instruct.yaml
- Llama-3.2-11B-Vision-Instruct.yaml
- Llama-3.2-1B-Instruct.yaml
- Llama-3.2-3B-Instruct.yaml
- Llama-3.2-90B-Vision-Instruct-FP8.yaml
- Llama-3.2-90B-Vision-Instruct.yaml
- Llama-3.3-70B-Instruct-FP8-dynamic.yaml
- Llama-3.3-70B-instruct.yaml
- Llama-4-Maverick-17B-128E-Instruct-FP8.yaml
- Llama-4-Maverick-17B-128E-Instruct.yaml
- Llama-4-Scout-17B-16E-Instruct.yaml
- Llama-Guard-3-8B.yaml
- Meta-Llama-3-8B-Instruct.yaml
- phi-1_5.yaml
- phi-2.yaml
- Phi-3-medium-4k-instruct.yaml
- Phi-3-mini-128k-instruct.yaml
- Phi-3-mini-4k-instruct.yaml
- Phi-3-small-8k-instruct.yaml
- Phi-3-vision-128k-instruct.yaml
- Phi-3.5-mini-instruct.yaml
- Phi-3.5-MoE-instruct.yaml
- Phi-4-mini-instruct.yaml
- Phi-4-multimodal-instruct.yaml
- phi-4.yaml
- MiniMax-M2.yaml
- Mistral-7B-Instruct-v0.2.yaml
- Mistral-7B-Instruct-v0.3.yaml
- Mistral-7B-v0.1.yaml
- Mistral-Nemo-Instruct-2407.yaml
- Mistral-Small-3.1-24B-Instruct-2503.yaml
- Mixtral-8x22B-v0.1.yaml
- Mixtral-8x7B-Instruct-v0.1.yaml
- Mixtral-8x7B-v0.1.yaml
- Kimi-K2-Instruct.yaml
- Kimi-VL-A3B-Instruct.yaml
- mpt-7b.yaml
- hermes-2-pro-llama-3-8b.yaml
- Llama-3.1-Nemotron-70B-Instruct-HF.yaml
- Llama-3.1-Nemotron-Nano-8B-v1.yaml
- Llama-3_1-Nemotron-Ultra-253B-v1.yaml
- Llama-3_3-Nemotron-Super-49B-v1.yaml
- NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16.yaml
- NVIDIA-Nemotron-3-Nano-30B-A3B-BF16.yaml
- NVIDIA-Nemotron-3-Nano-30B-A3B-FP8.yaml
- NVIDIA-Nemotron-Nano-12B-v2-VL-BF16.yaml
- NVIDIA-Nemotron-Nano-12B-v2-VL-FP8.yaml
- NVIDIA-Nemotron-Nano-9B-v2.yaml
- clip-vit-large-patch14-336.yaml
- gpt-oss-120b.yaml
- gpt-oss-20b.yaml
- MiniCPM-2B-sft-bf16.yaml
- MiniCPM-V-2_6.yaml
- MiniCPM3-4B.yaml
- InternVL2_5-8B.yaml
- Orion-14B-Base.yaml
- Qwen-7B-Chat.yaml
- Qwen-Image-Edit-Plus.yaml
- Qwen-Image-Edit.yaml
- Qwen-Image.yaml
- Qwen-VL-Chat.yaml
- Qwen-VL.yaml
- Qwen1.5-110B-Chat.yaml
- Qwen1.5-32B-Chat.yaml
- Qwen1.5-72B-Chat.yaml
- Qwen1.5-7B-Chat.yaml
- Qwen2-72B-Instruct.yaml
- Qwen2-7B-Instruct.yaml
- Qwen2-VL-2B-Instruct.yaml
- Qwen2-VL-72B-Instruct.yaml
- Qwen2-VL-7B-Instruct.yaml
- Qwen2.5-0.5B.yaml
- Qwen2.5-1.5B.yaml
- Qwen2.5-14B-Instruct.yaml
- Qwen2.5-14B.yaml
- Qwen2.5-32B-Instruct.yaml
- Qwen2.5-32B.yaml
- Qwen2.5-3B-Instruct.yaml
- Qwen2.5-3B.yaml
- Qwen2.5-72B-Instruct.yaml
- Qwen2.5-72B.yaml
- Qwen2.5-7B.yaml
- Qwen2.5-Coder-32B-Instruct.yaml
- Qwen2.5-Coder-7B-Instruct.yaml
- Qwen2.5-Math-RM-72B.yaml
- Qwen2.5-VL-7B-Instruct.yaml
- Qwen3-0.6B.yaml
- Qwen3-1.7B.yaml
- Qwen3-14B.yaml
- Qwen3-30B-A3B.yaml
- Qwen3-32B.yaml
- Qwen3-4B.yaml
- Qwen3-8B.yaml
- Qwen3-Embedding-0.6B.yaml
- Qwen3-Embedding-4B.yaml
- Qwen3-Embedding-8B.yaml
- Qwen3-Next-80B-A3B-Instruct.yaml
- Qwen3-VL-235B-A22B-Instruct.yaml
- dots.ocr.yaml
- dots.vlm1.inst.yaml
- xgen-7b-8k-inst.yaml
- Skywork-OR1-7B-Preview.yaml
- Skywork-Reward-Gemma-2-27B-v0.2.yaml
- Skywork-Reward-Llama-3.1-8B-v0.2.yaml
- stablelm-2-12b-chat.yaml
- stablelm-tuned-alpha-7b.yaml
- chatglm2-6b.yaml
- falcon-7b-instruct.yaml
- Falcon3-10B-Instruct.yaml
- Llama-3.2-11B-Vision-Instruct.yaml
- SOLAR-10.7B-Instruct-v1.0.yaml
- grok-1.yaml
- grok-2.yaml
- MiMo-7B-RL.yaml
- MiMo-VL-7B-RL.yaml
- XVERSE-MoE-A36B.yaml
- GLM-4.5V.yaml
- glm-4-9b-chat.yaml
- kustomization.yaml
- SUPPORTED_MODELS.md
- model-metadata.yaml
- ome-agent.yaml
- auth_proxy_role.yaml
- auth_proxy_role_binding.yaml
- auth_proxy_service.yaml
- kustomization.yaml
- leader_election_role.yaml
- leader_election_role_binding.yaml
- metrics_auth_role.yaml
- metrics_auth_role_binding.yaml
- metrics_reader_role.yaml
- role.yaml
- role_binding.yaml
- service_account.yaml
- persimmon-8b-chat-rt.yaml
- gme-qwen2-vl-2b-instruct-rt.yaml
- gte-qwen2-7b-instruct-rt.yaml
- olmo-2-1124-7b-instruct-rt.yaml
- olmoe-1b-7b-0924-rt.yaml
- afm-4-5b-base-rt.yaml
- bge-large-en-v1-5-rt.yaml
- bge-m3-rt.yaml
- bge-reranker-v2-m3-rt.yaml
- baichuan2-13b-chat-rt.yaml
- baichuan2-7b-chat-rt.yaml
- ernie-4-5-21b-a3b-pt-rt.yaml
- starcoder2-15b-rt.yaml
- starcoder2-7b-rt.yaml
- bloomz-7b1-rt.yaml
- tele-flm-rt.yaml
- c4ai-command-r-v01-rt.yaml
- dbrx-instruct-rt.yaml
- dolly-v2-12b-rt.yaml
- deepseek-coder-7b-instruct-v1-5-rt.yaml
- deepseek-llm-7b-chat-rt.yaml
- deepseek-r1-distill-llama-70b-rt.yaml
- deepseek-r1-distill-llama-8b-rt.yaml
- deepseek-r1-distill-qwen-1-5b-rt.yaml
- deepseek-r1-distill-qwen-14b-rt.yaml
- deepseek-r1-distill-qwen-32b-rt.yaml
- deepseek-r1-distill-qwen-7b-rt.yaml
- deepseek-v2-lite-chat-rt.yaml
- deepseek-v3-0324-rt.yaml
- deepseek-v3-rt.yaml
- deepseek-vl2-rt.yaml
- janus-pro-7b-rt.yaml
- nvila-8b-rt.yaml
- gpt-j-6b-rt.yaml
- gemma-2-27b-it-rt.yaml
- gemma-2-2b-it-rt.yaml
- gemma-2-9b-it-rt.yaml
- gemma-3-12b-it-rt.yaml
- gemma-3-1b-it-rt.yaml
- gemma-3-4b-it-rt.yaml
- smollm-1-7b-rt.yaml
- smollm2-1-7b-instruct-rt.yaml
- granite-3-0-3b-a800m-instruct-rt.yaml
- granite-3-1-8b-instruct-rt.yaml
- ling-lite-rt.yaml
- ling-plus-rt.yaml
- internlm2-20b-rt.yaml
- internlm2-7b-reward-rt.yaml
- internlm2-7b-rt.yaml
- e5-mistral-7b-instruct-rt.yaml
- jet-nemotron-2b-rt.yaml
- exaone-3-5-7-8b-instruct-rt.yaml
- llava-v1-5-13b-rt.yaml
- llava-next-72b-rt.yaml
- llava-onevision-qwen2-7b-ov-rt.yaml
- gpt-oss-120b-bf16-rt.yaml
- gpt-oss-20b-bf16-rt.yaml
- vicuna-13b-v1-5-rt.yaml
- vicuna-7b-v1-5-rt.yaml
- llama-2-13b-chat-hf-rt.yaml
- llama-2-13b-rt.yaml
- llama-2-70b-chat-hf-rt.yaml
- llama-2-70b-rt.yaml
- llama-2-7b-chat-hf-rt.yaml
- llama-2-7b-rt.yaml
- llama-3-1-405b-instruct-fp8-rt.yaml
- llama-3-1-70b-instruct-pd-rt.yaml
- llama-3-1-70b-instruct-rt.yaml
- llama-3-1-8b-instruct-grpc-rt.yaml
- llama-3-1-8b-instruct-rt.yaml
- llama-3-2-11b-vision-instruct-rt.yaml
- llama-3-2-1b-instruct-pd-rt.yaml
- llama-3-2-1b-instruct-rt.yaml
- llama-3-2-3b-instruct-pd-rt.yaml
- llama-3-2-3b-instruct-rt.yaml
- llama-3-2-90b-vision-instruct-fp8-rt.yaml
- llama-3-2-90b-vision-instruct-rt.yaml
- llama-3-3-70b-instruct-fp8-dynamic-rt.yaml
- llama-3-3-70b-instruct-pd-rt.yaml
- llama-3-3-70b-instruct-rt.yaml
- llama-3-70b-instruct-rt.yaml
- llama-3-8b-instruct-rt.yaml
- llama-4-maverick-17b-128e-instruct-fp8-grpc-rt.yaml
- llama-4-maverick-17b-128e-instruct-fp8-pd-grpc-rt.yaml
- llama-4-maverick-17b-128e-instruct-fp8-pd-rt.yaml
- llama-4-maverick-17b-128e-instruct-fp8-rt.yaml
- llama-4-maverick-17b-128e-instruct-rt.yaml
- llama-4-scout-17b-16e-instruct-pd-rt.yaml
- llama-4-scout-17b-16e-instruct-rt.yaml
- llama-guard-3-8b-rt.yaml
- phi-2-rt.yaml
- phi-3-5-mini-instruct-rt.yaml
- phi-3-5-moe-instruct-rt.yaml
- phi-3-mini-4k-instruct-rt.yaml
- phi-3-vision-128k-instruct-rt.yaml
- phi-4-mini-instruct-rt.yaml
- phi-4-multimodal-instruct-rt.yaml
- phi-4-rt.yaml
- minimax-m2-rt.yaml
- mistral-7b-instruct-v0-2-rt.yaml
- mistral-7b-instruct-v0-3-rt.yaml
- mistral-nemo-instruct-2407-rt.yaml
- mistral-small-3-1-24b-instruct-2503-rt.yaml
- mixtral-8x22b-v0-1-rt.yaml
- mixtral-8x7b-instruct-v0-1-rt.yaml
- mixtral-8x7b-v0-1-rt.yaml
- kimi-k2-instruct-rt.yaml
- kimi-vl-a3b-instruct-rt.yaml
- mpt-7b-rt.yaml
- hermes-2-pro-llama-3-8b-rt.yaml
- llama-3-1-nemotron-70b-instruct-hf-rt.yaml
- llama-3-1-nemotron-nano-8b-v1-rt.yaml
- llama-3-1-nemotron-ultra-253b-v1-rt.yaml
- llama-3-3-nemotron-super-49b-v1-rt.yaml
- nvidia-nemotron-3-nano-30b-a3b-base-bf16-rt.yaml
- nvidia-nemotron-3-nano-30b-a3b-bf16-rt.yaml
- nvidia-nemotron-3-nano-30b-a3b-fp8-rt.yaml
- nvidia-nemotron-nano-12b-v2-vl-bf16-rt.yaml
- nvidia-nemotron-nano-12b-v2-vl-fp8-rt.yaml
- nvidia-nemotron-nano-9b-v2-rt.yaml
- clip-vit-large-patch14-336-rt.yaml
- gpt-oss-120b-rt.yaml
- gpt-oss-20b-rt.yaml
- minicpm-2b-sft-bf16-rt.yaml
- minicpm-v-2-6-rt.yaml
- minicpm3-4b-rt.yaml
- InternVL2_5-8B-rt.yaml
- orion-14b-base-rt.yaml
- Qwen-7B-Chat-rt.yaml
- Qwen-Image-Edit-rt.yaml
- Qwen-Image-rt.yaml
- Qwen1.5-110B-Chat-rt.yaml
- Qwen1.5-32B-Chat-rt.yaml
- Qwen1.5-72B-Chat-rt.yaml
- Qwen1.5-7B-Chat-rt.yaml
- qwen2-5-1-5b-rt.yaml
- qwen2-5-14b-instruct-rt.yaml
- qwen2-5-14b-rt.yaml
- qwen2-5-32b-instruct-rt.yaml
- qwen2-5-3b-instruct-rt.yaml
- qwen2-5-3b-rt.yaml
- qwen2-5-7b-rt.yaml
- qwen2-5-coder-7b-instruct-rt.yaml
- Qwen2-72B-Instruct-rt.yaml
- Qwen2-7B-Instruct-rt.yaml
- Qwen2-VL-7B-Instruct-rt.yaml
- Qwen2.5-32B-Instruct-rt.yaml
- Qwen2.5-72B-Instruct-rt.yaml
- Qwen2.5-Coder-32B-Instruct-rt.yaml
- Qwen2.5-VL-7B-Instruct-rt.yaml
- qwen3-0-6b-rt.yaml
- qwen3-30b-a3b-rt.yaml
- Qwen3-32B-rt.yaml
- qwen3-4b-rt.yaml
- qwen3-8b-rt.yaml
- qwen3-embedding-0-6b-rt.yaml
- Qwen3-Embedding-0.6B-rt.yaml
- qwen3-embedding-4b-rt.yaml
- qwen3-next-80b-a3b-instruct-rt.yaml
- qwen3-vl-235b-a22b-instruct-rt.yaml
- dots-ocr-rt.yaml
- dots-vlm1-inst-rt.yaml
- xgen-7b-8k-inst-rt.yaml
- skywork-or1-7b-preview-rt.yaml
- stablelm-2-12b-chat-rt.yaml
- stablelm-tuned-alpha-7b-rt.yaml
- inkling-small-nvfp4-rt.yaml
- chatglm2-6b-rt.yaml
- falcon-7b-instruct-rt.yaml
- falcon3-10b-instruct-rt.yaml
- llama-3-2-11b-vision-instruct-rt.yaml
- solar-10-7b-instruct-v1-0-rt.yaml
- grok-1-rt.yaml
- grok-2-rt.yaml
- mimo-7b-rl-rt.yaml
- mimo-vl-7b-rl-rt.yaml
- xverse-moe-a36b-rt.yaml
- glm-4-5v-rt.yaml
- glm-4-9b-chat-rt.yaml
- deepseek-rdma-pd-rt.yaml
- deepseek-rdma-rt.yaml
- e5-mistral-7b-instruct-rt.yaml
- gpt-oss-120b-rt.yaml
- gpt-oss-20b-rt.yaml
- kimi-k2-pd-rt.yaml
- mistral-7b-instruct-pd-rt.yaml
- mistral-7b-instruct-rt.yaml
- mixtral-8x7b-instruct-pd-rt.yaml
- mixtral-8x7b-instruct-rt.yaml
- inkling-nvfp4-rt.yaml
- deepseek-v4-flash-rt.yaml
- deepseek-v4-pro-rt.yaml
- kimi-k3-rt.yaml
- e5-mistral-7b-instruct-rt.yaml
- llama-3-1-405b-instruct-fp8-rt.yaml
- llama-3-1-8b-instruct-rt.yaml
- llama-3-1-nemotron-nano-8b-v1-rt.yaml
- llama-3-1-nemotron-ultra-253b-v1-rt.yaml
- llama-3-2-11b-vision-instruct-rt.yaml
- llama-3-2-1b-instruct-rt.yaml
- llama-3-2-3b-instruct-rt.yaml
- llama-3-2-90b-vision-instruct-fp8-dynamic-rt.yaml
- llama-3-2-90b-vision-instruct-rt.yaml
- llama-3-3-70b-instruct-fp8-dynamic-rt.yaml
- llama-3-3-70b-instruct-rt.yaml
- llama-3-3-nemotron-super-49b-v1-rt.yaml
- llama-4-maverick-17b-128e-instruct-fp8-rt.yaml
- llama-4-scout-17b-16e-instruct-rt.yaml
- mistral-7b-instruct-rt.yaml
- mixtral-8x7b-instruct-rt.yaml
- kustomization.yaml
- deepseek-r1-rdma.yaml
- e5-mistral-7b-instruct.yaml
- huggingface-secret.yaml
- llama3-1-70b-instruct.yaml
- persimmon-8b-chat.yaml
- gme-qwen2-vl-2b-instruct.yaml
- gte-qwen2-7b-instruct.yaml
- olmo-2-1124-7b-instruct.yaml
- olmoe-1b-7b-0924.yaml
- afm-4-5b-base.yaml
- bge-large-en-v1-5.yaml
- bge-m3.yaml
- bge-reranker-v2-m3.yaml
- baichuan2-13b-chat.yaml
- baichuan2-7b-chat.yaml
- starcoder2-15b.yaml
- starcoder2-7b.yaml
- bloomz-7b1.yaml
- c4ai-command-r-v01.yaml
- dolly-v2-12b.yaml
- deepseek-coder-7b-instruct-v1-5.yaml
- deepseek-llm-7b-chat.yaml
- deepseek-r1-distill-llama-70b.yaml
- deepseek-r1-distill-llama-8b.yaml
- deepseek-r1-distill-qwen-1-5b.yaml
- deepseek-r1-distill-qwen-14b.yaml
- deepseek-r1-distill-qwen-32b.yaml
- deepseek-r1-distill-qwen-7b.yaml
- deepseek-r1.yaml
- deepseek-v2-lite-chat.yaml
- deepseek-v3-pd.yaml
- deepseek-v3.yaml
- deepseek-v4-flash.yaml
- deepseek-vl2.yaml
- janus-pro-7b.yaml
- nvila-8b.yaml
- gpt-j-6b.yaml
- gemma-2-27b-it.yaml
- gemma-2-2b-it.yaml
- gemma-2-9b-it.yaml
- gemma-3-12b-it.yaml
- gemma-3-1b-it.yaml
- gemma-3-4b-it.yaml
- smollm-1-7b.yaml
- smollm2-1-7b-instruct.yaml
- granite-3-0-3b-a800m-instruct.yaml
- granite-3-1-8b-instruct.yaml
- internlm2-20b.yaml
- internlm2-7b-reward.yaml
- internlm2-7b.yaml
- e5-mistral-7b-instruct.yaml
- jet-nemotron-2b.yaml
- exaone-3-5-7-8b-instruct-isvc.yaml
- exaone-3-5-7-8b-instruct.yaml
- vicuna-13b-v1-5.yaml
- vicuna-7b-v1-5.yaml
- llama-2-13b-chat-hf.yaml
- llama-2-13b.yaml
- llama-2-70b-chat-hf.yaml
- llama-2-70b.yaml
- llama-2-7b-chat-hf.yaml
- llama-2-7b.yaml
- llama-3-1-70b-instruct.yaml
- llama-3-1-8b-instruct.yaml
- llama-3-2-1b-instruct.yaml
- llama-3-2-3b-instruct.yaml
- llama-3-70b-instruct.yaml
- llama-3-8b-instruct.yaml
- llama-4-maverick-17b-128e-instruct-fp8.yaml
- llama-4-maverick-17b-128e-instruct.yaml
- llama-4-scout-17b-16e-instruct.yaml
- llama-guard-3-8b.yaml
- llama3-1-405b-instruct-fp8.yaml
- llama3-1-70b-instruct.yaml
- llama3-1-8b-instruct.yaml
- llama3-2-11b-vision.yaml
- llama3-2-1b-instruct.yaml
- llama3-2-90b-vision-fp8-dynamic.yaml
- llama3-3-70b-instruct.yaml
- phi-2.yaml
- phi-3-5-mini-instruct.yaml
- phi-3-5-moe-instruct.yaml
- phi-3-mini-4k-instruct.yaml
- phi-4-mini-instruct.yaml
- phi-4-multimodal-instruct.yaml
- phi-4.yaml
- mistral-7b-instruct-v0-2.yaml
- mistral-7b-instruct-v0-3.yaml
- mistral-nemo-instruct-2407.yaml
- mistral-small-3-1-24b-instruct-2503.yaml
- mixtral-8x22b-v0-1.yaml
- mixtral-8x7b-instruct-v0-1.yaml
- mixtral-8x7b-v0-1.yaml
- kimi-k2-pd.yaml
- mpt-7b.yaml
- hermes-2-pro-llama-3-8b.yaml
- llama-3-1-nemotron-70b-instruct-hf.yaml
- llama-3-1-nemotron-nano-8b-v1.yaml
- llama-3-3-nemotron-super-49b-v1.yaml
- nvidia-nemotron-3-nano-30b-a3b-base-bf16.yaml
- nvidia-nemotron-3-nano-30b-a3b-bf16.yaml
- nvidia-nemotron-3-nano-30b-a3b-fp8.yaml
- nvidia-nemotron-nano-12b-v2-vl-fp8.yaml
- nvidia-nemotron-nano-9b-v2.yaml
- gpt-oss-20b.yaml
- minicpm-2b-sft-bf16.yaml
- minicpm3-4b.yaml
- InternVL2_5-8B.yaml
- orion-14b-base.yaml
- Qwen-7B-Chat.yaml
- Qwen-Image.yaml
- Qwen1.5-110B-Chat.yaml
- Qwen1.5-32B-Chat.yaml
- Qwen1.5-72B-Chat.yaml
- Qwen1.5-7B-Chat.yaml
- qwen2-5-1-5b.yaml
- qwen2-5-14b-instruct.yaml
- qwen2-5-14b.yaml
- qwen2-5-32b-instruct.yaml
- qwen2-5-3b-instruct.yaml
- qwen2-5-3b.yaml
- qwen2-5-7b.yaml
- qwen2-5-coder-7b-instruct.yaml
- Qwen2-72B-Instruct.yaml
- Qwen2-7B-Instruct.yaml
- Qwen2-VL-7B-Instruct.yaml
- Qwen2.5-32B-Instruct.yaml
- Qwen2.5-72B-Instruct.yaml
- Qwen2.5-Coder-32B-Instruct.yaml
- Qwen2.5-VL-7B-Instruct.yaml
- qwen3-0-6b.yaml
- qwen3-30b-a3b.yaml
- Qwen3-32B.yaml
- qwen3-4b.yaml
- qwen3-8b.yaml
- qwen3-embedding-0-6b.yaml
- Qwen3-Embedding-0.6B.yaml
- qwen3-embedding-4b.yaml
- qwen3-next-80b-a3b-instruct.yaml
- xgen-7b-8k-inst.yaml
- skywork-or1-7b-preview.yaml
- stablelm-2-12b-chat.yaml
- stablelm-tuned-alpha-7b.yaml
- chatglm2-6b.yaml
- falcon-7b-instruct.yaml
- falcon3-10b-instruct.yaml
- llama3-2-11b-vision.yaml
- solar-10-7b-instruct-v1-0.yaml
- grok-2.yaml
- mimo-7b-rl.yaml
- glm-4-5v.yaml
- glm-4-9b-chat.yaml
- 00-clusterbasemodel.yaml
- 10-clusterservingruntime.yaml
- 20-inferenceservice.yaml
- 30-inferenceservice-gang.yaml
- README.md
- kustomization.yaml
- manifests.yaml
- service.yaml
- trainingmutator.yaml
- trainingvalidator.yaml
- alfred.Dockerfile
- manager.Dockerfile
- model-agent.Dockerfile
- ome-agent.Dockerfile
- members.tpl
- pkg.tpl
- type.tpl
- config.yaml
- go.mod
- go.sum
- tools.go
- go.mod
- go.sum
- tools.go
- ome.yaml
- client-gen.sh
- README.md
- swagger_config.json
- .golint_failures
- boilerplate.go.txt
- current_violation_exceptions.list
- kustomize-runtime-to-helm.sh
- minimal-crdgen.sh
- model-download.yaml
- patch_image_dev.sh
- self-signed-ca.sh
- telepresence-setup.sh
- test-model-metadata-agent.sh
- update-codegen.sh
- update-openapigen.sh
- verify-codegen.sh
- violation_exceptions.list
- config.go
- config_test.go
- enigma.go
- enigma_test.go
- module.go
- module_test.go
- config.go
- fine_tuned_adapter.go
- module.go
- config.go
- metadata.go
- metadata_test.go
- module.go
- replication_object.go
- replication_object_test.go
- utils.go
- utils_test.go
- helper.go
- helper_test.go
- helper_timeout_test.go
- hf_to_oci.go
- hf_to_oci_test.go
- hf_to_pvc.go
- hf_to_pvc_test.go
- oci_to_oci.go
- oci_to_oci_test.go
- oci_to_pvc.go
- oci_to_pvc_test.go
- pvc_to_oci.go
- pvc_to_oci_test.go
- pvc_to_pvc.go
- pvc_to_pvc_test.go
- replicator.go
- test_mocks.go
- config.go
- config_test.go
- factory.go
- factory_test.go
- module.go
- module_test.go
- replica.go
- replica_test.go
- config.go
- config_test.go
- module.go
- module_test.go
- serving_agent.go
- serving_agent_test.go
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- oep.yaml
- README.md
- errors.go
- fetcher.go
- fetcher_test.go
- policy_helpers.go
- policy_helpers_test.go
- README.md
- selector.go
- selector_test.go
- types.go
- basepath.go
- fs.go
- glob.go
- mem.go
- mem_test.go
- module.go
- os.go
- os_test.go
- config.go
- config_test.go
- store.go
- watcher.go
- watcher_test.go
- arbiter.go
- arbiter_test.go
- earlytick.go
- loop.go
- loop_test.go
- omenative.go
- reporter.go
- reporter_test.go
- state.go
- metrics.go
- metrics_test.go
- loop.go
- loop_test.go
- placement.go
- policy.go
- policy_test.go
- repack.go
- scoring.go
- scoring_test.go
- simulate.go
- api.go
- builder.go
- builder_test.go
- gpu.go
- gpu_test.go
- models.go
- pools.go
- pools_test.go
- pvc.go
- pvc_test.go
- types.go
- builder.go
- builder_test.go
- accelerator_class.go
- autoscaler.go
- autoscaler_status.go
- benchmark_job.go
- canary_status_types.go
- component.go
- coordination_types.go
- doc.go
- inference_service.go
- inference_service_conversion.go
- inference_service_status.go
- inference_service_status_test.go
- inferencereplica_types.go
- inferencereplica_types_test.go
- kedaconfig.go
- lifecycle_types.go
- lifecycle_types_test.go
- model.go
- placement_types.go
- podspec.go
- rollout_types.go
- rollout_types_test.go
- servingruntime_types.go
- servingruntime_types_test.go
- traffic_status_types.go
- traffic_types.go
- traffic_types_test.go
- v1beta1.go
- workloadcluster_types.go
- workloadcluster_types_test.go
- zz_generated.deepcopy.go
- zz_generated.defaults.go
- apis.go
- apierror.go
- apierror_test.go
- isvc_list.golden
- models_merged.golden
- columns_test.go
- get.go
- get_test.go
- registry.go
- registry_test.go
- logs.go
- logs_test.go
- multiplex.go
- multiplex_test.go
- explain.go
- explain_test.go
- runtime.go
- status_notready.golden
- status_unlabeled.golden
- gather.go
- gather_test.go
- render.go
- render_test.go
- status.go
- status_test.go
- version.go
- version_test.go
- factory.go
- factory_test.go
- static.go
- paging.go
- paging_test.go
- printers.go
- printers_test.go
- root.go
- clientset_generated.go
- doc.go
- register.go
- doc.go
- register.go
- doc.go
- fake_acceleratorclass.go
- fake_basemodel.go
- fake_benchmarkjob.go
- fake_clusterbasemodel.go
- fake_clusterservingruntime.go
- fake_finetunedweight.go
- fake_inferencereplica.go
- fake_inferenceservice.go
- fake_ome_client.go
- fake_servingruntime.go
- fake_workloadcluster.go
- acceleratorclass.go
- basemodel.go
- benchmarkjob.go
- clusterbasemodel.go
- clusterservingruntime.go
- doc.go
- finetunedweight.go
- generated_expansion.go
- inferencereplica.go
- inferenceservice.go
- ome_client.go
- servingruntime.go
- workloadcluster.go
- clientset.go
- factory_interfaces.go
- acceleratorclass.go
- basemodel.go
- benchmarkjob.go
- clusterbasemodel.go
- clusterservingruntime.go
- finetunedweight.go
- inferencereplica.go
- inferenceservice.go
- interface.go
- servingruntime.go
- workloadcluster.go
- interface.go
- factory.go
- generic.go
- acceleratorclass.go
- basemodel.go
- benchmarkjob.go
- clusterbasemodel.go
- clusterservingruntime.go
- expansion_generated.go
- finetunedweight.go
- inferencereplica.go
- inferenceservice.go
- servingruntime.go
- workloadcluster.go
- configutils.go
- configutils_test.go
- fx.go
- constants.go
- constants_test.go
- pvc.go
- traffic_annotations.go
- traffic_annotations_test.go
- controller.go
- controller_test.go
- deletion.go
- reconcile.go
- status.go
- status_test.go
- watches.go
- watches_test.go
- backend.go
- metadata_job.go
- metadata_rbac.go
- pvc.go
- watches.go
- shared.go
- backend.go
- controller.go
- controller_test.go
- job.go
- job_test.go
- utils.go
- utils_test.go
- controller.go
- controller_test.go
- configmap.go
- configmap_test.go
- multicluster.go
- multicluster_test.go
- base.go
- base_test.go
- builder.go
- component.go
- decoder.go
- decoder_test.go
- engine.go
- engine_test.go
- ir_projection_test.go
- pvc.go
- pvc_test.go
- router.go
- router_test.go
- status_pod_label_test.go
- autoscaler_reconciler.go
- autoscaler_reconciler_test.go
- deployment_reconciler.go
- podspec_reconciler.go
- podspec_reconciler_test.go
- deployment_reconciler.go
- deployment_reconciler_test.go
- external_service_reconciler.go
- external_service_reconciler_test.go
- hpa_reconciler.go
- hpa_reconciler_test.go
- backendtrafficpolicy_builder.go
- backendtrafficpolicy_builder_test.go
- endpoints.go
- endpoints_test.go
- httproute_builder.go
- httproute_builder_test.go
- ingress_builder.go
- ingress_builder_test.go
- reconciler_factory.go
- reconciler_factory_test.go
- builder.go
- reconciler.go
- validator.go
- domain_service.go
- domain_service_test.go
- path_service.go
- path_service_test.go
- gateway_api_strategy.go
- gateway_api_strategy_test.go
- raw_ingress_strategy.go
- raw_ingress_strategy_test.go
- reconciler.go
- reconciler_test.go
- irstatus_read.go
- irstatus_read_test.go
- projector.go
- projector_test.go
- status.go
- status_test.go
- istiosidecar_reconciler.go
- istiosidecar_reconciler_test.go
- keda_reconciler.go
- keda_reconciler_test.go
- lws_reconciler.go
- lws_reconciler_test.go
- modelconfig_reconciler.go
- modelconfig_reconciler_test.go
- multinode_reconciler.go
- pdb_reconciler.go
- pdb_reconciler_test.go
- raw_kube_reconciler.go
- raw_kube_reconciler_test.go
- rbac_reconciler.go
- rbac_reconciler_test.go
- service_reconciler.go
- service_reconciler_test.go
- factory.go
- factory_test.go
- status.go
- status_test.go
- translator.go
- translator_test.go
- translator.go
- translator_test.go
- noop.go
- noop_test.go
- intent.go
- intent_test.go
- reconciler.go
- reconciler_test.go
- translator.go
- unsupported.go
- unsupported_test.go
- status_reconciler.go
- status_reconciler_test.go
- status_util.go
- status_util_test.go
- top_level_condition.go
- top_level_condition_test.go
- annotations.go
- annotations_test.go
- container.go
- deployment.go
- merging.go
- merging_test.go
- overlay.go
- overlay_test.go
- pods.go
- reconciliation.go
- reconciliation_test.go
- utils.go
- utils_test.go
- cleanup.go
- cleanup_test.go
- controller.go
- controller_test.go
- pinning.go
- pinning_test.go
- runtime_watch_test.go
- suite_test.go
- watches.go
- config.go
- config_test.go
- constants.go
- controller.go
- controller_name_test.go
- controller_test.go
- gatewayapi.go
- gatewayapi_test.go
- publisher.go
- admission.go
- admission_test.go
- constants.go
- controller.go
- controller_test.go
- derive.go
- derive_test.go
- dispatcher.go
- dispatcher_test.go
- failed.go
- failed_test.go
- gc.go
- gc_test.go
- match.go
- match_test.go
- predicate_test.go
- statusconverge.go
- statusconverge_test.go
- wiring_test.go
- gc_controller.go
- plan.go
- plan_test.go
- drain.go
- drain_test.go
- readiness.go
- readiness_test.go
- backoff.go
- connection.go
- connection_test.go
- controller.go
- controller_test.go
- manager.go
- manager_test.go
- options.go
- options_test.go
- remoteclient.go
- remoteclient_test.go
- watchfunnel.go
- watchfunnel_test.go
- main.go
- main.go
- main.go
- main.go
- README.md
- config.go
- config_test.go
- constants.go
- constants_test.go
- download.go
- download_test.go
- errors.go
- errors_test.go
- http_client.go
- module.go
- module_test.go
- progress.go
- README.md
- repo.go
- repo_test.go
- types.go
- types_test.go
- utils.go
- utils_test.go
- iaasInfoResponse.json
- instanceResponse.json
- instanceResponseWithHostSubclassNameInCaps.json
- instanceResponseWithInvalidHostSubclass.json
- instanceResponseWithoutHostsubclass.json
- config.go
- imds_client.go
- imds_client_test.go
- imds_vmi_test.go
- instance.go
- instance_test.go
- context.go
- requestlogger.go
- requestlogger_test.go
- config.go
- config_test.go
- discard.go
- fxlog.go
- interface.go
- level.go
- level_test.go
- logging.go
- logrus.go
- module.go
- zap.go
- request.go
- request_test.go
- configmap_reconciler.go
- configmap_reconciler_test.go
- gopher.go
- gopher_task_queue.go
- gopher_task_queue_test.go
- gopher_test.go
- healthz.go
- healthz_test.go
- hf_artifact_data.go
- hf_artifact_identity.go
- hf_artifact_identity_test.go
- hf_artifact_repository.go
- hf_artifact_repository_test.go
- hf_client.go
- hf_client_test.go
- metrics.go
- metrics_test.go
- model_data.go
- model_data_test.go
- node_label_reconciler.go
- node_label_reconciler_test.go
- scout.go
- scout_test.go
- utils.go
- utils_test.go
- main.go
- config.json
- quant_config.json
- tensor_sample.txt
- config.json
- model.safetensors.index.json
- tensor_sample.txt
- config.json
- tensor_sample.txt
- config.json
- model.safetensors.index.json
- tensor_sample.txt
- config.json
- NOTES.txt
- config.json
- hf_quant_config.json
- model.safetensors.index.json
- tensor_sample.txt
- config.json
- model.safetensors.index.json
- tensor_sample.txt
- config.json
- model-1-of-2.safetensors
- model-2-of-2.safetensors
- baichuan2_7b.json
- bge_large.json
- chatglm3_6b.json
- clip_vision_model.json
- command_r_35b.json
- config_sentence_transformers.json
- dbrx_132b.json
- deepseek_v3.json
- deepseek_vl2_tiny.json
- e5_mistral_7b.json
- exaone_7.8b.json
- gemma3.json
- gemma3_text.json
- gemma_2_2b.json
- gemma_2_2b_it.json
- gemma_2_9b.json
- gemma_7b.json
- glm4_9b.json
- gpt_oss_120b.json
- gpt_oss_20b.json
- gte_qwen2_7b.json
- internlm2_7b.json
- internlm2_reward.json
- janus_1.3b.json
- kimi_k2_instruct.json
- llama3.json
- llama3_1.json
- llama3_1_405b.json
- llama3_2_11b_vision.json
- llama3_2_1b.json
- llama3_2_3b.json
- llama3_2_90b_vision.json
- llama4.json
- llama4_scout_17b_16e.json
- llava_1.5_7b_hf.json
- llava_v1.5_7b.json
- minicpm3_4b.json
- mistral.json
- mistral_7b_instruct.json
- mixtral.json
- phi3.json
- phi3_v.json
- phi3small.json
- phimoe.json
- qwen2.5_0.5b.json
- qwen2.5_1.5b.json
- qwen2.5_14b.json
- qwen2.5_32b.json
- qwen2.5_3b.json
- qwen2.5_72b.json
- qwen2.5_7b.json
- qwen2.5_vl_7b.json
- qwen2_7b.json
- qwen2_vl_2b.json
- qwen2_vl_7b.json
- qwen3_30b.json
- qwen3_4b.json
- qwen3_5_27b.json
- qwen3_5_35b_a3b.json
- qwen3_8b_fp8.json
- qwen3_embedding_8b.json
- qwen3_vl_235b.json
- qwen3_vl_2b_instruct.json
- qwen3_vl_30b_a3b_instruct.json
- qwen_7b.json
- skywork_reward_llama.json
- smollm_1.7b.json
- stablelm_3b.json
- xverse_7b.json
- base.go
- base_test.go
- capability.go
- capability_test.go
- config.go
- config_test.go
- diffusion.go
- diffusion_test.go
- fixtures_test.go
- interface.go
- loader.go
- quant_config.go
- quant_config_test.go
- quant_param_count.go
- quant_param_count_test.go
- README.md
- safetensors.go
- safetensors_test.go
- capability.go
- capability_test.go
- config_parser.go
- config_parser_test.go
- model_metadata.go
- quant.go
- quant_test.go
- util.go
- util_test.go
- config.go
- config_test.go
- data_store.go
- data_store_test.go
- download_options.go
- download_options_test.go
- local_data_store.go
- local_data_store_test.go
- module.go
- module_test.go
- os_client.go
- os_client_test.go
- os_data_store.go
- os_data_store_test.go
- os_parallel_download.go
- os_parallel_download_test.go
- os_parallel_upload.go
- os_parallel_upload_test.go
- README.md
- utils.go
- utils_test.go
- openapi_generated.go
- swagger.json
- common.go
- config.go
- factory.go
- instance_principal.go
- oke_workload_identity.go
- resource_principal.go
- user_principal.go
- from_client.go
- from_client_test.go
- merge.go
- merge_test.go
- resolve.go
- resolve_test.go
- hash.go
- hash_test.go
- name.go
- name_test.go
- store.go
- store_test.go
- errors.go
- fetcher.go
- fetcher_test.go
- matcher.go
- matcher_test.go
- README.md
- scorer.go
- selector.go
- selector_test.go
- types.go
- envtest_setup.go
- oci_mocks.go
- testutils.go
- storage.go
- storage_local_test.go
- storage_test.go
- instance_type_util.go
- instance_type_util_test.go
- intstr.go
- intstr_test.go
- types.go
- types_test.go
- utils.go
- utils_test.go
- basemodel.go
- basemodel_test.go
- canary.go
- canary_test.go
- coordination.go
- coordination_test.go
- isvc.go
- isvc_test.go
- lifecycle.go
- lifecycle_test.go
- names.go
- placement.go
- placement_test.go
- traffic.go
- traffic_annotations.go
- traffic_annotations_test.go
- traffic_test.go
- client.go
- client_test.go
- config.go
- config_test.go
- module.go
- module_test.go
- client.go
- client_test.go
- config.go
- config_test.go
- module.go
- config.go
- config_test.go
- kmsvault.go
- kmsvault_test.go
- module.go
- module_test.go
- client.go
- client_test.go
- config.go
- config_test.go
- module.go
- module.go
- module_test.go
- secret_in_vault.go
- secret_in_vault_config.go
- secret_in_vault_config_test.go
- secret_in_vault_test.go
- vault_client.go
- module.go
- module_test.go
- secret_client.go
- secret_retrieval.go
- secret_retrieval_config.go
- secret_retrieval_config_test.go
- secret_retrieval_test.go
- config.go
- config_test.go
- module.go
- module_test.go
- vault_client.go
- vault_client_test.go
- secret_config.go
- secret_config_test.go
- util.go
- util_test.go
- version.go
- basemodel_webhook.go
- basemodel_webhook_test.go
- benchmark_webhook.go
- benchmark_webhook_test.go
- validator.go
- validator_test.go
- inference_service_defaults.go
- inference_service_defaults_test.go
- inference_service_validation.go
- inference_service_validation_test.go
- fine_tuned_adapter_injector.go
- injector_error_test.go
- model_init_injector.go
- model_init_injector_test.go
- mutator.go
- mutator_test.go
- rdma_injector.go
- rdma_injector_test.go
- resource_requirements.go
- serving_sidecar_injector.go
- suite_test.go
- webhook.go
- webhook_test.go
- servingruntime_webhook.go
- servingruntime_webhook_test.go
- config.toml
- Dockerfile
- main.go
- error.rs
- ffi.rs
- hf_adapter.rs
- lib.rs
- logging.rs
- progress.rs
- runtime.rs
- xet_downloader.rs
- xet_integration.rs
- API_FUNCTIONS.md
- BUILD_AND_RELEASE.md
- Cargo.lock
- Cargo.toml
- cbindgen.toml
- config.go
- config_test.go
- ERROR_MAPPING.md
- hf_compat.go
- Makefile
- module.go
- module_test.go
- README.md
- xet.go
- xet.h
- xet_test.go
- unzip.go
- unzip_test.go
- zip.go
- zipper_test.go
- 1.png
- hd-no-words.png
- hd-words.png
- icon.png
- logo-clear-background.png
- logo.png
- logo1.svg
- _styles_project.scss
- _variables_project.scss
- ome-logo-500x500.png
- ome-logo-hd.png
- _index.md
- controller-configuration.md
- ingress.md
- model-agent.md
- _index.md
- base_model.md
- benchmark.md
- fine_tuned_weight.md
- inference_service.md
- ingress.md
- runtime-revision.md
- serving_runtime.md
- _index.md
- contributing.md
- _index.md
- _index.md
- _index.md
- labels-and-annotations.md
- ome.v1beta1.md
- deploy-inference-service.md
- run-benchmarks.md
- _index.md
- kubectl-ome.md
- _index.md
- _index.html
- featured-background.jpg
- search.md
- render-heading.html
- body-end.html
- anchor.html
- footer.html
- head.html
- navbar-version-selector.html
- navbar.html
- seo_schema.html
- content-item.html
- content-section.html
- link-down.html
- sample-section.html
- tab.html
- tabs.html
- feature-state.html
- include.html
- needs-update.html
- params.html
- 404.html
- sitemap.xml
- site.webmanifest
- ome-architecture.html
- ome-architecture.svg
- prism-init.js
- _redirects
- .gitignore
- go.mod
- go.sum
- hugo.toml
- package-lock.json
- package.json
- README.md
- agent_integration_test.go
- helpers.go
- integration_suite_test.go
- .gitignore
- .pre-commit-config.yaml
- AGENTS.md
- CLAUDE.md
- CONTRIBUTING.md
- coverage-cmd-no-xet.out.tmp
- go.mod
- go.sum
- LICENSE
- Makefile
- Makefile-deps.mk
- NOTICE
- PROJECT
- README.md
// repository documentation
Was this content helpful?
(0 ratings)