Implementation:Kserve Kserve LLMIsvc Quick Install
| Knowledge Sources | |
|---|---|
| Domains | Infrastructure, Kubernetes, LLM_Serving |
| Last Updated | 2026-02-13 00:00 GMT |
Overview
Concrete shell script that installs the complete LLMInferenceService stack via Helm charts and kubectl commands.
Description
The llmisvc_quick_install.sh script automates the installation of all components required for LLM inference serving. It installs dependencies in the correct order, handles minikube-specific configurations (MetalLB), and creates the required Gateway resources.
Usage
Run the script on a Kubernetes cluster (>= 1.24) with Helm installed. It handles the full dependency chain automatically.
Code Reference
Source Location
- Repository: kserve
- File: hack/llmisvc_quick_install.sh, Lines 1-238
Signature
# Usage
bash hack/llmisvc_quick_install.sh
# Installation sequence:
# L98-105: cert-manager (helm install jetstack/cert-manager)
# L108: Gateway API Extension CRDs
# L118-124: Envoy Gateway (helm install envoy-gateway)
# L132-142: Envoy AI Gateway CRDs + controller
# L147: kserve namespace creation
# L150-190: MetalLB config (minikube only)
# L194-199: Leader Worker Set (LWS)
# L203-211: GatewayClass "envoy"
# L213: KServe LLMIsvc Helm chart
# L219-238: Gateway "kserve-ingress-gateway"
Import
# Prerequisites
helm version # Helm must be installed
kubectl version # Kubernetes >= 1.24
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| Kubernetes cluster | cluster | Yes | Kubernetes >= 1.24 |
| Helm CLI | binary | Yes | Helm package manager |
| Internet access | network | Yes | For downloading charts and images |
Outputs
| Name | Type | Description |
|---|---|---|
| cert-manager | Deployment | TLS certificate management |
| Envoy Gateway | Deployment | Ingress controller with AI routing |
| Leader Worker Set | Deployment | Multi-pod coordination controller |
| KServe LLMIsvc controller | Deployment | LLMInferenceService reconciler |
| CRDs | CustomResourceDefinition | LLMInferenceService, LLMInferenceServiceConfig |
| Gateway | gateway.networking.k8s.io | kserve-ingress-gateway on port 80 |
Usage Examples
Full Installation
# Clone the repository
git clone https://github.com/kserve/kserve.git
cd kserve
# Run quick install
bash hack/llmisvc_quick_install.sh
# Verify installation
kubectl get pods -n kserve
kubectl get crd llminferenceservices.serving.kserve.io
kubectl get gateway kserve-ingress-gateway
Related Pages
Implements Principle
Requires Environment
- Environment:Kserve_Kserve_Kubernetes_Cluster
- Environment:Kserve_Kserve_Cert_Manager
- Environment:Kserve_Kserve_Gateway_API
- Environment:Kserve_Kserve_Leader_Worker_Set
Uses Heuristic
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment