Implementation:Kubeflow Pipelines Helm Pipeline Template
| Knowledge Sources | |
|---|---|
| Domains | Deployment, Pipeline_Management, Helm |
| Last Updated | 2026-02-13 14:00 GMT |
Overview
Helm template for the core KFP pipeline control plane resources in the GCP Marketplace deployment, defining the API server, UI, persistence agent, and supporting services.
Description
This is the largest and most critical Marketplace template (877 lines), containing the entire KFP control plane. It defines CRDs (ScheduledWorkflow, Viewer), and all Kubernetes resources for: the KFP API server, persistence agent, scheduled workflow controller, viewer CRD controller, visualization server, UI frontend, and metadata writer. Each component includes its own ServiceAccount, Role, RoleBinding, Service, and Deployment.
Usage
This template is rendered during Helm-based GCP Marketplace installation. It provisions all KFP control plane components that handle pipeline run execution, scheduling, UI serving, and metadata tracking.
Code Reference
Source Location
- Repository: Kubeflow_Pipelines
- File: manifests/gcp_marketplace/chart/kubeflow-pipelines/templates/pipeline.yaml
- Lines: 1-877
Signature
# Key Kubernetes resources defined:
# - CRD: scheduledworkflows.kubeflow.org (v1beta1, Namespaced)
# - CRD: viewers.kubeflow.org (v1beta1, Namespaced)
# - Deployment: ml-pipeline (API server)
# - Deployment: ml-pipeline-persistenceagent
# - Deployment: ml-pipeline-scheduledworkflow
# - Deployment: ml-pipeline-viewer-crd
# - Deployment: ml-pipeline-visualizationserver
# - Deployment: ml-pipeline-ui
# - Deployment: metadata-writer
# - Services, Roles, RoleBindings, ServiceAccounts for each component
Import
# Rendered via Helm during GCP Marketplace installation
helm install kubeflow-pipelines chart/kubeflow-pipelines/
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| .Release.Name | Helm value | Yes | Helm release name for resource labeling |
| .Release.Namespace | Helm value | Yes | Target Kubernetes namespace |
| Component images | Helm values | Yes | Container images for each KFP component |
Outputs
| Name | Type | Description |
|---|---|---|
| KFP CRDs | CustomResourceDefinition | ScheduledWorkflow and Viewer CRDs |
| API Server | Deployment + Service | Central pipeline management API (ml-pipeline) |
| UI | Deployment + Service | Frontend web application (ml-pipeline-ui) |
| Agents | Deployments | Persistence, scheduling, viewer, visualization, metadata writer |
Usage Examples
Verifying KFP Control Plane
# Check all KFP deployments are running
kubectl get deployments | grep ml-pipeline
# Verify API server service
kubectl get svc ml-pipeline
# Check KFP CRDs
kubectl get crd | grep kubeflow.org