Running on Kubernetes#

SkyPilot tasks can be run on your private on-prem or cloud Kubernetes clusters. The Kubernetes cluster gets added to the list of “clouds” in SkyPilot and SkyPilot tasks can be submitted to your Kubernetes cluster just like any other cloud provider.

Why use SkyPilot on Kubernetes?#

✅ Ease of use

No complex kubernetes manifests - write a simple SkyPilot YAML and run with one command sky launch.

📋 Interactive development on Kubernetes

SSH access to pods, VSCode integration, job management, autodown idle pods and more.

☁️ Burst to the cloud

Kubernetes cluster is full? SkyPilot seamlessly gets resources on the cloud to get your job running sooner.

🖼 Run popular models on Kubernetes

Train and serve Llama-3, Mixtral, and more on your Kubernetes with ready-to-use recipes from the AI gallery.

☁️ Unified platform for all Infrastructure

Scale beyond your Kubernetes cluster to capacity on across clouds and regions without manual intervention.

🚯️ Minimize resource wastage

SkyPilot can run with your custom pod scheduler and automatically terminate idle pods to free up resources for other users.

👀 Observability

Works with your existing observability and monitoring tools, such as the Kubernetes Dashboard.

🍽️ Self-serve infra for your teams

Reduce operational overhead by letting your teams provision their own resources, while you retain control over the Kubernetes cluster.

Table of Contents#

👋 Get Started

Already have a kubeconfig? Launch your first SkyPilot task on Kubernetes - it’s as simple as sky launch.

⚙️ Cluster Configuration

Are you a cluster admin? Find cluster deployment guides and setup instructions here.

🔍️ Troubleshooting

Running into problems with SkyPilot on your Kubernetes cluster? Find common issues and solutions here.

Features and Roadmap#

Kubernetes support is under active development. Some features are in progress and will be released soon:

  • CPU and GPU Tasks - ✅ Available

  • Auto-down - ✅ Available

  • Storage mounting - ✅ Available on x86_64 clusters

  • Multi-node tasks - ✅ Available

  • Custom images - ✅ Available

  • Opening ports and exposing services - ✅ Available

  • Multiple Kubernetes Clusters - 🚧 In progress