Skip to main content
Ctrl+K

Site Navigation

  • Docs
  • Blog
  • Community
  • Slack
  • Twitter
  • GitHub

Site Navigation

  • Docs
  • Blog
  • Community
  • Slack
  • Twitter
  • GitHub

Getting Started

  • Overview
  • Installation
  • Quickstart
  • Examples
    • Quickstart: PyTorch
    • Training
      • Axolotl
      • DeepSpeed
      • Distributed PyTorch
      • Distributed TensorFlow
      • Finetuning Llama 3
      • Finetuning Llama 2
      • NeMo
      • Ray
      • Training on TPUs
      • Unsloth
      • Vertex AI
    • Serving
      • vLLM
      • SGLang
      • Ollama
      • Hugging Face TGI
      • LoRAX
      • Cog
    • Models
      • DeepSeek-R1
      • DeepSeek-R1 Distilled
      • DeepSeek-Janus
      • Gemma 3
      • Llama 3.2
      • Llama 3.1
      • Llama 3
      • Llama 2
      • CodeLlama
      • Pixtral
      • Mixtral
      • Mistral 7B
      • Qwen 2.5
      • Yi
      • Gemma
      • DBRX
      • GPT-2 via llm.c
      • Vicuna
    • Other Frameworks
      • Airflow
      • DVC
      • Jupyter
      • Kueue
      • MPI
    • AI Applications
      • DeepSeek-R1 for RAG
      • Image Vector Database
      • Tabby: Coding Assistant
      • LocalGPT: Chat with PDF
      • Stable Diffusion
  • Concept: Sky Computing

Clusters

  • Start a Cluster
  • Cluster Jobs
  • Provisioning Compute
  • Autostop and Autodown

Jobs

  • Managed Jobs
  • Multi-Node Jobs
  • Many Parallel Jobs

Model Serving

  • Getting Started
  • Serving User Guides
    • Autoscaling
    • Updating a Service
    • Authorization
    • Using Spot Instances for Serving
    • HTTPS Encryption

Infra Choices

  • Using Kubernetes
    • Getting Started
    • Kubernetes Cluster Setup
      • Deployment Guides
      • Exposing Services
    • Priority and Preemption
    • Multiple Kubernetes Clusters
    • SkyPilot vs. Vanilla Kubernetes
    • Examples
      • Dynamic Workload Scheduler
      • Kueue
      • Multi-region Kubernetes
    • Kubernetes Troubleshooting
  • Using Existing Machines
  • Using Reservations
  • Using Cloud VMs
  • GPUs and Accelerators
    • Using Google TPUs

Data

  • Cloud Buckets
  • Syncing Code and Artifacts

User Guides

  • Asynchronous Execution
  • Secrets and Environment Variables
  • Docker Containers
  • Opening Ports
  • Usage Collection
  • Frequently Asked Questions

Administrator Guides

  • Team Deployment
    • Deploying API Server
  • Minimal Cloud Permissions
    • AWS
    • GCP
    • vSphere
    • Kubernetes
  • Cloud Authentication
  • Requesting Quota Increase
  • Admin Policies

References

  • SkyPilot YAML
  • CLI
  • Python SDK
  • Advanced Configurations
  • Developer Guides
    • Contributing to SkyPilot
    • Guide: Adding a New Cloud

AI Applications#

  • DeepSeek-R1 for RAG
  • Image Vector Database
  • Tabby: Coding Assistant
  • LocalGPT: Chat with PDF
  • Stable Diffusion

previous

Mpirun

next

Retrieval Augmented Generation with DeepSeek R1
Edit on GitHub

© Copyright 2025, SkyPilot Team.