Examples

A collection of examples demonstrating the use cases of SkyPilot.

👋 New to SkyPilot?

Click here to read Quickstart first.

• Quickstart: PyTorch
• Training
  • Axolotl
  • DeepSpeed
  • Distributed PyTorch
  • Distributed TensorFlow
  • Finetuning Llama 3
  • Finetuning Llama 2
  • NeMo
  • Ray
  • Training on TPUs
  • Unsloth
  • Vertex AI
• Serving
  • vLLM
  • SGLang
  • Ollama
  • Hugging Face TGI
  • LoRAX
  • Cog
• Models
  • DeepSeek-R1
  • DeepSeek-R1 Distilled
  • DeepSeek-Janus
  • Gemma 3
  • Llama 3.2
  • Llama 3.1
  • Llama 3
  • Llama 2
  • CodeLlama
  • Pixtral
  • Mixtral
  • Mistral 7B
  • Qwen 2.5
  • Yi
  • Gemma
  • DBRX
  • GPT-2 via llm.c
  • Vicuna
• Other Frameworks
  • Airflow
  • DVC
  • Jupyter
  • Kueue
  • MPI
• AI Applications
  • DeepSeek-R1 for RAG
  • Image Vector Database
  • Tabby: Coding Assistant
  • LocalGPT: Chat with PDF
  • Stable Diffusion

Adding an example

We welcome contributions from the community. Instructions below:

Adding an example

1. Fork the SkyPilot repository on GitHub.

2. Create a new folder under llm/ or examples/.

   • For example, call it my-llm/.

   • Add a README.md, a SkyPilot YAML, and other necessary files to run the AI project.

   • git add the files.

4. Go to the appropriate subdir under Examples and add your example.

   • For example, if you want to add to “Examples / Serving”:

   • cd docs/source/examples/serving; ln -s ../generated-examples/my-llm.md.

   • Add a heading for your example to the TOC in the index.rst file.

   • git add index.rst my-llm.md

5. Build the docs as usual.