Training# Axolotl DeepSpeed Distributed PyTorch Distributed TensorFlow Fairseq2 Finetuning GPT-OSS Finetuning Llama 4 Finetuning Llama 3 Finetuning Llama 2 nanochat NeMo NeMo RL OpenRLHF PyTorch Monarch Ray TorchTitan Training on TPUs Unsloth Verl (RLHF) SkyRL Vertex AI