Soup CLI
Soup CLI is an open-source tool for LLM post-training that eliminates the hardware barrier of fine-tuning.
Free tierVisit site ↗
Our verdict
Who it's for
Fine-tune any LLM on a 4GB GPU with layer streaming
Who should look elsewhere
Layer streaming is still in BETA with known edge cases and limitations (text-only, plain LoRA, specific architectures)
Pros
- +Enables fine-tuning of large models on low-cost consumer GPUs that would otherwise be impossible
- +Fully open source and free with no paid tier or vendor lock-in
- +Comprehensive automation: from data validation to config writing to model evaluation
Cons
- −Layer streaming is still in BETA with known edge cases and limitations (text-only, plain LoRA, specific architectures)
- −Requires Python 3.10 to 3.12 and is primarily designed for CUDA-based GPUs
Key features
- ✓Layer streaming: fine-tune models up to 8B on a 4GB GPU by streaming decoder layers from CPU/NVMe
- ✓23 training methods: SFT, DPO, ORPO, SimPO, KTO, and more
- ✓Automatic config generation: writes task, quantization, LR, and epochs based on rules, not search
- ✓Pre-flight data validation: refuses runs that won't fit on hardware
- ✓Self-correcting: catches reward hacking mid-run rather than just halting
- ✓Migration command: converts configs from LLaMA-Factory, Axolotl, and Unsloth
- ✓Supports 9 architectures: Llama, Qwen, Mistral, Gemma, Phi
- ✓17 quantization formats including NF4 for 4x compression
Pricing
No public pricing plans recorded.