makazhanalpamys/soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

View on GitHub ↗Jump to charts ↓

Summary Information

Updated 17 minutes ago
Added to GitGenius on August 15th, 2026
Created on February 20th, 2026
Open Issues & Pull Requests: 88 (+0)
GitHub issues: Enabled
Number of forks: 295
Total Stargazers: 1,991 (+0)
Total Subscribers: 13 (+0)

Repository Insights (GitGenius)

Median issue/PR response: 5.0 days
Mean response time: 10.3 days
90th percentile: 25.4 days
Tracked items: 312

How this project is maintained

Around half of the issues opened in the past year never receive a reply. Only 3% of open issues come from outside the core team — the tracker reads mainly as internal planning. Work labelled "bug" is answered fastest, typically in about 6 hours, while "qa" waits about 4 weeks. Almost all tracked open issues have seen activity in the last three months. Only 12% of issues opened in the past year have been closed.

Charts & Analytics

Fetching additional details & charts...

Issue Activity (beta)

Open issues: 78
New in 7 days: 45
Closed in 7 days: 30
Avg open age: 34 days
Stale 30+ days: 25
Stale 90+ days: 6

Recent activity

Opened in 7 days: 37
Closed in 7 days: 27
Comments in 7 days: 31
Events in 7 days: 133

Top labels

  • enhancement (278)
  • help wanted (208)
  • bug (63)
  • good first issue (58)
  • qa (14)
  • infra-blocked (10)
  • documentation (4)
  • upstream-gated (1)

Detailed Description

Soup is a command-line tool for fine-tuning large language models from a single YAML configuration file.

The tool addresses the complexity of LLM fine-tuning by eliminating configuration overhead and enabling training on consumer-grade hardware. It supports multiple training approaches including supervised fine-tuning and direct preference optimization, with layer streaming technology that allows an 8 billion parameter model to train on a 4 GB laptop GPU. The tool integrates with popular frameworks like Hugging Face, PyTorch, and Ollama, and supports quantization formats such as GGUF and QLoRA for memory-efficient training.

Soup suits developers who want to fine-tune models locally without managing complex infrastructure or remote servers. It works well for projects where a single YAML configuration can capture all training parameters, and where hardware constraints make traditional fine-tuning setups impractical. The tool is designed for those seeking a streamlined alternative to manual configuration management in LLM training workflows.

The project maintains active continuous integration with passing tests. Development activity shows regular updates to the codebase and ongoing refinement of core functionality.