Unsloth is a Python-based platform for training and running open-source language models locally, consisting of two complementary components: Unsloth Studio, a web UI for model training and inference, and Unsloth Core, a code-based library for developers. The project enables users to work with models including Gemma 4, Qwen 3.6, DeepSeek, gpt-oss, Llama, Mistral, and other open models on Windows, Linux, macOS, and WSL environments.
The inference capabilities of Unsloth Studio include searching, downloading, and running models in multiple formats such as GGUF, LoRA adapters, and safetensors. Users can export trained models to various formats, leverage self-healing tool calling with web search integration, and execute code within sandboxed environments to allow language models to test implementations. The platform provides an API inference endpoint for deploying local language models in external tools like Claude Code and Codex, with automatic inference parameter tuning and customizable chat templates. The project maintains direct collaborations with teams behind major model architectures, having contributed bug fixes that improve model accuracy for gpt-oss, Qwen3, Llama 4, Mistral, Gemma, and Phi-4.
Training functionality supports over 500 models with performance improvements of up to 2x faster training speed and up to 70 percent reduction in VRAM usage without accuracy loss. The platform includes custom Triton and mathematical kernels developed through collaborations with PyTorch and Hugging Face. Data recipes allow automatic dataset creation from PDF, CSV, and DOCX files with visual node-based workflow editing. Reinforcement learning capabilities use 80 percent less VRAM for GRPO training and support FP8 quantization. The platform supports full fine-tuning, reinforcement learning, pretraining, and various quantization levels including 4-bit, 16-bit, and FP8 training, with multi-GPU training support and live training observability for monitoring loss, GPU usage, and custom metrics.
Installation options include Docker containers, platform-specific pip installations, and cloud deployment with Cloudflare tunnel support for remote HTTPS access. The project provides free Google Colab notebooks for training various models including Gemma 4, Qwen 3.5, gpt-oss, and specialized notebooks for reinforcement learning, text-to-speech, embedding models, and vision-multimodal tasks. The platform is classified across multiple domains including AI development, machine learning, MLOps, natural language processing, model training, and conversational agents, reflecting its broad applicability across the machine learning development lifecycle.
