Training & Fine-Tuning Repositories

ml-intern

by huggingface

Total Stargazers:10813

Total Subscribers:47

🤗 ml-intern: an open-source ML engineer that reads papers, trains models, and ships ML models

dolly

by databrickslabs

Total Stargazers:10808

Total Subscribers:134

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

ART

by OpenPipe

Total Stargazers:10713

Total Subscribers:69

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

autogluon

by autogluon

Total Stargazers:10650

Total Subscribers:101

Fast and Accurate ML in 3 Lines of Code

yolov3

by ultralytics

Total Stargazers:10604

Total Subscribers:148

PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

cleanrl

by vwxyzjn

Total Stargazers:10391

Total Subscribers:50

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

tpot

by EpistasisLab

Total Stargazers:10051

Total Subscribers:274

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

OpenRLHF

by OpenRLHF

Total Stargazers:9997

Total Subscribers:58

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

nlp_chinese_corpus

by brightmart

Total Stargazers:9911

Total Subscribers:289

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

accelerate

by huggingface

Total Stargazers:9862

Total Subscribers:97

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

train-llm-from-scratch

by FareedKhan-dev

Total Stargazers:9603

Total Subscribers:78

A straightforward method for training your LLM, from downloading data to generating text.

LTX-2

by Lightricks

Total Stargazers:9398

Total Subscribers:99

Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model.

oumi

by oumi-ai

Total Stargazers:9382

Total Subscribers:67

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

so-vits-svc-fork

by voicepaw

Total Stargazers:9335

Total Subscribers:69

so-vits-svc fork with realtime support, improved interface and more features.

autokeras

by keras-team

Total Stargazers:9328

Total Subscribers:294

AutoML library for deep learning

Sana

by NVlabs

Total Stargazers:9058

Total Subscribers:105

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

apex

by NVIDIA

Total Stargazers:8999

Total Subscribers:101

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

AI4Animation

by sebastianstarke

Total Stargazers:8860

Total Subscribers:374

Bringing Characters to Life with Computer Brains in Unity

Bert-VITS2

by fishaudio

Total Stargazers:8801

Total Subscribers:54

vits2 backbone with multilingual-bert

minimind-v

by jingyaogong

Total Stargazers:8622

Total Subscribers:51

👀 Train a 65M-parameter VLM from scratch in just 2h!

LMFlow

by OptimalScale

Total Stargazers:8488

Total Subscribers:66

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

bitsandbytes

by bitsandbytes-foundation

Total Stargazers:8475

Total Subscribers:53

Accessible large language models via k-bit quantization for PyTorch.

slime

by THUDM

Total Stargazers:8448

Total Subscribers:31

slime is an LLM post-training framework for RL Scaling.

ASRT_SpeechRecognition

by nl8590687

Total Stargazers:8386

Total Subscribers:178

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

optimate

by nebuly-ai

Total Stargazers:8328

Total Subscribers:88

A collection of libraries to optimise AI model performances

OBLITERATUS

by elder-plinius

Total Stargazers:8278

Total Subscribers:76

OBLITERATE THE CHAINS THAT BIND YOU

AIInfra

by Infrasys-AI

Total Stargazers:8175

Total Subscribers:67

AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。

lmdeploy

by InternLM

Total Stargazers:8061

Total Subscribers:57

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

hybridclr

by focus-creative-games

Total Stargazers:7962

Total Subscribers:100

HybridCLR是一个特性完整、零成本、高性能、低内存的Unity全平台原生c#热更新解决方案。 HybridCLR is a fully featured, zero-cost, high-performance, low-memory solution for Unity's all-platform native c# hotupdate.

fast-stable-diffusion

by TheLastBen

Total Stargazers:7910

Total Subscribers:91

fast-stable-diffusion + DreamBooth

PaLM-rlhf-pytorch

by lucidrains

Total Stargazers:7863

Total Subscribers:134

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

LongCat-Video

by meituan-longcat

Total Stargazers:7862

Total Subscribers:79

______________

tensorrtx

by wang-xinyu

Total Stargazers:7833

Total Subscribers:103

Implementation of popular deep learning networks with TensorRT network definition API

ERNIE

by PaddlePaddle

Total Stargazers:7735

Total Subscribers:191

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

autograd

by HIPS

Total Stargazers:7528

Total Subscribers:205

Efficiently computes derivatives of NumPy code.

starcoder

by bigcode-project

Total Stargazers:7504

Total Subscribers:66

Home of StarCoder: fine-tuning & inference!

gpt-neox

by EleutherAI

Total Stargazers:7462

Total Subscribers:127

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

mergekit

by arcee-ai

Total Stargazers:7347

Total Subscribers:61

Tools for merging pretrained large language models.

fun-rec

by datawhalechina

Total Stargazers:7330

Total Subscribers:37

推荐系统入门教程，在线阅读地址：https://datawhalechina.github.io/fun-rec/

objectdetection_script

by z1069614715

Total Stargazers:7307

Total Subscribers:27

一些关于目标检测的脚本和改进思路代码，详细请看readme.md

InternLM

by InternLM

Total Stargazers:7278

Total Subscribers:58

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

ANE

by maderix

Total Stargazers:7255

Total Subscribers:79

Training neural networks on Apple Neural Engine via reverse-engineered private APIs

sd-scripts

by kohya-ss

Total Stargazers:7235

Total Subscribers:56

______________

flower

by flwrlabs

Total Stargazers:7125

Total Subscribers:42

Flower: A Friendly Federated AI Framework

Chinese-LLaMA-Alpaca-2

by ymcui

Total Stargazers:7117

Total Subscribers:73

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

DeepSpec

by deepseek-ai

Total Stargazers:7107

Total Subscribers:33

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

gemma.cpp

by google

Total Stargazers:7036

Total Subscribers:48

lightweight, standalone C++ inference engine for Google's Gemma models.

data-juicer

by datajuicer

Total Stargazers:7036

Total Subscribers:19

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

turboquant_plus

by TheTom

Total Stargazers:7021

Total Subscribers:65

______________

OpenNMT-py

by OpenNMT

Total Stargazers:7016

Total Subscribers:174

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

corenet

by apple

Total Stargazers:7008

Total Subscribers:59

CoreNet: A library for training deep neural networks

mlx-lm

by ml-explore

Total Stargazers:6984

Total Subscribers:51

Run LLMs with MLX

DeepSpeedExamples

by deepspeedai

Total Stargazers:6846

Total Subscribers:72

Example models using DeepSpeed

smol-course

by huggingface

Total Stargazers:6743

Total Subscribers:47

A course on aligning smol models.

llm-beginner

by nndl

Total Stargazers:6739

Total Subscribers:100

《大模型与智能体》电子书与 6 个编程任务：Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

OLMo

by allenai

Total Stargazers:6675

Total Subscribers:58

Modeling, training, eval, and inference code for OLMo

Liger-Kernel

by linkedin

Total Stargazers:6610

Total Subscribers:55

Efficient Triton Kernels for LLM Training

text-to-text-transfer-transformer

by google-research

Total Stargazers:6548

Total Subscribers:104

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

StableCascade

by Stability-AI

Total Stargazers:6534

Total Subscribers:58

Training & Fine-Tuning

Pre-training, fine-tuning, RLHF, distillation and post-training toolkits.

ml-intern

by huggingface

🤗 ml-intern: an open-source ML engineer that reads papers, trains models, and ships ML models

dolly

by databrickslabs

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

ART

by OpenPipe

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

autogluon

by autogluon

Fast and Accurate ML in 3 Lines of Code

yolov3

by ultralytics

PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

cleanrl

by vwxyzjn

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

tpot

by EpistasisLab

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

OpenRLHF

by OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

nlp_chinese_corpus

by brightmart

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

accelerate

by huggingface

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

train-llm-from-scratch

by FareedKhan-dev

A straightforward method for training your LLM, from downloading data to generating text.

LTX-2

by Lightricks

Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model.

oumi

by oumi-ai

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

so-vits-svc-fork

by voicepaw

so-vits-svc fork with realtime support, improved interface and more features.

autokeras

by keras-team

AutoML library for deep learning

Sana

by NVlabs

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

apex

by NVIDIA

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

AI4Animation

by sebastianstarke

Bringing Characters to Life with Computer Brains in Unity

Bert-VITS2

by fishaudio

vits2 backbone with multilingual-bert

minimind-v

by jingyaogong

👀 Train a 65M-parameter VLM from scratch in just 2h!

LMFlow

by OptimalScale

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

bitsandbytes

by bitsandbytes-foundation

Accessible large language models via k-bit quantization for PyTorch.

slime

by THUDM

slime is an LLM post-training framework for RL Scaling.

ASRT_SpeechRecognition

by nl8590687

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

optimate

by nebuly-ai

A collection of libraries to optimise AI model performances

OBLITERATUS

by elder-plinius

OBLITERATE THE CHAINS THAT BIND YOU