polymathicai/the_well

A 15TB Collection of Physics Simulation Datasets

View on GitHub ↗Jump to charts ↓Open shareable report

Summary Information

Updated 26 minutes ago
Added to GitGenius on September 15th, 2026
Created on December 2nd, 2024
Open Issues & Pull Requests: 22 (+0)
GitHub issues: Enabled
Number of forks: 571
Total Stargazers: 4,455 (+0)
Total Subscribers: 50 (+0)

Repository Insights (GitGenius)

Median issue/PR response: 30.9 hours
Mean response time: 15.5 days
90th percentile: 63.9 days
Tracked items: 36

Most active contributors

Sign in to see contributor activity.

Charts & Analytics

Fetching additional details & charts...

Issue Activity (beta)

Open issues: 17
New in 7 days: 0
Closed in 7 days: 0
Avg open age: 230 days
Stale 30+ days: 17
Stale 90+ days: 9

Recent activity

Opened in 7 days: 0
Closed in 7 days: 0
Comments in 7 days: 0
Events in 7 days: 0

Top labels

  • bug (6)

Most active issues this week

No issue events were indexed in the last 7 days.

Detailed Description

The Well is a large-scale collection of physics simulation datasets designed for machine learning research and model training.

The project addresses the need for diverse, high-quality training data in machine learning for computational sciences. It aggregates numerical simulations from 16 datasets spanning biological systems, fluid dynamics, acoustic scattering, and magneto-hydrodynamic phenomena. The collection totals 15TB of spatiotemporal data that can be used individually or as a unified benchmark suite. The tool provides a Python package with a standardized interface for accessing these datasets in training pipelines, along with utilities for downloading data and streaming from Hugging Face.

Researchers working on physics-informed machine learning, neural operators, or surrogate modeling for scientific computing should consider this collection. It suits projects that require diverse physical domains rather than deep specialization in a single system, and it accommodates varying computational resources through flexible download options. Individual datasets range from approximately 7GB to over 5TB, so users should assess their storage capacity before downloading. The project recommends Python 3.10 or later and provides installation paths from PyPI or source, with optional support for different GPU acceleration backends.

Development activity shows consistent maintenance with passing test workflows and active documentation. The project maintains published research outputs alongside the dataset release, indicating ongoing engagement with the scientific community. The tool is distributed through standard package management channels and provides streaming capabilities as an alternative to full downloads.