Arewefastyet is an automated benchmarking system that continuously monitors the performance of the Vitess codebase across pull requests and releases.
The tool addresses the need to detect performance regressions as the Vitess codebase evolves. It runs benchmarks using multiple workloads and compares results against the main branch, release branches, recent git tags, and custom git commits. Developers can request benchmarking of a specific pull request by applying a label, triggering automated performance testing that compares the pull request's head commit against its base branch.
The system is designed for teams maintaining Vitess who need systematic performance tracking integrated into their development workflow. It suits projects where performance stability is critical and where pull request-level performance visibility is valuable before merging. The tool runs via Docker and Docker Compose, making deployment straightforward across different environments, though accessing the full system requires secrets for database and benchmarking server connectivity that maintainers must provision.
The project maintains active development with regular updates to its benchmarking infrastructure and measurement capabilities. The codebase shows ongoing refinement of how performance data is collected and compared across different Vitess versions and configurations. Work continues on expanding the range of workloads tested and improving the accuracy of performance comparisons.
