airbyte
by
airbytehq

Description: Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

View on GitHub ↗

Summary Information

Updated 27 minutes ago
Added to GitGenius on January 5th, 2025
Created on July 27th, 2020
Open Issues & Pull Requests: 2,469 (+1)
Number of forks: 5,251
Total Stargazers: 21,600 (+0)
Total Subscribers: 184 (+0)

Issue Activity (beta)

Open issues: 646
New in 7 days: 1
Closed in 7 days: 0
Avg open age: 469 days
Stale 30+ days: 567
Stale 90+ days: 476

Recent activity

Opened in 7 days: 1
Closed in 7 days: 0
Comments in 7 days: 6
Events in 7 days: 14

Top labels

  • type/bug (5,095)
  • community (4,849)
  • area/connectors (4,680)
  • type/enhancement (4,074)
  • autoteam (3,913)
  • team/connectors-python (2,344)
  • team/use (1,618)
  • team/extensibility (1,611)

Repository Insights (GitGenius)

Median issue/PR response: 595.8 days
Mean response time: 571.2 days
90th percentile: 1071.9 days
Tracked items: 1,155

Most active contributors

Detailed Description

Airbyte is an open-source platform for data movement designed to support ELT pipelines and AI agents, enabling users to move data from APIs, databases, and files to warehouses, lakes, and AI applications. The project is available both as a self-hosted solution and through Airbyte Cloud. Written primarily in Python, the repository provides a comprehensive catalog of over 600 connectors that cover a wide range of data sources and destinations including popular databases like PostgreSQL, MySQL, and MSSQL, as well as cloud platforms such as Snowflake, BigQuery, and Redshift.

The platform addresses two distinct use cases. For traditional data integration, Airbyte enables users to deploy either the open-source version or Airbyte Cloud to centralize data movement into warehouses, lakes, and databases. For AI applications, Airbyte provides both a managed Airbyte Agents product and an open-source Agent SDK that gives AI agents, LLMs, and MCP clients real-time access to business data from CRMs, support tools, SaaS APIs, and databases. The Agent SDK integrates with frameworks like pydantic-ai, LangChain, OpenAI Agents, and FastMCP, offering built-in retry logic, exception translation, and output-size guardrails.

Connector development is streamlined through multiple approaches. Users can create connectors in minutes using the no-code Connector Builder or leverage the low-code Connector Development Kit. The platform supports incremental sync and change-data-capture capabilities, enabling efficient data replication. Airbyte syncs can be orchestrated with popular tools including Airflow, Dagster, and Kestra, or directly through the Airbyte API.

The repository demonstrates substantial community engagement and active maintenance. GitGenius tracking shows a median issue and pull request response latency of 0.0 hours with a mean of 4594.7 hours across 4654 tracked items, indicating rapid initial response times. The most active issue labels are community with 3679 items, type/bug with 2862 items, and autoteam with 2722 items. Top contributors include octavia-squidington-iii with 14542 tracked events, marcosmarxm with 8914 events, and girarda with 1180 events. The repository shares overlapping contributors with microsoft/vscode, h2oai/h2o-3, and microsoft/typescript, suggesting cross-pollination with major open-source projects.

The project is licensed under both MIT and ELv2 licenses, with Airbyte Enterprise offering additional security features beyond the open-source version. The platform maintains a publicly viewable roadmap on GitHub and fosters community participation through the Airbyte Community Slack, GitHub Discussions forum, and a contributor program with designated good first issues for newcomers. Contributors are encouraged to enable maintainer write access to their branches to expedite the review process, and security vulnerabilities should be reported directly to [email protected] rather than through public channels.

airbyte
by
airbytehqairbytehq/airbyte

Repository Details

Fetching additional details & charts...