airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

View on GitHub ↗Jump to charts ↓

Summary Information

Updated 1 hour ago
Added to GitGenius on January 5th, 2025
Created on July 27th, 2020
Open Issues & Pull Requests: 2,401 (+0)
GitHub issues: Enabled
Number of forks: 5,347
Total Stargazers: 22,057 (+0)
Total Subscribers: 183 (+0)

Charts & Analytics

Fetching additional details & charts...

Issue Activity (beta)

Issue API getrepoissuespagesummary failed: 429 Rate limit exceeded. Please try again later.

Detailed Description

Airbyte is an open-source platform for data movement designed to support ELT pipelines and AI agents, enabling users to move data from APIs, databases, and files to warehouses, lakes, and AI applications. The project is available both as a self-hosted solution and through Airbyte Cloud. Written primarily in Python, the repository provides a comprehensive catalog of over 600 connectors that cover a wide range of data sources and destinations including popular databases like PostgreSQL, MySQL, and MSSQL, as well as cloud platforms such as Snowflake, BigQuery, and Redshift.

The platform addresses two distinct use cases. For traditional data integration, Airbyte enables users to deploy either the open-source version or Airbyte Cloud to centralize data movement into warehouses, lakes, and databases. For AI applications, Airbyte provides both a managed Airbyte Agents product and an open-source Agent SDK that gives AI agents, LLMs, and MCP clients real-time access to business data from CRMs, support tools, SaaS APIs, and databases. The Agent SDK integrates with frameworks like pydantic-ai, LangChain, OpenAI Agents, and FastMCP, offering built-in retry logic, exception translation, and output-size guardrails.

Connector development is streamlined through multiple approaches. Users can create connectors in minutes using the no-code Connector Builder or leverage the low-code Connector Development Kit. The platform supports incremental sync and change-data-capture capabilities, enabling efficient data replication. Airbyte syncs can be orchestrated with popular tools including Airflow, Dagster, and Kestra, or directly through the Airbyte API.

The repository demonstrates substantial community engagement and active maintenance.

The project is licensed under both MIT and ELv2 licenses, with Airbyte Enterprise offering additional security features beyond the open-source version. The platform maintains a publicly viewable roadmap on GitHub and fosters community participation through the Airbyte Community Slack, GitHub Discussions forum, and a contributor program with designated good first issues for newcomers. Contributors are encouraged to enable maintainer write access to their branches to expedite the review process, and security vulnerabilities should be reported directly to [email protected] rather than through public channels.