dlt

dlt (Data Load Tool) is the open-source Python library for building highly maintainable ELT pipelines, moving data from diverse sources into structured datasets.

This is the production-ready data load tool (dlt): a Python library designed to simplify ELT for developers and data engineers. It abstracts complex data infrastructure, allowing you to load data from APIs, files, and databases directly into destinations like Snowflake, BigQuery, or DuckDB. Key features include automated schema evolution, incremental loading, and native integration with orchestration tools such as Airflow and dbt. By embedding data contracts and governance directly into the code, dlt ensures data quality and compliance (e.g., BCBS 239 standards) without requiring a separate UI or heavy backend infrastructure.

https://dlthub.com