Metaflow

The open-source Python framework for building and managing real-life ML and data science workflows at scale.

Metaflow is the battle-hardened, open-source framework developed at Netflix to streamline ML, AI, and data science projects. It allows data scientists to build robust workflows in plain Python, then seamlessly scale out to the cloud: leveraging GPUs, multiple cores, and large memory resources as needed. The platform automatically handles versioning and experiment tracking, ensuring reproducibility and confident deployment of flows to production with a single command. It manages the full lifecycle, from local development on a laptop to scalable execution across cloud infrastructure (AWS, Azure, GCP).

https://metaflow.org