1. Data pipeline & ETL
  2. Open Source Tools for AI-Projects

Open Source Tools for AI-Projects

Displaying 1 - 10 of 21
airflow by apache


Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
argo-workflows by argoproj


Workflow engine for Kubernetes
nifi by apache


Apache NiFi
dagster by dagster-io


An orchestration platform for the development, production, and observation of data assets.
metaflow by Netflix


:rocket: Build and manage real-life data science projects with ease!
Neuraxle by Neuraxio


A Sklearn-like Framework for Hyperparameter Tuning and AutoML in Deep Learning projects. Finally have the right abstractions and design patterns to properly do AutoML. Let your pipeline steps have hyperparameter spaces. Enable checkpoints to cut duplicate calculations. Go from research to production environment easily.
bonobo by python-bonobo


Extract Transform Load for Python 3.5+
zenml by zenml-io


ZenML 🙏: MLOps framework to create reproducible pipelines.
flyte by flyteorg


Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
snakemake by snakemake


This is the development home of the workflow management system Snakemake. For general information, see