1. Data pipeline & ETL
  2. Python
  3. Open Source Tools for AI-Projects

Open Source Tools for AI-Projects

Displaying 1 - 10 of 12
airflow by apache


Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dagster by dagster-io


An orchestration platform for the development, production, and observation of data assets.
metaflow by Netflix


:rocket: Build and manage real-life data science projects with ease!
Neuraxle by Neuraxio


A Sklearn-like Framework for Hyperparameter Tuning and AutoML in Deep Learning projects. Finally have the right abstractions and design patterns to properly do AutoML. Let your pipeline steps have hyperparameter spaces. Enable checkpoints to cut duplicate calculations. Go from research to production environment easily.
bonobo by python-bonobo


Extract Transform Load for Python 3.5+
zenml by zenml-io


ZenML 🙏: MLOps framework to create reproducible pipelines.
flyte by flyteorg


Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
prefect by PrefectHQ


The easiest way to automate your data
luigi by spotify


Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
couler by couler-proj


Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.