gokart
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
238
42
Data pipeline & ETL
prefect
The easiest way to automate your data
8558
832
dagster
An orchestration platform for the development, production, and observation of data assets.
4467
555
argo-workflows
Workflow engine for Kubernetes
10648
2098
bonobo
Extract Transform Load for Python 3.5+
1496
126
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
25179
10241
nifi
Apache NiFi
3051
2213
genie
Distributed Big Data Orchestration Service
1560
355
chronos
Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules
4312
556
azkaban
Azkaban workflow manager.
3991
1505