Open Source Tools for AI-Projects

Displaying 11 - 16 of 16

azkaban by azkaban


Azkaban workflow manager.

setl by SETL-Framework


A simple Spark-powered ETL framework that just works 🍺

luigi by spotify


Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

couler by couler-proj


Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

genie by Netflix


Distributed Big Data Orchestration Service

chronos by mesos


Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules