Data pipeline & ETL

×

Error message

  • Warning: count(): Parameter must be an array or an object that implements Countable in _term_reference_tree_output_list_level() (line 202 of /var/www/html/sites/all/modules/term_reference_tree/term_reference_tree.widget.inc).
  • Warning: count(): Parameter must be an array or an object that implements Countable in _term_reference_tree_output_list_level() (line 202 of /var/www/html/sites/all/modules/term_reference_tree/term_reference_tree.widget.inc).
  • Warning: count(): Parameter must be an array or an object that implements Countable in _term_reference_tree_output_list_level() (line 202 of /var/www/html/sites/all/modules/term_reference_tree/term_reference_tree.widget.inc).

couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
couler-proj
675
67

basin

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser
basin-etl
25
3

flyte

Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
flyteorg
1998
203

Neuraxle

A Sklearn-like Framework for Hyperparameter Tuning and AutoML in Deep Learning projects. Finally have the right abstractions and design patterns to properly do AutoML. Let your pipeline steps have hyperparameter spaces. Enable checkpoints to cut duplicate calculations. Go from research to production environment easily.
Neuraxio
508
53