1. Computation distribution
  2. Open Source Tools for AI-Projects

Open Source Tools for AI-Projects

Displaying 1 - 10 of 16
beam by apache


Apache Beam is a unified programming model for Batch and Streaming
ray by ray-project


An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
spark by apache


Apache Spark - A unified analytics engine for large-scale data processing
DeepSpeed by microsoft


DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dask by dask


Parallel computing with task scheduling
pytorch-lightning by PyTorchLightning


The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.
vespa by vespa-engine


The open big data serving engine. https://vespa.ai
BigDL by intel-analytics


Building Large-Scale AI Applications for Distributed Big Data
horovod by horovod


Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
analytics-zoo by intel-analytics


Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray