DeepSpeed DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.microsoft6447750
pytorch-lightning The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.PyTorchLightning176972229
horovod Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.horovod122282028
analytics-zoo Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Rayintel-analytics2484714
ray An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.ray-project195573365