edl

PaddlePaddle EDL: Elastic Deep Learning

While many hardware and software manufacturers are working on improving the running time of deep learning jobs, EDL optimizes

1. the global utilization of the cluster, and
2. the waiting time of job submitters.

For more about the project EDL, please refer to this invited blog post on the Kubernetes official blog.

EDL includes two parts:

1. a Kubernetes controller for the elastic scheduling of distributed deep learning jobs, and

2. making PaddlePaddle a fault-tolerable deep learning framework. This directory contains the Kubernetes controller. For more information about fault-tolerance, please refer to the design.

We deployed EDL on a real Kubernetes cluster, dlnel.com, opened for graduate students of Tsinghua University. The performance test report of EDL on this cluster is here.

Tutorials

• Usage
• How to Build EDL Component
• Run CTR Training and Deployment on Baidu Cloud

Design Docs

• Collective communication pattern
  • Fault-Tolerant Training in PaddlePaddle.
  • Elastic Deep Learning Design Doc:compute engine.
  • Elastic Deep Learning Design Doc:Scheduler.
  • Run Elastic Deep Learning Demo on a sinle node.

FAQ

TBD

License

PaddlePaddle EDL is provided under the Apache-2.0 license.