DeepSpeed
  • Training Setup
  • Inference Setup
  • Training API
  • Inference API
  • Model Checkpointing
  • Activation Checkpointing
  • ZeRO
  • AutoEP (Automatic Expert Parallelism)
  • Mixture of Experts (DeepSpeed MoE)
  • Transformer Kernels
  • Pipeline Parallelism
  • Optimizers
  • Learning Rate Schedulers
  • Flops Profiler
  • Autotuning
  • Memory Requirements
  • Monitoring
DeepSpeed
  • Search

© Copyright 2020, Microsoft.

Built with Sphinx using a theme provided by Read the Docs.