DeepSpeed
stable
Training Setup
Inference Setup
Training API
Inference API
Model Checkpointing
Activation Checkpointing
ZeRO
Mixture of Experts (MoE)
Transformer Kernels
Pipeline Parallelism
Optimizers
Learning Rate Schedulers
Flops Profiler
Autotuning
Memory Requirements
Monitoring
DeepSpeed
Search
Please activate JavaScript to enable the search functionality.
Read the Docs
v: stable
Versions
latest
stable
rtd-staging
Downloads
pdf
On Read the Docs
Project Home
Builds