DeepSpeed
  • Training Setup
  • Inference Setup
  • Training API
  • Inference API
  • Model Checkpointing
  • Activation Checkpointing
  • ZeRO
  • Mixture of Experts (MoE)
  • Transformer Kernels
  • Pipeline Parallelism
  • Optimizers
  • Learning Rate Schedulers
  • Flops Profiler
  • Autotuning
  • Memory Requirements
  • Monitoring
DeepSpeed
  • Python Module Index

Python Module Index

d
 
d
- deepspeed
    deepspeed.profiling.flops_profiler.profiler
    deepspeed.runtime.pipe.engine
    deepspeed.runtime.pipe.schedule

© Copyright 2020, Microsoft.

Built with Sphinx using a theme provided by Read the Docs.