All modules for which code is available

• deepspeed
• deepspeed.moe.layer
• deepspeed.ops.adam.cpu_adam
• deepspeed.ops.adam.fused_adam
• deepspeed.ops.lamb.fused_lamb
• deepspeed.ops.transformer.transformer
• deepspeed.profiling.flops_profiler.profiler
• deepspeed.runtime.fp16.onebit.adam
• deepspeed.runtime.fp16.onebit.lamb
• deepspeed.runtime.lr_schedules
• deepspeed.runtime.pipe.engine
• deepspeed.runtime.pipe.module
• deepspeed.runtime.pipe.schedule
• deepspeed.runtime.pipe.topology
• deepspeed.runtime.zero.stage2
• deepspeed.runtime.zero.stage3
• deepspeed.utils.distributed
• deepspeed.utils.groups
• deepspeed.utils.zero_to_fp32