All modules for which code is available
- deepspeed
- deepspeed.moe.layer
- deepspeed.ops.adam.cpu_adam
- deepspeed.ops.adam.fused_adam
- deepspeed.ops.lamb.fused_lamb
- deepspeed.ops.transformer.transformer
- deepspeed.profiling.flops_profiler.profiler
- deepspeed.runtime.fp16.onebit.adam
- deepspeed.runtime.fp16.onebit.lamb
- deepspeed.runtime.fp16.onebit.zoadam
- deepspeed.runtime.lr_schedules
- deepspeed.runtime.pipe.engine
- deepspeed.runtime.pipe.module
- deepspeed.runtime.pipe.schedule
- deepspeed.runtime.pipe.topology
- deepspeed.runtime.zero.stage3
- deepspeed.utils.distributed
- deepspeed.utils.zero_to_fp32