deepspeed.init_inference() returns an inference engine of type InferenceEngine.
deepspeed.init_inference()
InferenceEngine
for step, batch in enumerate(data_loader): #forward() method loss = engine(batch)