Optimizers¶
- DPOptimizer
DPOptimizerDPOptimizer.accumulated_iterationsDPOptimizer.add_noise()DPOptimizer.attach_step_hook()DPOptimizer.clip_and_accumulate()DPOptimizer.defaultsDPOptimizer.grad_samplesDPOptimizer.load_state_dict()DPOptimizer.param_groupsDPOptimizer.paramsDPOptimizer.pre_step()DPOptimizer.scale_grad()DPOptimizer.signal_skip_step()DPOptimizer.stateDPOptimizer.state_dict()DPOptimizer.step()DPOptimizer.zero_grad()
- DPPerLayerOptimizer
- DistributedDPOptimizer
- DistributedPerLayerOptimizer