Expand description
Learning rate schedulers for controlling the optimization process.
This module provides various strategies to adjust the learning rate during training, such as cosine annealing with linear warmup, to improve model convergence and performance.
Structs§
- Constant
Lr - Constant Learning Rate Scheduler.
- Cosine
Annealing Lr - Cosine Annealing Learning Rate Scheduler with Linear Warmup.