Module lr_scheduler

Learning rate scheduler module.

Modules

constant

Constant learning rate scheduler

cosine

Cosine learning rate scheduler

exponential

Exponential learning rate scheduler

linear

Linear learning rate scheduler

noam

Noam learning rate scheduler

step

Step learning rate scheduler

Traits

LrScheduler

Learning rate scheduler defines how the learning rate will evolve during training.