The current code for Learning Rate Scheduler is dependent of the initial learning rate manually provided by the user.
There is a need for some sort of Learning Rate Scheduler that tries different initial learning rates to figure out the most optimal one.