Inappropriate selection of learning rate value in gradient descent gives rise to:
A. Local Minima.
B. Oscillations.
C. Slow convergence.
D. All of the above.
Answer:D
Inappropriate selection of learning rate value in gradient descent gives rise to:
A. Local Minima. B. Oscillations. C. Slow convergence. D. All of the above.
Explanation: The learning rate decides how fast or slow our optimizer is able to achieve the global minimum. So by choosing an inappropriate value of learning rate, we may not reach the global minimum; instead, we get stuck at a local minimum and oscillate around the minimum, because of which the convergence time increases.