Convergence can be defined as a state achieved by the machine learning algorithms where the loss (the difference between the true value from the data set and the predicted value) is very minimal and change is almost non-existent with each iteration.