Measure of Sparsity of Weights: Fraction of zero values vs Number of Iterations. The figure shows that fraction of zero values for the hidden layers are steadily increasing towards 1 as the number of iterations increases and finally converges to a constant range. This trend depicts that at first, model is getting more "certain" about the predictions that it is making and then finally settles down once the network has learned important features from training data.