What counts is that you did start stacking.
You're ahead of the curve over the 98% who don't have physical silver in their possession. You are conservatively cautions, good. It's better to be cautious having sufficient funds available to cover emergency needs than to prematurely buy too much only to sell them too soon for a loss.

!PIZZA