By a novel approach, we present some new criteria for the exponential stability in mean square of solutions of non-linear stochastic difference systems with time-varying delays. A discussion of the obtained results is given. Illustrative examples and simulations are provided.