@yoshinat0r It’s only a problem if it is a problem for you.
It might become a problem eventually if it’s the only way they can get to sleep (and hence, back to sleep in the night) or if they don’t develop other ways to soothe when your nipple isn’t available.
But - it also very well might...