So when does sin start up inside us? The human heart is sinful from birth. You never have to teach a child how to be naughty! Children are naturally sinful.