It's reported many carol services are using the words 'offspring of the favoured one' instead of 'offspring of a virgin's womb' when singing the Charles Wesley hymn.
London vicar Rev Marcus Walker said it was 'heretical' to play down the reality of Christ's birth.
Speaking to the Sunday Telegraph, Bishop of Crediton Rt Rev Jacqueline Searle also criticised the change.
She said: "It's important we are not squeamish about singing 'of a virgin's womb', which reflects nothing being impossible with God."
"Just because something sounds difficult or new doesn't mean it needs changing."
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.