The Canadian singer, who identifies as a Christian, performed one of the commonly sung songs in churches around the world with only his guitar in front of thousands of fans.
He sang 'I could sing of your love forever' by Martin Smith on the Paris leg of his 2016 Purpose tour on Monday evening.
Martin Smith, who performed with the group Delirious, later tweeted a link to the song.
Ha!— Martin Smith (@MartinSmithTV) September 21, 2016
Justin Bieber rocking out one of my old tunes. @ Folies Bergère https://t.co/QsZEdQjhtA
Justin Bieber has spoken about his Christian faith in the past. Before deleting his Instagram account he often quoted Bible passages to his millions of followers.
The star also got a small cross tattooed on his face, by his left eye, earlier in 2016.
He has previously caused controversy over his comments saying that sometimes "Christians leave such a bad taste in people's mouths."
The star who was often seen in the media getting into trouble in his teenager years, returned to faith under the guidance of mega church pastors Carl Lentz and Judah Smith.
He has since attended worship all over the world and regularly speaks about his pastors' influence on his life.