The prince, 36, is the third in line to the Swedish throne behind his elder sister Crown Princess Victoria and her three-year-old daughter, Princess Estelle.
The Swedish Gospel artist Samuel Ljungblahd performed the popular Christian song at the wedding as the royal pair walked down the aisle following their nuptials.
Members of the congregation can be seen clapping and dancing as the couple leave the church.
Lyrics include "God of glory, Lord of love; hearts unfold like flowers before thee."
The ceremony took place on Saturday and has been described as one of Europe's most glamorous weddings.
Guests included Britain's Prince Edward and Sophie, Countess of Wessex,
Watch the performance at the royal wedding here: