Rev Scott Burton from Matthew's Church in Perth delivered an address on Saturday afternoon at the city's first ever Perthshire Pride event which celebrates LGBT identities.
He was quoted by Dundee-based The Courier newspaper as saying: "I am absolutely over the moon to be invited to open this fabulous occasion, it is an incredible honour.
"I will be taking the opportunity to apologise to members of the LGBT community if they have felt hurt, insulted and ostracised from the Church of Scotland.
"Forgive us for all the pain we have caused you and which we continue to inflict on you".
Rev Burton, who is thought to have become the first Church of Scotland minister to ever officially open a pride event, said all LGBT people were welcome at his church.
"If we do not have love, we have nothing." Perthshire Pride is officially opened by Rev Scott Burton! pic.twitter.com/FbMT0RReP7
— Lauren Aitchison (@devilwrstartan) August 11, 2018
Last year, the Church of Scotland leaders approved an apology to gay people "for the history of discrimination they have faced in the Church".
They also approved a controversial report which could pave the way to allow some ministers to conduct same-sex marriages in the future.
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.