Rev Lee Banfield, from Cornerstone Church in Bromley Cross in Bolton, said he was disappointed at being the first person to leave competition, the 67-year-old failed to impress judges Mary Berry and Paul Hollywood with a drizzle cake, Jaffa Cakes or a mirror glaze cake.
He admitted he was "disappointed to be the first off" and admitted the worst moment in the competition was when Paul Hollywood said "that isn't a Jaffa Cake" when judging his attempt at a bake.
He said: "I was trying to keep a straight face so I didn't give it away that it was mine.
"I've always enjoyed baking and at church I do regular baking demonstrations. I won't show the congregation how to make a Jaffa Cake, I am not going to repeat that experience - I'll buy them a pack instead."
The church leader said he will continue to bake and do his demonstrations at church.
Earlier in the week Rev Lee Banfield told Premier that he began baking back in 1984 when he was recovering from a back injury.
He said: "I decided to make a cake while the family were out, I needed something to do whilst I was in recovery.
"So while my wife was at work and the children were at school I decided to make a cake, and I went into the kitchen and baked a lemon tart and we thoroughly enjoyed it when we had it for tea - and since then I've been baking."
Judge, Paul Hollywood said: "It's very sad, but as I've just been saying to Lee now, you are one of the 12 best amateur bakers in the country. You should be very proud of yourself."
Last year the competition had more than 15 million viewers.
