According to the Daily Telegraph, Peter Hopkins had been musical director of the choir at St Nicholas Church in leafy Harpenden, Herts, for six years.
However, he felt he could no longer stand up to people who didn't agree with the notion that everyone can join the choir, even if they can't sing well.
He told the paper that some "ringleaders" had joined the choir who thought more talented singers should have the limelight.
A source close to the choir told the paper that there had been an "influx" of members between the ages of 35 and 40 whose behaviour had raised eyebrows during choir practises.
Hopkins said: "I think they (the choir ringleaders) have generated difficulty and I don't think that the way they have operated is very generous towards older people who come to the choir to enjoy it - not to have a whole lot of aggravation."
Rev Canon Dr Dennis Stamps, the rector of St Nicholas Church told the local newspaper he was "sad" about Mr Hopkins leaving the choir.
