The leader of a Christian charity has called the comments "patronising and insensitive".
Brooks Newmark, the new Minister for Civil Society, made the comments during his first major speech.
He urged charities to steer clear of political campaigning, arguing that is not what the public gives them money for.
It comes as the Charity Commission is consulting on plans that would require charities to say how much they spend on campaigning.
Mark Russell is the CEO of Christian charity 'Church Army', which works for social justice.
He told Premier he's invited the minister to come and see the work of his charity 'first hand': "I would urge him to say, 'look: I'm sorry, I've caused some offence. I probably shouldn't have said that'
"And then I would encourage him, before he opens his mouth again, to go and spend a few days out in various charities and seeing the great work they do".
He added that donors can "easily" see how the charities they support are spending their funds.
Mr Russell claims that charities, in particular Christian ones, play a vital role in campaigning for change:
A Monthly Gift Of $11 Makes A World Of Difference
In a world of fake news there’s never been a greater need for quality Christian journalism. Premier’s mission is to provide the Church with the most up to date and relevant news, told from a Christian perspective. But we can’t do it without you.
Unlike many websites we haven't put up a paywall — we want to keep our journalism free at the point of need and as open as we can. Premier’s news output takes a lot of time, money and hard work to produce. No one in the USA is sharing news like we are across radio, magazines and online so please help us to continue that today.
For a monthly gift of $11 or more we’d also be able to send you a free copy of the brand new Premier Bible, a wonderful Anglicised version of the NLT packed with exclusive bonus content, reading plan and resources to help you get the most out of scripture.
Your monthly support will make a world of difference. Thank you.