In his last day in the job before the party reveals its new leader in Bournemouth on Friday, Nigel Farage told Sky News: "It's a great shame isn't it that the head of our established church is not actually prepared to stand up and fight for our Christian culture in this country.
"He's somebody else who should go too."
Mr Farage and Most Rev Justin Welby have previously been involved in disputes over immigration.
Earlier this year Most Rev Welby accused Mr Farage of "legitimising racism," "accentuating fear for political gain" and "inexcusable pandering to people's worries and prejudices".
The Archbishop's comments came after Mr Farage said earlier this year that Britain would experience mass sex attacks on women like the ones which happened in Germany on New Year's Eve if it let in similar numbers of migrants.
Mr Farage said at the time that Mr Welby was "prepared to turn a blind eye" about the situation and highlighted that the Catholic Archbishop of Germany, Cardinal Reinhard Marx, said the sex attacks "can in no way be tolerated".
Premier has contacted Lambeth Palace, which says it is not commenting on Mr Farage's statement.
Speaking after the election of Diane James, the former UKIP leader said he would support her in her new role but had "done his bit."
Jonathan Arnott, UKIP MEP and Christian, told Premier's News Hour Diane James has a challenge ahead of her.
He said: "It's a time for her to show her ability to unite rather than divide, an ability to work together will all sides of the party to make sure we continute to be a credible and effective fighting force to move forward into future elections."
He told Premier that UKIP is not redundent after voting to leave the European Union (EU)
"Of course there's a massive role to play for UKIP in shaping that future deal and making sure that Brexit actually means the thing that people are voting for when they decided to leave the European Union."
"There's a huge, huge role ahead for UKIP - whether it's talking on issues like crime that's blighting family working class communities, whether it's talking about a fair and reasoned policy on immigration or whether it's talking about excellence in our education system."
Listen to Premier's Aaron James speak to Jonathan Arnott here:
