A special two-day conference trying to promote respect began on Wednesday in London.
Faith leaders, security experts and NGOs said that inclusive societies, where people are free to worship, are key for a non-violent world.
They stressed that "freedom of religion or belief is a key human right," but admitted "it is a sensitive issue in many countries."
Baroness Anelay, Minister of State for the Commonwealth and the UN at the Foreign and Commonwealth Office, told Premier's News Hour leaders who rule using religion to divide people cannot continue.
She said: "It is going to be a long struggle for them but it's worth it.
"In this country, it has taken some centuries for us to reach the position we're now in where we have diverse and inclusive societies.
"So the pace of change can be different but we can support not only governments, but we can work with communities."
Faith leaders from different backgrounds came together to discuss how relationships can be strengthened and what practical steps can be taken to bring communities closer.
80 per cent of world describes itself as religious and the Baroness said: "Freedom of religion or belief itself and respect is usually a bellwether to see whether you have a secure society but all those countries around the world who are members of United Nations who signed up to Article 18 have already signed up for freedom of religion or belief.
"They need to keep to their promise."
Leaders also said that vulnerable people need to be lead down alternative paths to avoid them being tempted by religious violence.
Baroness Anelay said the British government can help stop recruitment to groups like Boko Haram and Islamic State by ensuring the communities on the ground have opportunities and education so they are able to have other options.
"We'll strengthen the communities to resist that in practical ways in which we can support communities so that young people grow up in a way that they're not going to be attracted into this perverted form of Islam - they're going to be able to grow up and respect difference," she said.
Listen to Premier's Hannah Tooley speak to Baroness Anelay here:
