Most Revd Justin Welby visited Mahama camp in the Kibungo Diocese on Sunday, where almost 50,000 refugees - mostly from neighbouring Burundi - have fled.
The Archbishop of Canterbury and the Archbishop of Rwanda, Rt Revd Onesphore Rwaje, toured the camp and then held a special a service for those living there.
Burundi Facts:
War began 2015 - the worst crisis since the end of a civil war in 2005
Started after CNDD-FDD party said incumbent President of Burundi, Pierre Nkurunziza, would run for a third term in the 2015 election
One of the world's poorest nations
Trying to emerge from a 12-year, ethnic-based civil war
Tensions between the usually-dominant Tutsi minority and the Hutu majority
Population: 10.4 million
Mahama Camp is the UNHCR's most recently created camp in Rwanda.
It has been open four months and has already become the country's largest camp.
The archbishop's tour of Mahama camp followed a three-day visit to Burundi.
During his trip in Burundi the archbishop showed solidarity with Anglicans and prayed for peace and reconciliation in the conflict-torn nation.