Archbishop John, who's also the Bishop of Swansea and Brecon, was elected on Wednesday.
Speaking about what he will personally bring to the new role, he said: "People often describe me as being surprisingly quite normal, an ordinary human being, but somebody who's got a particular role to play.
"So I would hope that I would be able to demonstrate to people through what I might call my own ordinariness that the Church is a place for everybody."
Archbishop John said he thinks the biggest challenge that lies ahead is the decline of evangelism in the church.
"I don't think we need to be downhearted about that because every challenge can be viewed as an opportunity," he said.
"I think we've got a great opportunity to help people understand better what the Church is meant to be. [It's] an agent for change, and an agent for creating cohesive supportive loving communities.
"[It's] not just an institution that gives some people something to do for perhaps an hour on a Sunday. We've got a mission."
Archbishop John said that he hopes his legacy in the new role will be revamping the Church's evangelistic role.
He said: "We need to rehabilitate our role, we need to rehabilitate our evangelism and we need to rehabilitate ourselves to be more effective in our teaching and in our mission. If I can play a small part in that I'd be very happy to have done so."
The Archbishop will continue to hold his position as the Bishop of Swansea and Brecon which he has held for nine years.
He said he doesn't believe his new role will hinder the work he does in his own diocese. He added that bishops in the Church in Wales are close-knit and he plans to use a "shared leadership" strategy to ensure goals are accomplished in the Church.
Listen to Most Rev John Davies, Archbishop of Wales speaking with Premier's Tola Mbakwe here: