Writing in the Telegraph, Dr John Sentamu explained how he's come to that conclusion.
He said: "My conscience tells me that I must vote to Remain in the European Union.
"The possibility of any kind of organised political life depends on successive generations accepting the responsibilities undertaken before them.
"This applies both to the internal stability of nations, and also to the external stability of relations among them.
"The implication of wanting to decide everything afresh in every generation is universal instability.
"If we are serious about supporting either national or international order, we shall have to be prepared to live up to inherited obligations, even if we may sometimes think that they would have been better not incurred."
While the Church of England has chosen to stay neutral on the issue, a number of bishops have spoken publically about their voting intentions.
Lord Carey, the former Archbishop of Canterbury has stated he will vote out while Lord Williams his successor has said he will vote in.
Current Archbishop of Canterbury Justin Welby has said his vote will be private.