Revd George Lane has been married to Revd Libby Lane for 25 years and says the historic change in the Church was "a bit like a marriage - now we have to live together".
He said he toasted her appointment with a glass of Prosecco and said he was "very pleased" that his "very able" wife was the first woman into one of the Church's top roles.
"I'm very pleased for her and I'm very pleased for the Church of England. She is a very able person and brings something new," he said.
He added: "Our story represents the future of the Church of England. We met before we were ordained, when we were both students at St Peter's College, Oxford.
"And we both went through the selection process in parallel with each other.
"We were recommended for training at the same time and trained together. We were ordained together as if it were the most normal thing in the world."
He said it was important to get to a stage where his wife was just a bishop and not a female bishop.
"Normalcy will come very quickly, I think. Obviously, I think it will change the church for the better," he said.