The Rt Rev Michael Scott-Joynt was the area's bishop between 1995 and 2011, and was known for his traditionalist stance on gay relationships.
Having retired from the role, he became an honorary assistant bishop in the diocese of Portsmouth.
He is survived by his wife Louse, two sons and a daughter.
Justin Welby said: "In the death of Michael Scott-Joynt the Church of England has lost a faithful, hardworking and distinguished servant."
He added: "He was a person not afraid to say what he believed, even when he knew those views might not be popular. But all this he did from his deep faith, and after much careful prayer.
"Sadly, he did not have a long retirement, and in much of it he suffered illness. But characteristically, he would come to events when he could, where his presence was always welcomed.
"He enjoyed a wonderful marriage and Lou was at his side when he died. To her and to daughter Hannah and sons Matthew and Jeremy and all the family I offer deepest sympathy and prayers, which will include prayers of deep thankfulness for this faithful servant of Jesus Christ."
The current Bishop of Winchester, Rt Rev Tim Dakin, said: "Michael led this diocese with great integrity, both through his ministry and his strength of personality.
"I had the joy of working with him on a number of occasions before his retirement and then it was an honour to follow in his footsteps as Bishop of Winchester.
"Michael was a true servant for the Church of England at home and for the wider Anglican Communion abroad, particularly in Africa. He will long be remembered in our parishes and his presence sorely missed.
"Our prayers at this difficult time are with Lou and the family."