Lord Carey is a former student of King's College London, which has a picture and biography of him on their Strand campus building along with other famous people to attend the university.
However gay rights activists have called for his picture to be removed, because Lord Carey previously said "same sex relationships are not the same as heterosexual relationships and should not be put on the same level".
Lord Carey told Christian Today: "My greatest concern is what this says about the status of free speech in the universities especially in a period when it is under exceptional attack.
"I would imagine there is considerable diversity of views on same sex marriage among the alumni of King's, yet the great values of this institution, like other universities, is that different views are listened to, argued with and respected and the human rights of all are upheld, including those of the lesbian and gay community."
The campus building on Strand with Lord Carey's picture and biography is one of several which is set to be demolished and redeveloped subject to planning permission, meaning there's potential for a new set of alumni to replace the current pictures.
King's College London's LGBT student council officer Ben Hunt, who was involved in a two-year campaign to have Lord Carey apologise or have his window removed, told the university's newspaper: "The [university] principal has asked me to compile a list of new alumni for the window in suggestions.
"[This] will also mean the removal of Lord Carey and the inclusion of minorities in the discussions for new alumni."
A spokesman for King's College London said: "It is likely, subject to planning approval, that the proposed redevelopment of the Strand campus will require a review of the Strand windows and we will consider the diverse views of our students, staff and alumni at the appropriate time."