He met around 30 men that use the services, as well as volunteers that run the shelter which is located near St Peter's Square.
The Vatican has reported that the Holy Father spent 20 minutes or so with the group, greeting each person and having a tour of the building.
The Pope's chief alms-givers office, under Monsignor Konrad Krajewski, funded the shelter, and the nuns from Mother Teresa order operate it.
As well as the shelter, the Vatican now operates a barber shop for homeless people in the area too.