Items taken included laptops, however the safe was dumped with church records and left in the church car park.
Revd Mark Greenway-Robbins told The Sun that the raid was "very upsetting."
Mike Todd, a worshiper at St Martin's Church in Caerphilly said that the theft was "despicable."
He said: "It's a harsh act, breaking into a church on Christmas Day."
