He's been given the job after the resignation of Baroness Warsi yesterday.
She quit after criticising the government's position on the crisis in Gaza.
Lady Warsi was the first female Muslim member of the Cabinet when the coalition came to power four years ago.
She's been the Minister for Faith and Communities and Senior Minister of State for Foreign and Commonwealth Affairs since 4 September 2012.
Speaking to Premier last month she said an important part of her role was raising the profile of faith in society: "One of the first speeches that I gave in government was that this government would do God.
"For me I fundamentally believe that faith is the basis of good work and faith communities can be used to be part of the solution rather than to be painted as part of the problem which we tragically see too often."
Mr Pickles, Conservative MP for Brentwood and Ongar, will take up the role immediately.
He's tweeted:
This Govt is standing up for the role of faith in public life & actively supporting the good work of faith groups
He also tweeted a picture from the Department for Communities and Local Government: