The number of people out of work between January and March dropped by 35,000 to 1.83 million.
Paul Archer from Christian charity Christians Against Poverty told Premier these figures are great but that the long-term unemployed need extra support.
He said: "It's just difficult for people.
"The experience of being unemployed is one of just of applying for work and constantly getting told that the things that you put in your CV, the things that you put on your application form, they're not good enough - the employer's not convinced.
"But actually it's not like that, it's often there just aren't enough jobs available for people and there's somebody else who's slightly more qualified and things like that, so those people, they really need the support of a loving community, a Christian community is such a helpful thing for people.
"They need support and care, and a loving community and that is something that churches are uniquely placed to provide."
This is the smallest reduction in unemployment for almost two years - but new employment minister Priti Patel says she expects it to fall further.
Listen to Premier's Hannah Tooley speak with Paul Archer:
