Shelter says around three million are generally cutting back on food to save cash.
They spoke to a women who only wanted to be identified as Katherine.
"My husband and I don't have breakfast because we can't afford it, and we miss evening meals two or three times a month to help with the mortgage," she said.
She added: "We've really had to cut back on the basics, and I even had to send our daughter to school in an old uniform that I knew was too small; it made me feel horrible.
"We are already at breaking point, so I honestly don't know what we'd do if our financial situation got worse, it really frightens me."
Campbell Robb, chief executive of Shelter, said: "No parent should be forced to choose between putting food on the table and paying for the roof over their children's heads.
"These shocking figures show that millions of us are having to make these kind of agonising choices every day.
"We desperately need the Government to make sure there is a safety net that's strong enough to catch families who fall on hard times and stop them from going through the tragedy of losing their home."
Director of Projects at Christian charity Housing Justice, Alastair Murry, told Premier's News Hour the recession is still having an impact.
He said: "It doesn't surprise me. We hear a lot of stories from the churches in our network of increasing need of families struggling to pay bills.
"Even families that up until recently have felt fairly secure and comfortable are suffering."
Hear more from Alastair Murry here: