Seeking Sanctuary, which has been assisting individuals living in or near the port town, has been speaking after the French president announced the settlement would be shut down by the end of the year.
Speaking on Premier's News Hour, Ben Bano from Seeking Sanctuary said: "The fact there will be better conditions is a helpful one but we do have several concerns.
"These people could be dispersed to very remote parts of France, maybe in disused barracks, with a hostile local population. They are going to find it very, very difficult, particularly, to keep in touch with family and friends."
Making his first visit to Calais as President, Francois Hollande (pictured) said his government was planning to "completely" dismantle the Jungle, which currently homes around 9,000 people.
Residents failing to apply for asylum would be deported, while others would be moved to reception centres across the country for four months while their cases are processed.
Ben Bano went on to say: "When they cleared half of the Jungle (in February 2016) what we saw were mini Jungles created all the way from Calais to the Belgian border.
"Now, the French have been saying they won't allow this but people are resourceful.
"We think what we're going to have is a situation where people are going to be sleeping in even more squalid conditions, putting their lives at risk, still trying to get onto lorries or whatever it might be.
"Although this sounds like a simple solution, we don't think it's the end of the story."
Meanwhile, President Hollande also said Britain must "play its part" in handling the migrant crisis in Calais but spokesperson for Prime Minister Theresa May said the nation had done a "huge amount" already, investing tens of millions of pounds.