The Christian entertainer is working alongside Paul Gambaccini and Nigel Evans who have been accused of and cleared of sexual assault in the past.
Last month Sir Cliff was cleared of sexual assault charges against him.
The three men met in Surrey on Sunday to discuss plans to set up a group to highlight the "unnecessary pain and suffering" they have been through.
Paul Gambaccini was arrested as part of Operation Yewtree in 2013 and told no charges would be brought in 2014.
Nigel Evans, former deputy speaker, was acquitted of nine charges of rape and sexual assault in 2014.
He told The Daily Telegraph: "We have got common ground, but there are also a load of other people we have common ground with... some are famous before it happens, others become famous because of it... And if can do what other countries can, why don't we just get on with it?"
He also said that the group plans to make contact with others who have been through similar ordeals.
As it stands the law protects the alleged victim of sexual abuse for life, the alleged abuser can be named publicly.
