Peter Saunders, who as a child was abused by priests, has been an outspoken critic of the way Rome has handed allegations of abuse against clergy.
He was appointed by Pope Francis to the commission in 2014 but yesterday other members of the group voted for him to "take a leave of absence", claiming he was hard to work with.
Mr Saunders has repeatedly criticised the group but said he would not leave unless asked to do so by the pontiff.
He told Premier he had requested a one to one meeting with Francis about the issue.
"I cannot be part of something that simply accepts what is going on," he told Premier.
"Children are suffering today, there needs to be action today, the Pope could take action today.
"At the moment I suspect he won't, or is being very badly advised".
He criticised the group and said it had so far being "sitting around shuffling papers".
He said: "I am taking some time out to give thought to how I might best contribute to how we better protect our children and how the Church goes about doing that."
But he added: "I was appointed by His Holiness the Pope to the commission and until and unless His Holiness 'de-appoints' me then I remain a member of this position".
The Vatican commission on sexual abuse has 17 members and was established by Pope Francis shortly after his election.
He said it would establish "best practices" when complaints of abuse are made against priests.
Peter Saunders speaking to Premier's Antony Bushfield:
