He's put down an Early Day Motion claiming that parliamentary prayers are "not compatible with a society which respects the principle of freedom of and from religion".
The practice is believed to have started in 1558.
In the Commons, the speaker's chaplain normally reads the prayers. The main prayer asks for God's guidance that MPs "never lead the nation wrongly through love of power, desire to please, or unworthy ideals".
In the House of Lords, one of the Church of England bishops takes a lead.
There have been numerous calls for a rethink to the prayers over the years.
This latest call comes with the backing of four other MPs and the National Secular Society (NSS).
NSS chief executive Stephen Evans said: "Religious worship is for individuals who choose it - not for nations or legislative bodies.
"Members of parliament are of course free to pray in their own time, but institutionalised prayer doesn't belong in the legislative process. Parliament should reflect the country as it is today.
"Ending this anachronism would be tangible example of the reform needed in the house and represent a positive step forwards for modernity, equality and freedom of conscience."
An early day motion is a formal proposal calling for a parliamentary debate on an issue at the earliest opportunity, but rarely does it achieve that.
It's known more as a tool to raise awareness over a particular issue.
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.