Graham Gregory, 79, was jailed for three years after being found guilty of indecent assault on a girl under 13 years old in the late 1960s.
He was acquitted of two further counts of indecent assault following a retrial at the same court.
The clergyman was first investigated in 2012 after a woman claimed she had been abused as a child between 1969 and 1971 when she lived in Wandsworth and attended the church where Gregory was curate.
A second woman - who also knew Gregory through the same church - informed officers that she too had been abused as a child.
He denied the allegations and claimed not to know the women.
Officers believe there may be other victims at his former church in Wandsworth who are too scared to come forward.
Detective Constable Aaron Vardy, of the Met's Sexual Offences Exploitation and Child Abuse Command, said: "Gregory abused his position as a figure of trust and authority.
"It takes a lot of courage to report this type of crime and in some cases victims feel that they are only able to come forward years after the offence.
"This conviction highlights that regardless of how much time has passed, we remain committed to bringing offenders before the courts.
"I would urge anyone else who may have been a victim of Gregory's abuse to make contact with the police."
As well as working as curate in Southfields, Wandsworth, Gregory also held positions in Hastings, Chichester, York and the Isle of Man as a vicar.