Demonstrators wore the Indonesian flag colours of red and white, and sung the national anthem inside the courtyard of the city hall.
To the dismay of his supporters (below), Basuki Tjahaja Purnama was jailed after being found guilty of blasphemy against Islam, despite prosecutors recommending probation.
The acting governor of Jakarta, Djarot Saiful Hidayat was quoted by the AFP news agency as encouraging the crowd, saying: "Let's fight for justice."
The 50 year old's verdict has met concern from the European Union and the United Nations, whilst Amnesty International claimed it would "tarnish Indonesia's reputation for tolerance".
Purnama is the first ethnic Chinese leader of Jakarta and the city's first Christian governor for 50 years.
Hidayat added: "Last night I met with Ahok and he wants me to convey this message: 'We have to respect whatever the judges have decided, but the fight is not over yet'."
Some Islamic hardliners protested on Tuesday (above), some angry that he was not jailed for the maximum five year prison term.
The blasphemy allegations are linked to comments Purnama made last year where he accused rivals of using the Quran to deceive people into not voting for him.