A source has been quoted by a US celebrity magazine as saying preparation are underway for a celebration with friends and family but no date has been set.
They told People: "They've been figuring out the perfect time to do it, and they both feel like the sooner, the better. They're still figuring it out."
"They're working with the schedules of all their friends and family to make sure they can be surrounded by the people they love.
"There's no real rush. They're already legally married, but they're very excited about throwing a celebration with their loved ones."
The Christian couple reportedly tied the knot during a civil courthouse ceremony in New York City last September.
Bieber, 24, became a believer in the apartment of Hillsong pastor Carl Lentz and chose to be baptised immediately in a bath tub.
Confirming the news of his engagement to model Baldwin, 22, the singer told fans last summer that God's timing is "literally perfect".
Bieber has spoken publicly about his Christian faith, quoting Bible verses and sermons on his social media pages.
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.