The Nigerian Red Cross said the man attempted to access ECWA church in Gombe on a motorbike but was restrained.
He then set off the bomb killing himself and injuring eight others.
Worshippers were gathering for their annual New Year service at the time of attack.
A local resident was quoted by AFP: "He insisted on riding through the barrier.
"It was while he was arguing with the volunteers that his suicide belt exploded."
No group has claimed responsibility for the attack although terrorist group Boko Haram is currently waging war on Christian areas as it attempts to make Nigeria an Islamist state.
This is the second attack in the last few days in Gombe. The city's military barracks were also hit by a suicide bomber.
Nigerian President Goodluck Jonathan spoke earlier this week of his desire to stop these attacks.
He said he wanted to re-equip and re-position the armed forces to win the ongoing war.
"We will bring justice to the savage terrorists known as Boko Haram. They will be defeated," he said.
"We will not forget. We will not look the other way."