Christian Solidarity Worldwide said six bombs were found in the toilet of Evangelical Church Winning All (ECWA) in the area of Tudan Wara, before the Sunday service.
Four of the explosives were detonated by the militants, one exploded when it was thrown over a fence, and the bomb squad diffused the final bomb.
CSW said that as of earlier this month around 850 churches had been destroyed by Boko Haram in the north of Nigeria.
Boko Haram has also said in a video it would continue to attack Christians, Jews and the security forces
Mervyn Thomas, Chief Executive of Christian Solidarity Worldwide, said: "We are struck once again by the senseless violence of an international terrorist group that appears once again to be able to strike at will, murdering civilians in four nations in a cruel and unrelenting manner.
"Despite its pseudo-religious pronouncements, with every atrocity Boko Haram illustrates it is no more than a death cult that indoctrinates members to kill without conscience, regardless of the creed espoused by its victims."