Rev Adamu Gyang Wurim and his family died after their home was set alight less than 24 hours after the Christian Association of Nigeria (CAN) Northern region, ended a two-day peace summit in the state's capital Jos.
The family's church was also burnt down; with a further three people being killed in village attacks nearby.
The Chairman of the Berom Youth Movement, Thomas Tsok, told the New Telegraph in Nigeria that the attackers armed with machetes and AK47 rifles invaded a village at about 8pm, shot sporadically and burnt houses.
He said: "They first shot at two young men walking out of the village where they had gone to charge their phones in the pastor's house, killing one and wounding the other."
According to Christian Solidarity Worldwide, Fulani militia-related violence has been escalating since 2015, with the central states of Nigeria - and particularly Adamawa, Benue, Nasarawa, Plateau, Taraba and southern Kaduna - experiencing cyclical violence.
In a statement, Istifanus Dung Gyang who is a member of the House of Representatives for the Barkin Ladi/Riyom Federal Constituency, condemned the killings.
He said: "There has been the sustained malicious destruction and mowing down of crops on farms in many villages aimed at strangulating the communities economically as farming is their main economic activity.
"The unfortunate thing is that the perpetrators of these attacks continue to execute their agenda with reckless abandon without an appropriate response by government.
"Until decisive action is taken by the Nigerian government against the killer herdsmen to stop the ethnic cleansing and land grabbing, the presumption is simply that of acquiescence and complicity for which the government shall one day, be held accountable for crimes against humanity, ethnic cleansing and genocide."
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.