The group posted passport pictures of the men on social media and said they were from Egypt, Nigeria and Ghana.
Sources suggest they were taken in an area of the city of Sirte, an IS stronghold in the country.
There has been no demands of ransom for the men and it's unclear what the groups intentions are.
In January Islamic State kidnapped 21 Egyptian Christians in Libya.
Later, in April, the group released two videos showing the murder of 30 Ethiopian Christians in Libya.
15 of them appeared to be beheaded on a beach, whilst the other 15 were shot in the head in a desert.
It's feared IS is spreading its influence further than its strongholds in Syria and Iraq.