The men were killed in the Mahwit region when a bomb carried by one of them exploded "by accident".
It was unclear why the man had the bomb outside a Shiite mosque, many of which have been targeted by Sunni jihadists during this year's conflict in Yemen pitting the Huthis against government forces.