With Kane Williamson recording his sixth straight score of 50 or more, New Zealand appeared set for a dominant total, but Cremer and Nyumbu struck at crucial times to set up an intriguing run chase.
Preferred to Prosper Utseya because of his more attacking style, offspinner Nyumbu made the initial breakthrough when he dismissed Tuesday's centurion Tom Latham.
New Zealand rebuilt to reach 100 for one in the 21st over, but Cremer's double-strike kept them in check as he had Martin Guptill caught at slip for 42 and then spun one through the defences of Colin Munro.
The New Zealand captain fell for 90 -- the fifth time this year that he has been out between 90 and 100.
It took an unbroken stand of 50 in just 25 balls to give New Zealand the late boost they required, as James Neesham finished unbeaten on 37 and Nathan McCullum struck 25 not out from 16 deliveries.
