The first of Cramb's goals came in the 18th minute when he beat the offside trap and tucked a John-Paul McBride pass through Elgin keeper Kieron Renton's legs. Elgin's James McKenzie was booked for his protests over this goal.
On the stroke of half-time, Cramb glanced a McBride cross into the net to make it 2-0. The game continued with Stenhousemuir on top until Elgin's Hugh Dickson was dismissed for a second yellow card.
Stenhousemuir eased off after this and let Elgin back into the game, and Mark Booth should have scored twice against his old club before Patrick Scullion reduced the deficit in the 68th minute.
Elgin pushed for the equaliser and were denied on several occasions by home keeper William McCulloch before the home side scored with a counter attack when Jim Mercer headed home Stenhousemuir's third and final goal.