After an early scare when Garry Wood clipped the outside of the post, Berwick cut open the Elgin City defence with a superb goal from Kevin McLeish after Dave Murie and Gareth Hutchison set him up.
McLeish then hit the bar, Ian Little was inches wide with a shot before Kieron Renton saved well from Robbie Arthur's header.
Elgin, who had defended well from the start, began to exert pressure in the second half and Craig Coyle stopped a Martin Johnstone shot on the line.
It was Wood who created a late equaliser in 79 minutes. His fierce shot was well saved by Coyle but, still lying on the ground, the big striker swung his leg, sent the ball across goal and Johnstone finished it off.
In the closing minutes Berwick fought hard and from a flowing move down the left the ever dangerous McLeish sent a swerving shot wide of the far post.