The visitors started the better and maybe should have had a penalty in the ninth minute when the ball bounced up and seemed to strike defender Hugh Dickson on the arm.
In a very boring first half, the next chance took place in the 41st minute when Ian Little cut inside to blast inches wide. Goal-less at half-time and with Elgin just managing to hold out.
The next 45 minutes was worth the entry fee alone, and it only took the visitors two minutes to take the lead. Good work down the right by Robbie Arthur produced a great delivery for Kevin Hales to head home.
This seemed to give Elgin a wake-up call, and 10 minutes later they were level. A great delivery from Adam Nelson was met by the head of in-form striker Martin Johnston, and he made no mistake from six yards.
In the 62nd minute Berwick were fortunate not to be reduced to 10 men after a blatant kick out from Robbie Arthur only resulted in a yellow card.
The home crowd was fantastic all day and spurred Elgin on. Another great delivery from Adam Nelson was this time met by the head of former Celtic and Dunfermline man Pat Scullion, who headed home past Berwick keeper Gary O'Connor.
Elgin looked sure to take three points when substitute Bruno Da Silva's reckless challenge on Paul Napier left referee Willie Hornby no choice but to send the Berwick man off.
With the clock on 90 minutes all Elgin had to do was hold out, but a good run into the box from Kevin McLeish was halted by the trailing leg of Iain Vigurs and the spot- kick was awarded. Elgin felt hard done by, and Kevin Haynes slotted home from 12 yards to leave Elgin still winless at Borough Briggs.