New signing Matt Maclean made his debut playing off Ryan McBride, while there was also a first start for Andy Corrigan at right back.
United took a sixth minute lead through Ryan McBride after the Taylors work on the right, but Common equalised just seven minutes later after a 30-yard shot from the Dom Bristow that left Grant Young with no chance and went in off the crossbar.
Shaun Loft had a goal disallowed for offside towards the end of the first half, while Common midfielder Sam Brown rattled the underside of the crossbar with an effort from outside the box 12 minutes into the second half.
McBride spurned a golden opportunity to restore the lead on 65 minutes as he blazed a penalty over the crossbar after Taylor was fouled inside the area by Jerome Smith.
The home side hit the front nine minutes later as Jamie Crone lashed home a left-footed shot into the corner of the net from the edge of the box.
Common couldn’t hold on though, as Taylor buried a McBride lay-off into the corner from inside the box.
Loft was a whisker away from nabbing an injury time winner when he shot just wide following a Casey Ham corner