Both teams have struggled so far this season and prior to kick-off propped up the Guinness Premiership table, with Gloucester just above bottom-placed Leeds.
The win puts Celtic within a point of Rangers at the top of the table, after the Ibrox side drew with Inverness Caledonian Thistle in the later kick-off.