Bury lead Swindon Town 1-0 at half time in their League One clash at Gigg Lane.
Tom Pope rose highest to head in from a right-wing Joe Riley cross to give the promoted side the lead after four minutes.
Immediately following the Shakers' opening goal, Leon Clarke almost increased their lead but fired wide from close range.
Another Joe Riley cross was caught by Swindon keeper Lawrence Vigoroux as Bury continued to attack.
Bury then missed a penalty as Clarke hit the post from the spot, following a Vigouroux foul on the striker.