The hosts opted for all-out defence thereafter, with JP Duminy and Mark Boucher surviving for more than 20 overs before Duminy was caught at second slip off Siddle for 29.
England were 20-0 down at the break after tries from Juan Smith and JP Pietersen, and Ashton admitted his players had not done themselves any favours at all.