MPs also called for those who do not pay their "fair" share to be named by the government, but Prime Minister David Cameron and Chief Secretary to the Treasury Danny Alexander ruled it out, saying it would breach taxpayer confidentiality.
Mr Alexander, meanwhile, made his apology ahead of Prime Minister's Questions, where Tory leader David Cameron described the mishandling of the Scottish elections as a "scandal".