The freeze also prompted the resignation on Thursday of Adult Care and Support cabinet member Armand Toms because of the effect it could have on his portfolio.
The dispute arose after Mr Orszag asked cabinet agencies to prepare two budgets one with the administration's requested spending freeze, and one which would cut spending by 5%, which is much closer to what will probably be needed.