But as he outlined plans to extend the retirement age for millions, he warned that the "job is not yet done".
He warned of "more difficult decisions" and acknowledged that the effects of the economic crash on family budgets were still being felt.
But he pledged: "The hard work of the British people is paying off and we will not squander their efforts."
He revealed that the recession had been even deeper than feared - with GDP down by 7.2% rather than 6.3% - the equivalent of £3,000 per household and one of the sharpest falls globally.
But he said that UK plc was now growing faster than any other advanced economy.
Mr Osborne said the improving economic outlook meant borrowing would be £111 billion this year - £9 billion less than predicted at the time of the Budget in March.
Overall the Office for Budget Responsibility is now forecasting that borrowing over the next five years would be £73 billion less than previously thought with a "small cash surplus" by 2018/2019.
Mr Osborne announced a new cap from next year on welfare spending but said that state pensions would be excluded.
He also promised a further £3 billion in savings in the public sector but said the NHS would be excluded.
Detailing the changes to the retirement age, he confirmed that it would rise to 68 in the mid 2030s and 69 in the late 2040s.
The announcement has already drawn criticism with unions claiming that Britons were being expected to work "until they drop".