Andy Burnham has already made sweeping changes and promises after officially being named as the new Prime Minister.

The ex-Manchester mayor has left deputy prime minister David Lammy and Chancellor of the Exchequer Rachel Reeves out of his Cabinet, with both politicians confirming their departures on social media this afternoon.

Speaking without a lectern or notes, in a huge move away from tradition, Mr Burnham, 56, spoke for 10 minutes and used the opportunity to outline his vision for the UK. He made several vows, stressing his first action will be to set out a plan to end rough sleeping.

Minutes after this vow though, his Secretary of State for Housing, Communities and Local Government – Steve Reed OBE – quit. Mr Lammy and Ms Reeves have since said they are no longer part of Mr Burnham’s Cabinet, though no replacements have officially been named.

The new leader said: “I will bring forward a new plan for Britain, a 10-year plan laying out a path from where we are now to where I believe we all want Britain to be, wherever we’re coming from, whatever party we support. But I can do something to give people some breathing space now, some help with the cost of living.

“And I will set out some of those measures starting tomorrow, including how we pay for them. And that work starts now. I will soon go through that door behind me and issue my first instruction to end rough sleeping in our country.”

The new PM will now appoint his Cabinet throughout the afternoon, with speculation still rife surrounding the next Chancellor of the Exchequer. Peter Kyle and Liz Kendall are favourites to take the spot, but Ed Miliband has been tipped for weeks to be the next Chancellor.