Labour’s most high-profile billionaire backer, who switched allegiance from the Conservatives, has said he is “increasingly nervous” about the government’s direction and is in “despair of politicians”.

John Caudwell, the Phones 4u founder, said Labour’s winter fuel payments cut was a “fiasco” and ministers were not doing nearly enough to attract investment into the UK.

Caudwell, who has pledged to give away more than 70% of his £1.58bn fortune, said a wealth tax would be “very destructive” to growth.

The businessman – a prominent Brexit supporter who backed the Conservative party for many years – said he could never support Nigel Farage’s Reform UK because he was convinced of the need to tackle the climate crisis and urged Labour to be bolder on net zero.

Caudwell was speaking at the launch of a report from his charity Caudwell Youth, urging more investment in early intervention in the lives of disadvantaged young people and a renewed focus on mental health.

He said despite his own background in mobile phones, he believed social media and AI were a “disaster” for anxiety and feared a world where AI fakes were the norm.

Caudwell said he welcomed some important changes from Labour, including to pension funds, planning changes and green energy, though he said schemes such as Great British Energy could go further and were “lacking in ambition”.

He said Labour had been poor at telling the right story and the winter fuel saga and the welfare rebellion had been unnerving. “They’re just going to be tossed from pillar to post, that’s how it feels,” he said.

“I am becoming increasingly nervous about what Labour are doing and especially when they get into this mess over the welfare bill because it feels as though there’s anarchy within the party.”

Caudwell said he had repeatedly offered advice to Keir Starmer and Rachel Reeves, but had not received much interest in his ideas. “There seems to be a lack of that commercial intellect that we desperately need in government to make long-term right decisions,” he said.

He said he knew many wealthy individuals and business owners moving to Dubai or Monaco, and that the UK needed to become a more attractive place to invest.

“I despair of politicians in general,” Caudwell said. “You’ve got to attract inward investment to create high-paid jobs and in technology, sciences and especially in the environment, since that’s going to be the absolute future of mankind.

“There’s so much we need to do and there’s so little we do, and that was the Conservative party before and now it’s the Labour party.”

Caudwell said he did not regret switching his allegiance from the Conservatives, having previously donated £500,000 to them under Boris Johnson. “I don’t regret it. But do I regret some of the decisions they’ve made? Absolutely I do. And I think they could have done so much better.”

Senior Labour figures have suggested the party should introduce a wealth tax on rich people in the budget. The former Labour leader Neil Kinnock said on Sunday such a gesture “in the direction of equity fairness would make a big difference”.

But Caudwell said a wealth tax combined with other measures Labour had introduced would be a major disincentive for investors, even if he would personally be happy to pay.

“I would be very in favour of a wealth tax if it was global,” he said. “The rich-poor divide is the evil of society and how do we fix that?”

But he said that changes to agricultural property relief, changes to workers’ rights and increases to the minimum wage and employers’ national insurance was creating a more difficult climate for business.

“I think you can do some of those things, but you just can’t do everything,” he said. “You introduce a wealth tax on top of that and it just isn’t going to work. I know people that are leaving as we speak. They’re going to Monaco, they’re going to Dubai.

“I bet 10 people in the last three or four months have said, ‘Why don’t you go to Dubai?’ Well, I don’t want to go to Dubai, I’m British, I love it here. I don’t mind paying my taxes.

“I want to influence rich people to do more philanthropically and to pay taxes. A wealth tax would be very destructive on top. I don’t say that because I’m trying to protect my money – because I’m giving it away.”

Caudwell said Starmer should be bolder in his second year as prime minister. “I’d be a bit like a [version of] Trump who’s smart and who’s humanitarian. And I’d force things through. You wouldn’t do any of the same things [as Trump], but it is what we need.”

The businessman has previously been a guest of Farage on GB News and said the pair agreed on a lot of topics. But he ruled out backing Reform, calling Farage a “climate sceptic” and said the climate crisis was “the most crucial thing we’re facing”.

“I would be concerned that he’s too much of a Trumpite … and that would not be healthy for Britain at all. But a lot of what he says makes a lot of sense to me,” he said. “He’s able to talk very directly to people’s concerns.”

Caudwell said he would continue to urge a focus on young people and how investment in prevention would save billions in the long run for the justice system and the NHS.

“I think social media is disastrous for people’s mental health,” he said. “AI is going to be completely disastrous. Even up until probably four or five years ago, if I watched a video, I’d know it was real.

“Now the kids are going to see this stuff, they’re not going to have a clue what’s real. And I think that’s really worrying because our children are going to grow up in this fantasy world where they don’t know right from wrong, fact from fiction.”