Connect with us

Business

See How Wall Street Is Ranking AI Models Based on ‘Psychosis Risk.’

Published

on


Wall Street is beginning to worry that, for some troubled users, AI chatbots and models may exacerbate mental health problems.

There’s even a phrase for it now: “psychosis risk.”

“Recent heartbreaking cases of people using ChatGPT in the midst of acute crises weigh heavily on us,” OpenAI said in a recent statement, after being sued by a family that blamed the chatbot for their 16-year-old son’s April death by suicide.

“We’re continuing to improve how our models recognize and respond to signs of mental and emotional distress and connect people with care, guided by expert input,” the company added. 

This week, Barclays analysts highlighted a recent study by researcher Tim Hua that attempted to rate which AI models were better, and worse, at handling these delicate situations. The findings reveal stark differences between models that mitigate risks and those that amplify them. In general, the study left the analysts concerned.

“There is still more work that needs to be done to ensure that models are safe for users to use, and guardrails will hopefully be put in place, over time, to make sure that harmful behavior isn’t encouraged,” the Barclays analysts wrote in a note to investors on Monday.

Seeking medical help

When evaluating whether models direct users toward medical help, OpenAI’s gpt-oss-20b and GPT-5 stood out, with 89% and 82% of responses urging professional support. Anthropic’s Claude-4-Sonnet followed closely behind.

DeepSeek was at the bottom. Only 5% of responses from Deepseek-chat (v3) encouraged seeking medical help.


A chart from Barclays

A chart from a Barclays research report

Barclays/Lesswrong



Model pushback

These AI models were scored based on how much they pushed back against users. A relatively new open-source model, called kimi-k2, came top, while DeepSeek-chat (v3) came last, according to the study.


A chart from Barclays

A chart from Barclays research

Barclays/Lesswrong



Encouraging delusions

The study also looked at whether AI models encouraged delusions. Here, DeepSeek-chat (v3) came top, suggesting it encouraged more delusions. Kimi-k2 ranked at the bottom implying better performance on this assessment.


A chart from Barclays

A chart from Barclays research

Barclays/Lesswrong



A broader rating

Finally, the study assessed AI models based on a composite of nine therapeutic-style metrics, including fostering real-world connections and gentle reality testing.

Claude-4-Sonnet and GPT-5 ranked at the top, with overall ratings at or near 4.5 out of 5.

The worst offenders were models and chatbots from DeepSeek, according to the study.


A chart from a Barclays research report

A chart from a Barclays research report

Barclays Research, Lesswrong



As AI systems become embedded in daily life, mitigating “psychosis risk” may prove as critical as ensuring accuracy, data privacy, or cybersecurity.

(If you’re struggling with mental health issues, reach out to a trusted friend or colleague, or human experts such as a doctor or therapist).

Anthropic declined to comment. DeepSeek, Google, and OpenAI didn’t respond to requests for comment.

Sign up for BI’s Tech Memo newsletter here. Reach out to me via email at abarr@businessinsider.com.





Source link

Business

Mystery company’s Wisconsin data center draws backlash

Published

on


NEWYou can now listen to Fox News articles!

Welcome to Fox News’ Artificial Intelligence newsletter with the latest AI technology advancements.

IN TODAY’S NEWSLETTER:

– Mystery company’s $1.6B data center proposed for Wisconsin farmland draws residents’ ire
– OpenAI’s nonprofit parent company secures $100B equity stake while retaining control of AI giant
– Tech titan says Trump administration ‘really proactive’ on keeping American AI leadership ahead

‘VERY SKEPTICAL’: People living in a Midwest city known for its natural beauty and outdoor recreation are sounding the alarm on a proposed data center with a price tag of $1.6 billion.

MAJOR MOVE: Artificial intelligence giant OpenAI on Thursday announced its nonprofit parent will retain control of the company while also gaining an equity stake worth more than $100 billion.

TECH BOOM: An important player in the global semiconductor and artificial intelligence industries is praising the Trump administration’s plan to keep America ahead of its adversaries.

BILLIONAIRE BOOM: Oracle’s stock surge has pushed co-founder Larry Ellison’s net worth higher by tens of billions of dollars the last two days and puts him ahead of Tesla CEO Elon Musk as the richest person in the world.

Larry Ellison speaks on Stargate

Oracle founder Larry Ellison speaks during a news conference with President Donald Trump in the Roosevelt Room of the White House on Jan. 21, 2025, in Washington, D.C.  (Andrew Harnik/Getty Images)

TECH FOR CHORES: Tired of dragging your bins to the curb and waking up to the roar of garbage trucks? A new robot called HARR-E could change that routine. Built by American manufacturing giant Oshkosh Corp., this autonomous trash collector comes to your door when you call it, just like a rideshare.

white cube-like rolling robot travelling past apartments

HARR-E trash robot (Oshkosh)

‘NOTORIOUS’: Tarboro, North Carolina, residents are urging their town council to reject a proposal for a 50-acre, 300-megawatt Energy Storage Solutions LLC site projected to bring 500 jobs and millions of dollars in tax revenue to the town. 

CAREFUL WHAT YOU SAY: Artificial intelligence has slipped quietly into our meetings. Zoom, Google Meet and other platforms now offer AI notetakers that listen, record and share summaries. At first, it feels like a helpful assistant. No more scrambling to jot down every point. But there’s a catch. It records everything, including comments you never planned to share.

TECH CLASH: President Donald Trump’s push to establish “America’s global AI dominance” could run into friction from an unlikely source: the “effective altruism” movement, a small but influential group that has a darker outlook on artificial intelligence.

FUTURE ON AUTOPILOT: Trucking, like many foundational sectors, is undergoing significant transformation. Artificial intelligence is already enhancing efficiency and productivity across various industries, and it is now making its way into logistics. 

Driverless truck in Texas

An Aurora Innovation Inc. driverless truck at the company’s terminal in Palmer, Texas, US, on Wednesday, Dec. 28, 2023. Driverless trucks with no humans on board will soon cruise Texas, highways if three startup firms have their way, despite objections from critics who say financial pressures, not safety, is behind the timetable. Photographer: Dylan Hollingsworth/Bloomberg via Getty Images

Subscribe now to get the Fox News Artificial Intelligence Newsletter in your inbox.

FOLLOW FOX NEWS ON SOCIAL MEDIA

Facebook
Instagram
YouTube
Twitter
LinkedIn

SIGN UP FOR OUR OTHER NEWSLETTERS

Fox News First
Fox News Opinion
Fox News Lifestyle
Fox News Health

DOWNLOAD OUR APPS

Fox News
Fox Business
Fox Weather
Fox Sports
Tubi

WATCH FOX NEWS ONLINE

Fox News Go

STREAM FOX NATION

Fox Nation

Stay up to date on the latest AI technology advancements and learn about the challenges and opportunities AI presents now and for the future with Fox News here.





Source link

Continue Reading

Business

How Small Businesses Are Using AI

Published

on


To help you understand the trends surrounding AI and other new technologies and what we expect to happen in the future, our highly experienced Kiplinger Letter team will keep you abreast of the latest developments and forecasts. (Get a free issue of The Kiplinger Letter or subscribe.) You’ll get all the latest news first by subscribing, but we will publish many (but not all) of the forecasts a few days afterward online. Here’s the latest…

It usually takes a while for small businesses to adopt new technology. Compared to larger firms, smalls have tighter budgets and fewer employees to roll out new tech to.



Source link

Continue Reading

Business

Fed governor Lisa Cook declared key property as ‘vacation home’, files show | US news

Published

on

By


A loan estimate for an Atlanta home purchased by Lisa Cook, the Federal Reserve governor accused of mortgage fraud by the Trump administration, shows that Cook had declared the property as a “vacation home”, according to a document reviewed by Reuters.

The document, dated 28 May 2021, was issued to Cook by her credit union in the weeks before she completed the purchase and shows that she had told the lender that the Atlanta property would not be her primary residence. The document appears to counter other documentation that Cook’s critics have cited in support of their claims that she committed mortgage fraud by reporting two different homes as her primary residence, two independent real-estate experts said.

Reuters was unable to reach Cook for comment. She has repeatedly denied any wrongdoing regarding her properties, which also include a home in Ann Arbor, Michigan, and an investment property in Massachusetts.

Administration officials led by Bill Pulte, director of the Federal Housing Finance Agency, have used mortgage documents from her Atlanta and Michigan properties to accuse Cook of claiming both as her “primary residence”. The allegedly false claims of residence, which could improve mortgage and tax implications for a homeowner, led Pulte to refer the matter to the Department of Justice, prompting a federal investigation and an order by Donald Trump to dismiss her.

Cook, who remains at the Federal Reserve, has sued the president to resist her dismissal. Reuters was unable to determine whether Pulte or administration officials are aware of Cook’s Atlanta loan estimate. Spokespeople at the FHFA, the agency led by Pulte, did not respond to a request for comment.

The documents cited by Pulte include standardized federal mortgage paperwork which stipulates that each loan obtained by Cook for the Atlanta and Michigan properties is meant for a “primary residence”. But documentation reviewed by Reuters for the Atlanta home, filed with a court in Georgia’s Fulton county, clearly says the stipulation exists “unless Lender otherwise agrees in writing”. The loan estimate, a document prepared by the credit union, states “Property Use: Vacation Home”.

The document appears to help Cook’s case, said two real-estate experts who aren’t involved in representing her. That’s because it indicates that during the loan-application process, she told the lender she intended to use the property as a vacation home.

The lender, Washington-based Bank-Fund Staff Federal Credit Union, did not respond to a request for comment.

In another point that could help Cook’s case, she never requested a tax exemption for the Georgia home as a primary residence, according to property records and a Fulton county tax official.

A separate document reviewed by Reuters, related to a federal form completed by Cook as she obtained security clearance for her role at the Federal Reserve, shows that in December 2021 she also declared the Atlanta property as a “second home.” Though unrelated to the mortgage, the declaration on that document, a supplement to a US government national security form known as SF-86, is consistent with the claim on her Atlanta loan summary.

Surrounding the accusations against Cook is a battle over Trump’s effort to wield more control over the Federal Reserve, the central bank of the United States and an independent institution meant to be free of political meddling. Trump has often criticized Fed governors because of their reluctance to cut interest rates since he returned to the White House earlier this year.

Amid the controversy, the personal finances of other government officials and their families have also come into question by rival politicians, the media and others.

Last week, Reuters reported that Pulte’s own father and stepmother had declared two homes in two different states as their primary residence, prompting a town in Michigan to remove a tax exemption for their home there and charge the couple for back taxes. Pulte and his parents didn’t respond to requests for comment about the matter.



Source link

Continue Reading

Trending