Connect with us

AI Research

California, New York could become first states to enact laws aiming to prevent catastrophic AI harm

Published

on


This story is originally published by Stateline.

California and New York could become the first states to establish rules aiming to prevent the most advanced, large-scale artificial intelligence models — known as frontier AI models — from causing catastrophic harm involving dozens of casualties or billion-dollar damages.

The bill in California, which passed the state Senate earlier this year, would require large developers of frontier AI systems to implement and disclose certain safety protocols used by the company to mitigate the risk of incidents contributing to the deaths of 50 or more people or damages amounting to more than $1 billion.

The bill, which is under consideration in the state Assembly, would also require developers to create a frontier AI framework that includes best practices for using the models. Developers would have to publish a transparency report that discloses the risk assessments used while developing the model. 

In June, New York state lawmakers approved a similar measure; Democratic Gov. Kathy Hochul has until the end of the year to decide whether to  sign it into law.

Under the measure, before deploying a frontier AI model, large developers would be required to implement a safety policy to prevent the risk of critical harm — including the death or serious injury of more than 100 people or at least $1 billion in damages — caused or enabled by a frontier model through the creation or use of large-scale weapons systems or through AI committing criminal acts.  

Frontier AI models are large-scale systems that exist at the forefront of artificial intelligence innovation. These models, such as OpenAI’s GPT-5, Google’s Gemini Ultra and others, are highly advanced and can perform a wide range of tasks by processing substantial amounts of data. These powerful models also have the potential to cause catastrophic harm. 

California legislators last year attempted to pass stricter regulations on large developers to prevent the catastrophic harms of AI, but Democratic Gov. Gavin Newsom vetoed the bill. He said in his veto message that it would apply “stringent standards to even the most basic functions” of large AI systems. He wrote that small models could be “equally or even more dangerous” and worried about the bill curtailing innovation.

Over the following year, the Joint California Policy Working Group on AI Frontier Models wrote and published its report on how to approach frontier AI policy. The report emphasized the importance of empirical research, policy analyses and balance between the technology’s benefits and risks.

Tech developers and industry groups have opposed the bills in both states. Paul Lekas, the senior vice president of global public policy at the Software & Information Industry Association, wrote in an emailed statement to Stateline that California’s measure, while intended to promote responsible AI development, “is not the way to advance this goal, build trust in AI systems, and support consumer protection.”

The bill would create “an overly prescriptive and burdensome framework that risks stifling frontier model development without adequately improving safety,” he said, the same problems that led to last year’s veto. “The bill remains untethered to measurable standards, and its vague disclosure and reporting mandates create a new layer of operational burdens.”

NetChoice, a trade association of online businesses including Amazon, Google and Meta, sent a letter to Hochul in June, urging the governor to veto New York’s proposed legislation. 

“While the goal of ensuring the safe development of artificial intelligence is laudable, this legislation is constructed in a way that would unfortunately undermine its very purpose, harming innovation, economic competitiveness, and the development of solutions to some of our most pressing problems, without effectively improving public safety,” wrote Patrick Hedger, the director of policy at NetChoice.

Stateline reporter Madyson Fitzgerald can be reached at mfitzgerald@stateline.org.

Stateline is part of States Newsroom, a nonprofit news network supported by grants and a coalition of donors as a 501c(3) public charity. Stateline maintains editorial independence. Contact Editor Scott S. Greenberger for questions: info@stateline.org.





Source link

AI Research

Lenovo research shows that AI investments in healthcare industry soar by 169%

Published

on


Research from Lenovo reveals that 96% of retail sector AI deployments are meeting or exceeding expectations – outpacing other industries. While finance and healthcare are investing heavily, their results show mixed returns, highlighting sharp differences in how AI is being applied across sectors.

Lenovo research has demonstrated a huge rise in AI investments across the retail, healthcare and financial services sectors.

The CIO Playbook 2025, Lenovo’s study of EMEA IT leaders in partnership with IDC, uncovers sharply different attitudes, investment strategies, and outcomes across the Healthcare, Retail, and, Banking, Financial Services & Insurance (BFSI) industries.

Caution Pays Off for EMEA BFSI and Retail sectors

Of all the sectors analysed, BFSI stands out for its caution. Potentially reflecting the highly regulated nature of the industry, only 7% of organisations have adopted AI, and just 38% of AI budgets allocated to Generative AI (GenAI) in 2025 – the lowest across all sectors surveyed.

While the industry is taking a necessarily measured approach to innovation, the strategy appears to be paying dividends: BFSI companies reported the highest rate of AI projects exceeding expectations (33%), suggesting that when AI is deployed, it’s well-aligned with specific needs and workloads.

A similar pattern is visible in Retail, where 61% of organisations are still in the pilot phase. Despite below-average projected spending growth (97%), the sector reported a remarkable 96% of AI deployments to date either meeting or exceeding expectations, the highest combined satisfaction score among all industries surveyed.

Healthcare: Rapid Investment, Uneven Results

In contrast, the healthcare sector is moving quickly to catch up, planning a 169% increase in AI spending over 2025, the largest increase of any industry. But spend doesn’t directly translate to success. Healthcare currently has the lowest AI adoption rate and the highest proportion of organisations reporting that AI fell short of expectations.

This disconnect suggests that, while the industry is investing heavily, it may lack the internal expertise or strategy needed to implement AI effectively and may require stronger external support and guidance to ensure success.

One Technology, Many Journeys

“These findings confirm that there’s no one-size-fits-all approach to AI,” said Simone Larsson, Head of Enterprise AI, Lenovo. “Whether businesses are looking to take a bold leap with AI, or a more measured step-by-step approach, every industry faces unique challenges and opportunities. Regardless of these factors, identification of business challenges and opportunity areas followed by the development of a robust plan provides a foundation on which to build a successful AI deployment.”

The CIO Playbook 2025 is designed to help IT leaders benchmark their progress and learn from peers across industries and geographies. The report provides actionable insights on AI strategy, infrastructure, and transformation priorities in 2025 and beyond. The full CIO Playbook 2025 report for EMEA can be downloaded here.

Europe and Middle East CIO Playbook 2025, It’s Time for AI-nomics features research from IDC, commissioned by Lenovo, which surveyed 620 IT decision-makers in nine markets, [Denmark, Eastern Europe, France, Germany, Italy, Middle East, Netherlands, Spain and United Kingdom]. Fieldwork was conducted in November 2024.

Explore the full EMEA Lenovo AInomics Report here.

 





Source link

Continue Reading

AI Research

Augment Raises $85 Million for AI Teammate for Logistics

Published

on

By


Augment raised $85 million in a Series A funding round to accelerate the development of its artificial intelligence teammate for logistics, Augie.

The company will use the new capital to hire more than 50 engineers to “push the frontier of agentic AI” and to expand Augie into more logistics workflows for shippers, brokers, carriers and distributors, according to a Sept. 4 press release.

Augie performs tasks in quoting, dispatch, tracking, appointment scheduling, document collection and billing, the release said. It understands the context of every shipment and acts across email, phone, TMS, portals and chat.

“Logistics runs on millions of decisions—under pressure, across fragmented systems and with too many tabs open,” Augment co-founder and CEO Harish Abbott said in the release. “Augie doesn’t just assist. It takes ownership.”

Augment launched out of stealth five months ago, and the Series A funding brings its total capital raised to $110 million, according to the release.

When announcing the company’s launch in a March 18 blog post, Abbott said Augie does all the tedious work so that staff can focus on more important tasks.

“What exactly does Augie do?” Abbott said in the post. “Augie can read/write documents, respond to emails, make calls and receive calls, log into systems, do data entry and document uploads.”

Augie is now used by dozens of third-party logistics providers and shippers and supports more than $35 billion in freight under management, per the Sept. 4 press release.

Customers have reported a 40% reduction in invoice delays, an eight-day acceleration in billing cycles, 5% or greater gross margin recovery per load and, across all customers, millions of dollars in track and trace payroll savings, the release said.

Jacob Effron, managing director at Redpoint Ventures, which led the funding round, said in the release that Augment is “creating the system of work the logistics industry has always needed.”

“Customers consistently highlight Augment’s speed, deeply collaborative approach and transformative impact on productivity,” Effron said.

In another development in the space, Authentica said Tuesday (Sept. 9) that it launched an AI platform designed to deliver real-time supply chain visibility and automate compliance.

In May, AI logistics software startup Pallet raised $27 million in a Series B funding round.

For all PYMNTS B2B coverage, subscribe to the daily B2B Newsletter.



Source link

Continue Reading

AI Research

The race to power artificial intelligence

Published

on


The United States is experiencing a significant increase in electricity demand due to the rapid growth of artificial intelligence technologies. According to an analysis from Berkeley Lab, data centers currently consume about 4.4% of all U.S. electricity, a figure expected to rise sharply as AI models require more power. By 2028, over half of this consumption could be attributed to AI alone, equivalent to powering 22% of all U.S. households.

Most of this electricity is generated from fossil fuels, with data centers operating on grids that emit 48% more carbon than the national average, said a report from MIT Technology Review. While companies like Meta and Microsoft are investing in nuclear power, natural gas remains the primary energy source.

In response to the growing demand, President Donald Trump signed an executive order in April directing the Department of Energy to expedite emergency approvals for power plants to operate at full capacity during peak demand. The order also mandates the development of a uniform methodology to assess reserve margins and identify critical power plants essential for grid reliability.

Despite these measures, concerns remain about the U.S.’s ability to provide the 24/7 power required by AI, especially as China implements plans to ensure reliable electricity for data centers. According to reporting from Forbes, “the U.S. does not have a coherent and continuing energy plan of any type. China’s central planning allows for development and sustainability, while the U.S. approach to energy changes every four years”.



Source link

Continue Reading

Trending