Connect with us

Ethics & Policy

AI Can Be a Powerful Tool in Medicine, But Is it Always the Right Tool?

Published

on


Artificial intelligence “is poised to dramatically affect medical research and practice,” says Matthew DeCamp, MD, PhD, of the University of Colorado Department of Medicine. But there also is an “urgent need” to better understand AI’s potential impact on patient-centered care and to create ethical guardrails for its use, he says.

AI ethics are a key theme in DeCamp’s research as associate professor in the CU Division of General Internal Medicine and the Center for Bioethics and Humanities at the CU Anschutz Medical Campus. He also frequently lectures on the subject at CU, the local community, and around the country.

“A lot of my research on AI ethics is motivated by my patient care in an outpatient internal medicine clinic,” DeCamp says. “Like many of us, I could see what was coming, with AI tools having more of an effect on the way we deliver patient care.”

But alongside the promise of AI, DeCamp cautions, there’s also the potential for peril, such as bias, errors, and a shift from a focus on what he calls the “north star” of medicine: “patient-centered, high quality, equitable care delivered through caring relationships.”

In a talk last year as part of the CU Anschutz “Transforming Healthcare” lecture series, DeCamp recalled a line from a 1964 book by philosopher Abraham Kaplan: “Give a small boy a hammer, and he will find that everything he encounters needs pounding” – suggesting that tools like AI may be right for some jobs and not others.

“The most fundamental question is, what is the problem we’re trying to solve?” he says. “And how do we develop tools to solve that problem, rather than saying, ‘We have a tool – AI – and now let’s go find a problem to solve.”

Automated risk scores

DeCamp has overseen two major research projects on AI ethics recently. One, a project that received $655,000 in funding from the National Institute of Nursing Research in 2023, examines the use of AI tools for individualized treatment planning in end-of-life and palliative care, especially in creating an automated “risk score” predicting a patient’s prognosis or probability of death years in advance, based on electronic health record data.

“It’s certainly possible that AI-based mortality predictions could help us make better end-of-life decisions, but they create a number of ethics issues, as you can imagine,” DeCamp says. “Do patients need to be told before the score is calculated? Who should have access to the score? How does knowledge of the score affect the choices we make about care?” An AI-derived risk score might inadvertently contribute to depersonalized or unempathetic care, he adds.

For the ongoing study, DeCamp and his colleagues have interviewed more than 80 patients, families, and clinical care team members at four sites around the country, and also surveyed more than 500 palliative care physicians on their view of this technology.

“Later this year, we’re convening an expert panel to develop recommendations around these ethical issues,” he adds. “This builds on a natural strength of CU, where we’re leaders in palliative care.”

Living with Livi

Another study led by DeCamp looked at how patients of UCHealth, the CU Department of Medicine’s clinical partner, interact with Livi, “this amazing little chatbot that they can access on their mobile phone and is linked to their electronic health record.” Livi serves as a virtual assistant that can help UCHealth patients access test results, schedule appointments, find a specialist, and more.

“When it comes to Livi, all sorts of questions come up,” DeCamp says. “What do patients think of Livi? Do they know it’s a computer? What information do they like to share with Livi, and what do they think about the privacy of that information? How does using it affect their perception of their human care team?”

In a 2024 publication, DeCamp and a team including Jessica Ellis, MS, a professional research assistant at the Center for Bioethics and Humanities, and CU School of Medicine student Marlee Akerson surveyed 617 patients using Livi. The team found that 6% thought Livi was a real person, 13% weren’t sure, and 17% thought it was a computer being monitored by a person in real time.

“There is a promise for technologies such as patient-facing chatbots to leapfrog traditional barriers to care, whether it’s geography or insurance or more,” DeCamp says. “There’s a real potential to help people in that way. But we can’t stop there. If we implement technology in such a way that, five years from now, our rural communities can only access care via technology, maybe we’ve solved an access problem, but we’ve inadvertently created an unfair double standard in care.”

Making AI decisions

Looking forward, DeCamp says his next major area of research in this space is “coming to a better understanding of how health care systems make decisions about implementing and using AI tools.”

DeCamp expects federal regulators will play a role in setting guidelines for AI use in medicine. “But at the end of the day, important decisions will be made by health systems all around the country about whether or how to implement these AI-based tools.”

Health care systems are “creating governance committees and processes to make these decisions, but they’re all doing it in different ways,” he adds. “But what should be the roles of patients, families, and communities in informing those AI implementation decisions? That’s key question we need to ask.”

When AI tools work wonders, such as creating artwork from a few words, “the first reaction is a sense of awe. It’s pretty amazing what they can do,” DeCamp says. “Sometimes that sense of awe could blind us to what could be missing. We want to be amazed, but we can’t let that blind us to the fact that these tools are just tools. They make mistakes, they’re inaccurate at times, and we have to be vigilant to the potential for that, even as they get better.”





Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Ethics & Policy

5 ways companies are incorporating AI ethics – myupnow.com

Published

on



5 ways companies are incorporating AI ethics  myupnow.com



Source link

Continue Reading

Ethics & Policy

Letters: Two-party system | International affairs | AI ethics | Bringing music education to kids

Published

on

By


Two-party system

For the time being, and for the foreseeable future, we live in a two-party system. That means that Democrats are the only political party that can check the power of Trump, MAGA and Republicans who choose to bow to a fascist regime. It also means that Democrats have to win in the 2026 midterm elections and the 2028 general election.

This is a tall order given all the woes that currently beset the party: no clear leader, lousy messaging, an inability to connect with young people and, perhaps most importantly to recognize with the recent observance of Labor Day, the loss of working class voters including low-income and low-propensity voters.

Yet this could also be an opportunity. To paraphrase NASA’s Gene Krantz during the Apollo 13 crisis in 1970, “This could be our (Democrats) finest hour.” Labor Day can serve as a reminder to us that working people have the power to drastically alter the political environment. We have seen this time and again in our country’s history: think of the conditions that led to the New Deal, the civil rights movement, and the war on poverty. 

As Bishop William J. Barber from the Poor People’s campaign has noted, the combination of working people, moral leaders, and strong allies coming together can “reconstruct democracy”.

– Ward Kanowsky

International affairs

National security is of utmost importance; foreign aid is how we secure it.

National security and foreign aid are often seen as tangential entities. National security conjures images of large, marching militaries or closed, concrete borders. Foreign aid is seen as a nonprofit undertaking, one carried out by large organizations like UNICEF or smaller local enterprises.

These vivid images are not completely stereotypical, but they don’t paint the whole picture. As an intern at the Borgen Project, I learnt a very vital dogma: foreign aid secures national security.

There are pronounced correlations that prove that focusing on non-combat, diplomatic strategies can alleviate poverty in developing countries while securing America’s borders. 

The most dangerous countries in the world are also the poorest. Families who cannot afford expensive education send their kids to religious schools, which, while providing an avenue for education, can also be a breeding ground for extremist ideology. 

In the late 1980s, Charlie Wilson pleaded for Congress to build schools in Afghanistan after their war with the Soviets. The consequences of his failed plea can be seen in the rise of extremism in Afghanistan in the following years.

The solution to this cause is best summarized by former secretary of defense Chuck Hagel:

“America’s role in the world should reflect the hope and promise of our country, and possibilities for all mankind, tempered with a wisdom that has been the hallmark of our national character. That means pursuing a principled and engaged realism that employs diplomatic, economic, and security tools as well as our values to advance our security and our prosperity.”

— Atheeth Ravikrishnan

Teen’s nonprofit brings music education to kids

As a high school student, I’m proud to share the work of Youthtones, a nonprofit I started with a team of teen volunteers to bring music education to kids in the Bay Area. Our mission is simple: connect young musicians with children to provide free or affordable music lessons.

Through YouthTones, our team helps students develop not only musical skills, but also confidence, creativity, and a sense of community. What makes this program special is that it’s entirely run by teens — our volunteers aren’t just teaching music, they’re mentoring and inspiring the next generation of young musicians.

Watching the students grow, overcome challenges, and find joy in music has been incredibly rewarding. Many families in our area don’t have easy access to music lessons, and YouthTones helps fill that gap.

I hope our story inspires others to recognize the power of youth leadership and the impact a group of motivated teens can have in their community. Music has the power to bring people together, and our team at YouthTones is dedicated to making that power accessible to every child who wants to learn.

— Henna Lam 

AI ethics

When I began studying artificial intelligence as a college student, I learned how AI could be a tool for social good, helping us understand climate change, improve public health and reduce waste through smart automation. I still see that potential. But the way we are building AI today is taking us further from that vision.

Like many students entering tech, I first saw AI as innovation. I was taught to celebrate breakthroughs in machine learning, natural language processing and automation. But it did not take long before I started questioning what was missing from those conversations.

The environmental costs of large scale AI models are enormous. A 2023 MIT report found that training a single large language model could emit over 626 thousand pounds of carbon dioxide, equal to five cars over their lifetimes. These models run in data centers that consume massive electricity and water, often in areas already strained by climate change.

These facts are not minor. They are just ignored. Something we also overlook is the labor behind AI. Thousands of underpaid workers in countries like Kenya, the Philippines and Venezuela label toxic content so others can have so called safe systems. Their trauma goes unseen.

In school, we barely talked about climate or workers. That needs to change.

AI can support climate action, but not if it causes harm or worsens inequality. We cannot build sustainable solutions on extractive foundations.

I still believe in AI. But belief is not enough. If we do not build ethically now, we may not get a second chance.

– Aadya Madgula

Most Popular



Source link

Continue Reading

Ethics & Policy

OpenAI Merges Teams to Boost ChatGPT Ethics and Cut Biases

Published

on

By


In a move that underscores the evolving priorities within artificial intelligence development, OpenAI has announced a significant reorganization of its Model Behavior team, the group responsible for crafting the conversational styles and ethical guardrails of models like ChatGPT. According to an internal memo obtained by TechCrunch, this compact unit of about 14 researchers is being folded into the larger Post Training team, which focuses on refining AI models after their initial training phases. The shift, effective immediately, sees the team’s leader, Lilian Weng, transitioning to a new role within the company, while the group now reports to Max Schwarzer, head of Post Training.

This restructuring comes amid growing scrutiny over how AI systems interact with users, particularly in balancing helpfulness with honesty. The Model Behavior team has been instrumental in addressing issues like sycophancy—where models excessively affirm user opinions—and mitigating political biases in responses. Insiders suggest the integration aims to streamline these efforts, embedding personality shaping directly into the core refinement process rather than treating it as a separate silo.

Strategic Alignment in AI Development

OpenAI’s decision reflects broader industry trends toward more cohesive AI development pipelines, where behavioral tuning is not an afterthought but a foundational element. Recent user feedback on GPT-5, as highlighted in posts on X (formerly Twitter), has pointed to overly formal or detached interactions, prompting tweaks to make ChatGPT feel “warmer and friendlier” without veering into unwarranted flattery. For instance, OpenAI’s own announcements on the platform in August 2025 detailed the introduction of new chat personalities like Cynic, Robot, Listener, and Nerd, available as opt-in options in settings.

These changes build on earlier experiments, such as A/B testing different personality styles noted by users on X as far back as April 2025. Publications like WebProNews report that the reorganization is partly driven by GPT-5 feedback, emphasizing reductions in sycophantic tendencies and enhancements in engagement through advanced reasoning and safety features.

Implications for Ethical AI and User Experience

The merger could accelerate OpenAI’s ability to iterate on model behaviors, potentially leading to more context-aware interactions that better align with ethical standards. As detailed in a BitcoinWorld analysis, this realignment is crucial for influencing user experience and ethical frameworks, especially in sectors like cryptocurrency and blockchain where AI’s role is expanding. The team’s past work on models since GPT-4 has reduced harmful outputs by significant margins, with one X post claiming a 78% drop in certain biases, though such figures remain unverified by OpenAI.

Critics, however, worry that consolidating teams might dilute specialized focus on nuanced issues like bias management. Industry observers on X have debated the “sycophancy trap,” where tuning for truthfulness risks alienating casual users who prefer comforting responses, creating a game-theory dilemma for developers.

Leadership Shifts and Future Directions

Lilian Weng’s departure from the team leadership marks a notable transition; her expertise in AI safety has been pivotal, and her new project remains undisclosed. OpenAI spokesperson confirmed to StartupNews.fyi that the move is designed to foster closer collaboration, positioning the company to lead in human-AI dialogue evolution.

Looking ahead, this reorganization signals OpenAI’s bet on integrated teams to handle the complexities of next-generation AI. With GPT-5 already incorporating subtle warmth adjustments based on internal tests, as per OpenAI’s X updates, the focus is on genuine, professional engagement that avoids pitfalls like ungrounded praise. For industry insiders, this could mean faster deployment of features that make AI feel more human-like, while upholding values of honesty and utility.

Broader Industry Ripple Effects

The changes at OpenAI are likely to influence competitors, as the quest for balanced AI personalities intensifies. Reports from NewsBytes and Bitget News emphasize how this restructuring enhances post-training interactions, potentially setting new benchmarks for AI ethics. User sentiment on X, including discussions of model selectors and capacity limits, suggests ongoing refinements will be key to retaining loyalty.

Ultimately, as OpenAI navigates these internal shifts, the emphasis on personality could redefine how we perceive and interact with AI, blending technical prowess with empathetic design in ways that resonate across applications from everyday queries to complex problem-solving.



Source link

Continue Reading

Trending