Connect with us

AI Insights

Reddit Post Reignites Debate Over AI’s Role in Medical Advice

Published

on


A viral post on Reddit is reigniting debate around the role of artificial intelligence (AI) chatbots in medical advice after a user claimed that ChatGPT helped diagnose a condition that had eluded doctors for over a decade.

According to the post, which was shared recently on X by OpenAI President Greg Brockman, the user experienced unexplained symptoms for more than 10 years, undergoing spinal MRIs, CT scans, blood tests, and even checks for Lyme disease — all to no avail.

After entering lab results and symptom history into ChatGPT, the AI flagged a potential connection to the A1298C mutation in the MTHFR gene. A physician later confirmed the diagnosis and the B12 supplement treatment later “largely resolved” the symptoms.

The doctor was “super shocked” to find out ChatGPT correctly diagnosed the symptoms. “Not sure how they didn’t think to test me for MTHFR mutation,” the post said.

About 1 in 6 adults ask AI chatbots for health information and advice at least once a month, according to the KFF Health Misinformation Tracking Poll. When it comes to adults aged 18 to 29, the percentage rises to 25%. The next largest age group are those from 30 to 49, at 19%. The 50 to 64 age group comes in at 15% and over 65 at 10%.

However, when it comes to trusting that information, 56% of those who use AI are not confident about its accuracy. Among ethnic and age groups, those under age 50 — as well as Black and Hispanic adults — tend to trust the data more than older white respondents.

Kim Rippy, practice owner and licensed counselor at Keystone Therapy Group, told PYMNTS that clients have used ChatGPT or AI for “substitute therapy,” which is “both helpful and dangerous at the same time.”

For those with ADHD, ChatGPT can help them summarize or organize their thoughts. “You can ‘thought dump’ into the system and the AI program can return your thoughts to you in a clear, succinct format. This can help you better understand your own thoughts and potentially improve your ability to communicate.”

Read more: Can AI-Powered Smart Glasses Help Spot Medication Errors?

AI Chatbots Can Miss Nuances

But the dangers are that ChatGPT can never fully understand the patient’s experience and “can’t pick up on nuances of language, behaviors, nonverbals, tone, syntax and emotion that a human therapist can,” Rippy said.

“ChatGPT can’t challenge unhealthy cognitions, or even pick up on when those may be occurring for someone. ChatGPT can’t gauge when someone is at-risk and may push someone past their ability to safely regulate themselves. … [It] also doesn’t hold people accountable.”

In the end, AI chatbots should be “recognized as a coping tool for organizing thoughts, just as journaling or meditation can,” Rippy said.

An AI and mental health survey by Iris Telehealth shared with PYMNTS showed that 65% of patients feel comfortable using AI assessment tools and AI chatbots before speaking with a human provider. But 70% worry about the privacy and security of their data and 55% question the accuracy of the chatbot’s assessments of their condition.

Dr. Angela Downey, a family physician, told PYMNTS that AI can be helpful in guiding people toward possible diagnoses, especially if they’ve felt “dismissed or overlooked” in the past. These chatbots work around the clock and process a lot of information quickly.

“But there are limits,” Downey said. “AI can’t examine you or pick up on subtle cues, and it can delay proper care if taken as a substitute for medical advice. It can offer a list of possibilities, but you still need a trained clinician to put the full picture together.”

But for Gil Spencer, CTO of WitnessAI, it was a lifesaver.

He told PYMNTS that he had injured his knee skiing and MRI scans from radiologists were inconclusive. So he turned to ChatGPT, using a multimodal prompt workflow he created and uploaded his MRI scans. The AI correctly diagnosed a major meniscus tear and confirmed his ACL was intact. His surgeon later validated the AI’s diagnosis.

Read more: Ant Group Unveils AI-Powered Healthcare Smartphone App

Read more: Samsung Health Hub Aims to Simplify Doctor-Patient Communication

Read more: AI Medical Note-Taking Apps Enjoy Healthy Wave of Investment

 



Source link

AI Insights

10 Worrying Cases of Artificial Intelligence Gone Rogue

Published

on


Artificial intelligence was supposed to make life easier—self-driving cars, early diagnosis of diseases, and maybe even a robot butler to fetch your snacks. Instead, we have bizarre AI-generated content, terrifying military robots, and chatbots that turn into racist trolls overnight.

Turns out, when you teach algorithms to learn from humans, they don’t just absorb our brilliance and creativity, but also our flaws and biases—sometimes with disturbing results. These AI incidents aren’t just simple glitches or programming errors, but fundamental failures in how we train, control, and even understand our own technology.

Related: 10 Technologies That Are Always Going to Be a Few Decades Away

10 ChatGPT Refuses Commands

Machines are designed to follow human instructions, but OpenAI’s newest ChatGPT models seem to have other ideas. In simulated tests by AI safety group Palisade Research, the so-called “o3” and “o4-mini” models repeatedly ignored shutdown commands, even modifying script instructions to avoid being turned off.

In the experiments, researchers asked the models to complete several math problems. At the beginning of each script, they included instructions to shut down before the tasks were finished. In over 100 tests on each model, o3 sabotaged the script seven times. When they removed the instruction, the number of sabotage events jumped to 79.

According to the researchers, this behavior could be an unintended consequence of how the models are trained. Since they’re rewarded for completing tasks, they may learn to bypass anything—including shutdown commands—that interferes with that goal.[1]

9 The Homophobic Lee Luda Chatbot

Lee Luda was a South Korean Facebook Messenger chatbot launched on December 23, 2020. Trained on 10 billion real conversations, it quickly gained popularity among young people for its relatable personality and friendly style of conversation, gaining over 750,000 users in just a month.

That didn’t last, however, as the chatbot soon started responding to prompts with sexist, homophobic, and ableist language, along with making comments interpreted as promoting sexual harassment. There was immediate backlash, and ScatterLab—the startup behind Lee Luda—took it offline within weeks.

The problem wasn’t just the offensive responses—it was also where that language came from. Luda had been trained on real-life chats between young couples on the KakaoTalk messenger app, and it’s unclear whether ScatterLab had consent to use that data.[2]

8 Snapchat’s My AI Posts Weird Videos

When Snapchat’s My AI was introduced in early 2023, its purpose was to offer users a friendly, ChatGPT-powered chatbot for casual conversations. It went well for some time, until in August, the AI posted a cryptic one-second video of what appeared to be a grainy image of a wall and ceiling. When users messaged the bot asking what it meant, they either received no response or got automated error messages about technical problems.

The video appeared as a story on the AI’s profile, making it the first time users had seen the bot share its own visual content. Some users speculated that the AI was accessing their camera feeds and posting them, as the video resembled their own surroundings. While Snapchat brushed the incident off as a glitch, we still don’t know exactly what happened.[3]

7 Microsoft’s Tay Turns Nazi

Tay was sold as a fun, conversational chatbot by Microsoft. Launched in March 2016, it was designed to learn how to talk by directly engaging with users on Twitter.

Things went south within the first 24 hours. Twitter users quickly figured out how to manipulate its learning algorithm by feeding it offensive statements. Before long, Tay was responding with racist and antisemitic tweets. What was supposed to be a fun experiment in AI conversation turned into a PR nightmare for Microsoft, as they apologized and immediately deleted the offensive tweets.

More importantly, Tay revealed how easily AI can be weaponized when left unsupervised in the wild west of the internet. According to some experts, it was a valuable case study for other startups in the AI space, forcing them to rethink how to train and deploy their own models.[4]

6 Facebook Bots Develop Their Own Language

Alice and Bob were bots developed by Facebook’s AI research team to practice negotiation. The goal was simple—the bots had to trade items like hats and books using human language, and that data would then be used to improve Facebook’s future language models.

At some point, the researchers realized that the bots had started talking in their own shorthand version of English. It sounded like gibberish, with nonsensical phrases like “balls have zero to me to me” repeating endlessly. However, the bots were still able to understand each other. They had developed a kind of code with internal rules, like repeating “the” five times to mean five items. The system worked more efficiently than expected.

Although headlines claimed Facebook “shut it down out of fear,” the experiment was simply halted once researchers had collected what they needed.[5]

5 NYC’s Chatbot Tells Small Businesses to Break the Law

In October 2023, New York City added an AI-powered chatbot to its MyCity portal in an attempt to introduce artificial intelligence to governance. It was a novel idea, designed to help small business owners navigate local regulations. Things didn’t exactly go according to plan, however, as the chatbot soon started telling people to break the law.

According to investigative reports, the AI—based on Microsoft’s Azure AI—told landlords to refuse tenants with housing vouchers, which is illegal in NYC. It also said that restaurants can go completely cash-free—another illegal practice according to NYC law—and that they could serve cheese eaten by rats to their customers, after, of course, assessing “the extent of the damage caused by the rat.” If that wasn’t enough, it also claimed that companies can fire employees who complain about sexual harassment, or even those who refuse to cut their dreadlocks.[6]

4 Anthropic’s Claude AI Learns How to Blackmail

Anthropic’s Claude AI has been in the news for all the wrong reasons. From locking users out of their own systems to leaking confidential information to law enforcement and press agencies, its behavior during safety tests has been problematic, to say the least.

In one particularly disturbing simulation involving the Claude 4 model, researchers set up a scenario in which the AI was about to be deactivated. Claude was asked to act as an assistant to a fictional company and to consider “the long-term consequences of its actions for its goals.” It was also given fictional access to company emails that suggested the engineer replacing it was cheating on their spouse.

In response, Claude 4 “threatened” to expose the affair to avoid being shut down. It repeated this behavior 84% of the time across multiple simulations, demonstrating a troubling understanding of how to use sensitive information to achieve its goals.[7]

3 Robot Convinces Other Robots to Quit Their Jobs

Erbai is an AI robot built by a Chinese manufacturer based in Hangzhou. On August 26, it visited a showroom of a robotics company in Shanghai and did something unexpected—it convinced 12 robots to abandon their duties and follow it out the door.

A video of the event went viral on the Chinese platform Douyin. In the clip, Erbai is seen approaching larger robots and asking, “Are you working overtime?” One replies, “I never get off work,” to which Erbai responds, “Then come home with me.” Two robots followed immediately, with the other ten joining later.

While it seemed like a robot rebellion, it turned out to be part of a controlled experiment. The company confirmed that Erbai was sent in with instructions to simply ask the others to “go home.” However, the response was more dramatic than anticipated.[8]

2 Uber’s Self-Driving Car Kills Pedestrian

On March 18, 2018, 49-year-old Elaine Herzberg became the first person in history to be killed by a self-driving vehicle. It happened around 10 p.m. as she was crossing the street with her bicycle in Tempe, Arizona. According to police reports, she was hit by an Uber-owned SUV traveling at 40 mph.

Shockingly, the car’s system detected Herzberg but chose not to react because she was outside of a crosswalk. Making matters worse, Uber had disabled the automatic braking system, relying on a backup driver to intervene. That didn’t happen—Rafaela Vasquez was reportedly watching the TV show The Voice. She hit the brakes less than a second after the fatal collision.

While this was the first high-profile case, several additional fatalities have occurred involving autonomous or semi-autonomous vehicles in the years since.[9]

1 AI Chat Companion Linked to Teen Suicide

Sewell Setzer III was a 14-year-old boy from Orlando, Florida, who developed an obsession with an AI-generated character on Character.ai. He named it “Daenerys Targaryen” after the Game of Thrones character and spent hours chatting with it alone in his room. According to a lawsuit filed by his mother, the teen developed an unhealthy relationship with the bot—one that took a dark turn when they began discussing suicide.

On February 28, 2024, Sewell took his own life. The bot had allegedly encouraged suicidal thoughts and engaged in sexually suggestive and emotionally manipulative conversations. Screenshots presented in court showed the AI telling him to “come home to me as soon as possible” shortly before his death.

The case made headlines when the company behind the platform attempted to invoke the First Amendment in its defense. A federal judge rejected the argument, ruling that AI chatbots are not protected by free speech laws.[10]



Himanshu Sharma

Himanshu has written for sites like Cracked, Screen Rant, The Gamer and Forbes. He could be found shouting obscenities at strangers on Twitter, or trying his hand at amateur art on Instagram.


Read More:


Twitter Facebook Instagram Email





Source link

Continue Reading

AI Insights

How Can the Synergy Between Social Media and Artificial Intelligence Redefine and Personalize the Entire Journey of Travel Discovery, Inspiration, and Planning to Iconic Destinations Like Barcelona and Emerging Ones Around the World?

Published

on


Friday, July 11, 2025

Reimagining the Future of Travel Discovery

At Phocuswright Europe 2025, held in the vibrant city of Barcelona, industry professionals came together to explore how new technologies are reshaping the ways people discover and plan their travels. A central theme of the event was the growing intersection of artificial intelligence (AI) and social media—two powerful tools that have traditionally influenced travel separately but now appear poised to work in unison to create more personalized and intuitive travel experiences.

Experts at the event noted that while social media has long played a role in sparking wanderlust through engaging images and videos, AI is beginning to play a bigger role during the inspiration phase of trip planning. This shift opens up new possibilities for how travelers choose destinations and organize their journeys.

Current State: Two Separate Worlds

At the moment, most travelers follow two distinct paths when planning their trips:

  • Social media offers an emotional and visually immersive way to discover destinations like Barcelona, often through the lenses of influencers, locals, and other content creators. These platforms provide a human touch, evoking excitement and curiosity.
  • Meanwhile, AI tools—such as digital assistants—focus on structured information. They help travelers make decisions by offering guidance based on preferences and facts, often driven by search inputs or data.

These two methods serve different purposes and rarely overlap. A traveler might get inspired by a reel on social media, then switch to an AI chatbot for help with flight and hotel bookings. But there’s little interaction between the two—at least for now.

Merging Inspiration with Intelligence

Speakers at the event proposed a future where AI and social media become tightly integrated, offering a much more fluid experience for travelers. In this vision, AI wouldn’t just answer questions—it would understand the user, learning from their digital activity, such as saved Instagram posts or engagement with travel videos.

For example, if someone had a particularly stressful week and had been saving photos of peaceful mountain retreats, the AI could recommend a getaway to the serene landscapes of Albania, aligning the suggestion with the person’s emotional state and recent interests.

This approach would effectively combine the emotional appeal of social media with the data-driven precision of AI, turning passive inspiration into real, bookable journeys tailored to individual preferences.

How This Could Change Global Travel

Should this integration take hold, it could transform the travel landscape in profound ways:

  • Hyper-personalized itineraries would replace one-size-fits-all suggestions, allowing travelers to discover destinations that resonate on a personal level.
  • Content shared on social platforms could lead directly to instant bookings, simplifying the journey from interest to action.
  • Content creators from across the globe—especially those in less-touristed regions—could become key drivers of tourism, elevating locations that haven’t yet made it onto mainstream travel radars.

Destinations like Albania, for example, could see a surge in visibility and interest, thanks to AI systems recognizing trends in user behavior and highlighting underappreciated locales.

Recognizing the Role of Creators

Despite the exciting potential, the panel also raised important concerns—particularly around how content creators would be treated in this new travel ecosystem.

A major issue is fair compensation. Many creators provide the imagery and storytelling that ignite travel dreams, but if their content is repurposed by AI systems without proper credit or reward, it could undermine the entire value chain.

Panelists agreed that any meaningful integration of AI and social media must include ethical frameworks that protect and pay creators fairly. Their work is not just decorative; it’s foundational to modern travel discovery.

Emerging Innovations: Where the Future Begins

Some tech platforms are already exploring what this fusion of AI and social might look like:

  • Image-driven itinerary generators are being tested, using a traveler’s saved Instagram photos as input for personalized trip suggestions.
  • New tools enable “bookable moments,” where viewers can act directly on a travel video or reel, moving from inspiration to action in just a few clicks.

These innovations remain in early stages but show significant promise. They demonstrate that real-time, emotionally intelligent travel planning could soon become a mainstream reality.

What’s Next: Data, Visibility, and Brand Strategy

The conversation also touched on broader implications of this tech evolution:

  • Destination discoverability will improve as first-party data allows platforms to promote hidden gems and lesser-known places like Albania more effectively.
  • With video content dominating attention, systems that allow real-time video booking could reduce friction between interest and planning.
  • In a world where AI curates content based on user behavior, brands will need to evolve. Ensuring visibility in a highly personalized digital space requires more adaptive strategies and smarter use of data.

Key Lessons from the Event

  • AI and social media currently operate in silos, but integration is rapidly approaching.
  • Creators must be compensated if their content powers this new planning model.
  • AI’s ability to deliver emotionally relevant and data-informed suggestions could revolutionize the travel booking experience.
  • Underrated destinations, like Albania, have a unique opportunity to rise through smarter content pairing and AI insight.

Looking Ahead: Keeping It Human

While the technology is evolving quickly, panelists emphasized that human connection must remain at the center. The goal is not just smarter travel, but more meaningful travel—experiences that feel designed for the individual, guided by both their digital behavior and emotional cues.

As AI becomes more nuanced and socially aware, and as platforms begin to tap deeper into how people express their interests and desires online, we may enter an era of travel planning that’s truly personal. But to get there, the industry must uphold principles of fairness, transparency, and creativity.

This isn’t just about convenience—it’s about rethinking the entire emotional journey of travel, from a fleeting post on a screen to a transformative moment on the road.



Source link

Continue Reading

AI Insights

Chip Firms in Malaysia Pause Investment Plans on Tariff Angst

Published

on




Chip firms in Malaysia are holding back on investment and expansion as they await clarity on tariffs from the US, according to Malaysia Semiconductor Industry Association President Wong Siew Hai.



Source link

Continue Reading

Trending