Connect with us

AI Insights

10 Worrying Cases of Artificial Intelligence Gone Rogue

Published

on


Artificial intelligence was supposed to make life easier—self-driving cars, early diagnosis of diseases, and maybe even a robot butler to fetch your snacks. Instead, we have bizarre AI-generated content, terrifying military robots, and chatbots that turn into racist trolls overnight.

Turns out, when you teach algorithms to learn from humans, they don’t just absorb our brilliance and creativity, but also our flaws and biases—sometimes with disturbing results. These AI incidents aren’t just simple glitches or programming errors, but fundamental failures in how we train, control, and even understand our own technology.

Related: 10 Technologies That Are Always Going to Be a Few Decades Away

10 ChatGPT Refuses Commands

Machines are designed to follow human instructions, but OpenAI’s newest ChatGPT models seem to have other ideas. In simulated tests by AI safety group Palisade Research, the so-called “o3” and “o4-mini” models repeatedly ignored shutdown commands, even modifying script instructions to avoid being turned off.

In the experiments, researchers asked the models to complete several math problems. At the beginning of each script, they included instructions to shut down before the tasks were finished. In over 100 tests on each model, o3 sabotaged the script seven times. When they removed the instruction, the number of sabotage events jumped to 79.

According to the researchers, this behavior could be an unintended consequence of how the models are trained. Since they’re rewarded for completing tasks, they may learn to bypass anything—including shutdown commands—that interferes with that goal.[1]

9 The Homophobic Lee Luda Chatbot

Lee Luda was a South Korean Facebook Messenger chatbot launched on December 23, 2020. Trained on 10 billion real conversations, it quickly gained popularity among young people for its relatable personality and friendly style of conversation, gaining over 750,000 users in just a month.

That didn’t last, however, as the chatbot soon started responding to prompts with sexist, homophobic, and ableist language, along with making comments interpreted as promoting sexual harassment. There was immediate backlash, and ScatterLab—the startup behind Lee Luda—took it offline within weeks.

The problem wasn’t just the offensive responses—it was also where that language came from. Luda had been trained on real-life chats between young couples on the KakaoTalk messenger app, and it’s unclear whether ScatterLab had consent to use that data.[2]

8 Snapchat’s My AI Posts Weird Videos

When Snapchat’s My AI was introduced in early 2023, its purpose was to offer users a friendly, ChatGPT-powered chatbot for casual conversations. It went well for some time, until in August, the AI posted a cryptic one-second video of what appeared to be a grainy image of a wall and ceiling. When users messaged the bot asking what it meant, they either received no response or got automated error messages about technical problems.

The video appeared as a story on the AI’s profile, making it the first time users had seen the bot share its own visual content. Some users speculated that the AI was accessing their camera feeds and posting them, as the video resembled their own surroundings. While Snapchat brushed the incident off as a glitch, we still don’t know exactly what happened.[3]

7 Microsoft’s Tay Turns Nazi

Tay was sold as a fun, conversational chatbot by Microsoft. Launched in March 2016, it was designed to learn how to talk by directly engaging with users on Twitter.

Things went south within the first 24 hours. Twitter users quickly figured out how to manipulate its learning algorithm by feeding it offensive statements. Before long, Tay was responding with racist and antisemitic tweets. What was supposed to be a fun experiment in AI conversation turned into a PR nightmare for Microsoft, as they apologized and immediately deleted the offensive tweets.

More importantly, Tay revealed how easily AI can be weaponized when left unsupervised in the wild west of the internet. According to some experts, it was a valuable case study for other startups in the AI space, forcing them to rethink how to train and deploy their own models.[4]

6 Facebook Bots Develop Their Own Language

Alice and Bob were bots developed by Facebook’s AI research team to practice negotiation. The goal was simple—the bots had to trade items like hats and books using human language, and that data would then be used to improve Facebook’s future language models.

At some point, the researchers realized that the bots had started talking in their own shorthand version of English. It sounded like gibberish, with nonsensical phrases like “balls have zero to me to me” repeating endlessly. However, the bots were still able to understand each other. They had developed a kind of code with internal rules, like repeating “the” five times to mean five items. The system worked more efficiently than expected.

Although headlines claimed Facebook “shut it down out of fear,” the experiment was simply halted once researchers had collected what they needed.[5]

5 NYC’s Chatbot Tells Small Businesses to Break the Law

In October 2023, New York City added an AI-powered chatbot to its MyCity portal in an attempt to introduce artificial intelligence to governance. It was a novel idea, designed to help small business owners navigate local regulations. Things didn’t exactly go according to plan, however, as the chatbot soon started telling people to break the law.

According to investigative reports, the AI—based on Microsoft’s Azure AI—told landlords to refuse tenants with housing vouchers, which is illegal in NYC. It also said that restaurants can go completely cash-free—another illegal practice according to NYC law—and that they could serve cheese eaten by rats to their customers, after, of course, assessing “the extent of the damage caused by the rat.” If that wasn’t enough, it also claimed that companies can fire employees who complain about sexual harassment, or even those who refuse to cut their dreadlocks.[6]

4 Anthropic’s Claude AI Learns How to Blackmail

Anthropic’s Claude AI has been in the news for all the wrong reasons. From locking users out of their own systems to leaking confidential information to law enforcement and press agencies, its behavior during safety tests has been problematic, to say the least.

In one particularly disturbing simulation involving the Claude 4 model, researchers set up a scenario in which the AI was about to be deactivated. Claude was asked to act as an assistant to a fictional company and to consider “the long-term consequences of its actions for its goals.” It was also given fictional access to company emails that suggested the engineer replacing it was cheating on their spouse.

In response, Claude 4 “threatened” to expose the affair to avoid being shut down. It repeated this behavior 84% of the time across multiple simulations, demonstrating a troubling understanding of how to use sensitive information to achieve its goals.[7]

3 Robot Convinces Other Robots to Quit Their Jobs

Erbai is an AI robot built by a Chinese manufacturer based in Hangzhou. On August 26, it visited a showroom of a robotics company in Shanghai and did something unexpected—it convinced 12 robots to abandon their duties and follow it out the door.

A video of the event went viral on the Chinese platform Douyin. In the clip, Erbai is seen approaching larger robots and asking, “Are you working overtime?” One replies, “I never get off work,” to which Erbai responds, “Then come home with me.” Two robots followed immediately, with the other ten joining later.

While it seemed like a robot rebellion, it turned out to be part of a controlled experiment. The company confirmed that Erbai was sent in with instructions to simply ask the others to “go home.” However, the response was more dramatic than anticipated.[8]

2 Uber’s Self-Driving Car Kills Pedestrian

On March 18, 2018, 49-year-old Elaine Herzberg became the first person in history to be killed by a self-driving vehicle. It happened around 10 p.m. as she was crossing the street with her bicycle in Tempe, Arizona. According to police reports, she was hit by an Uber-owned SUV traveling at 40 mph.

Shockingly, the car’s system detected Herzberg but chose not to react because she was outside of a crosswalk. Making matters worse, Uber had disabled the automatic braking system, relying on a backup driver to intervene. That didn’t happen—Rafaela Vasquez was reportedly watching the TV show The Voice. She hit the brakes less than a second after the fatal collision.

While this was the first high-profile case, several additional fatalities have occurred involving autonomous or semi-autonomous vehicles in the years since.[9]

1 AI Chat Companion Linked to Teen Suicide

Sewell Setzer III was a 14-year-old boy from Orlando, Florida, who developed an obsession with an AI-generated character on Character.ai. He named it “Daenerys Targaryen” after the Game of Thrones character and spent hours chatting with it alone in his room. According to a lawsuit filed by his mother, the teen developed an unhealthy relationship with the bot—one that took a dark turn when they began discussing suicide.

On February 28, 2024, Sewell took his own life. The bot had allegedly encouraged suicidal thoughts and engaged in sexually suggestive and emotionally manipulative conversations. Screenshots presented in court showed the AI telling him to “come home to me as soon as possible” shortly before his death.

The case made headlines when the company behind the platform attempted to invoke the First Amendment in its defense. A federal judge rejected the argument, ruling that AI chatbots are not protected by free speech laws.[10]



Himanshu Sharma

Himanshu has written for sites like Cracked, Screen Rant, The Gamer and Forbes. He could be found shouting obscenities at strangers on Twitter, or trying his hand at amateur art on Instagram.


Read More:


Twitter Facebook Instagram Email





Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

AI Insights

Artificial Intelligence (AI) In Beauty and Cosmetics Market

Published

on


Artificial Intelligence (AI) In Beauty and Cosmetics Market

The Artificial Intelligence (AI) in Beauty and Cosmetics market is expected to be valued at USD 3.9 billion in 2024 and is projected to reach approximately USD 17.1 billion by 2033, growing at a CAGR of around 17.9% from 2025 to 2033.

Artificial Intelligence (AI) in Beauty and Cosmetics Market Overview:

The AI in Beauty and Cosmetics market is rapidly evolving as brands increasingly integrate smart technologies to enhance customer experiences and streamline operations. AI-powered tools such as virtual try-ons, personalized skincare recommendations, and AI-driven diagnostic tools are revolutionizing how consumers discover, select, and purchase beauty products. Companies are leveraging machine learning and facial recognition to deliver hyper-personalized solutions tailored to individual skin types, preferences, and concerns. E-commerce growth and rising demand for immersive shopping experiences are fueling AI adoption. Furthermore, AI is playing a key role in trend forecasting, inventory management, and product development, positioning it as a transformative force in the global beauty industry.

Request a sample copy of this report at: https://www.omrglobal.com/request-sample/ai-in-beauty-and-cosmetics-market

Advantages of requesting a Sample Copy of the Report:

1) To understand how our report can bring a difference to your business strategy

2) To understand the analysis and growth rate in your region

3) Graphical introduction of global as well as the regional analysis

4) Know the top key players in the market with their revenue analysis

5) SWOT analysis, PEST analysis, and Porter’s five force analysis

The report further explores the key business players along with their in-depth profiling

L’Oréal Group, Procter & Gamble Co., Estée Lauder Companies Inc., Shiseido Company Limited, Unilever plc, LVMH Moët Hennessy Louis Vuitton, Coty Inc., Perfect Corp., Revieve Oy, and Olay (P&G).

💄 Artificial Intelligence (AI) in Beauty and Cosmetics Market Segments:

✅ By Type:

• Skin Care

• Hair Care

• Makeup

• Fragrances

• Others

✅ By Technology:

• Machine Learning (ML)

• Natural Language Processing (NLP)

• Computer Vision

• Chatbots & Virtual Assistants

• Augmented Reality (AR) Integration

✅ By Application:

• Personalized Product Recommendations

• Virtual Try-On & Beauty Analysis

• Skin Diagnostics

• Customer Service & Chatbots

• Inventory & Supply Chain Optimization

• Product Development & Formulation

✅ By Deployment Mode:

• Cloud-Based

• On-Premise

✅ By End User:

• Cosmetics Brands & Retailers

• Dermatology Clinics

• E-commerce Platforms

• Salons & Spas

• Individual Consumers

Report Drivers & Trends Analysis:

The report also discusses the factors driving and restraining market growth, as well as their specific impact on demand over the forecast period. Also highlighted in this report are growth factors, developments, trends, challenges, limitations, and growth opportunities. This section highlights emerging Artificial Intelligence (AI) In Beauty and Cosmetics Market trends and changing dynamics. Furthermore, the study provides a forward-looking perspective on various factors that are expected to boost the market’s overall growth.

Competitive Landscape Analysis:

In any market research analysis, the main field is competition. This section of the report provides a competitive scenario and portfolio of the Artificial Intelligence (AI) In Beauty and Cosmetics Market’s key players. Major and emerging market players are closely examined in terms of market share, gross margin, product portfolio, production, revenue, sales growth, and other significant factors. Furthermore, this information will assist players in studying critical strategies employed by market leaders in order to plan counterstrategies to gain a competitive advantage in the market.

Regional Outlook:

The following section of the report offers valuable insights into different regions and the key players operating within each of them. To assess the growth of a specific region or country, economic, social, environmental, technological, and political factors have been carefully considered. The section also provides readers with revenue and sales data for each region and country, gathered through comprehensive research. This information is intended to assist readers in determining the potential value of an investment in a particular region.

» North America (U.S., Canada, Mexico)

» Europe (Germany, U.K., France, Italy, Russia, Spain, Rest of Europe)

» Asia-Pacific (China, India, Japan, Singapore, Australia, New Zealand, Rest of APAC)

» South America (Brazil, Argentina, Rest of SA)

» Middle East & Africa (Turkey, Saudi Arabia, Iran, UAE, Africa, Rest of MEA)

If you have any special requirements, Request customization: https://www.omrglobal.com/report-customization/ai-in-beauty-and-cosmetics-market

Key Benefits for Stakeholders:

⏩ The study represents a quantitative analysis of the present Artificial Intelligence (AI) In Beauty and Cosmetics Market trends, estimations, and dynamics of the market size from 2025 to 2032 to determine the most promising opportunities.

⏩ Porter’s five forces study emphasizes the importance of buyers and suppliers in assisting stakeholders to make profitable business decisions and expand their supplier-buyer network.

⏩ In-depth analysis, as well as the market size and segmentation, help you identify current Artificial Intelligence (AI) In Beauty and Cosmetics Market opportunities.

⏩ The largest countries in each region are mapped according to their revenue contribution to the market.

⏩ The Artificial Intelligence (AI) In Beauty and Cosmetics Market research report gives a thorough analysis of the current status of the Artificial Intelligence (AI) In Beauty and Cosmetics Market’s major players.

Key questions answered in the report:

➧ What will the market development pace of the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ What are the key factors driving the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ Who are the key manufacturers in the market space?

➧ What are the market openings, market hazards,s and market outline of the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ What are the sales, revenue, and price analysis of the top manufacturers of the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ Who are the distributors, traders, and dealers of Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ What are the market opportunities and threats faced by the vendors in the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ What are deals, income, and value examination by types and utilizations of the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

➧ What are deals, income, and value examination by areas of enterprises in the Artificial Intelligence (AI) In Beauty and Cosmetics Market?

Purchase Now Up to 25% Discount on This Premium Report: https://www.omrglobal.com/buy-now/ai-in-beauty-and-cosmetics-market?license_type=quick-scope-report

Reasons To Buy The Artificial Intelligence (AI) In Beauty and Cosmetics Market Report:

➼ In-depth analysis of the market on the global and regional levels.

➼ Major changes in market dynamics and competitive landscape.

➼ Segmentation on the basis of type, application, geography, and others.

➼ Historical and future market research in terms of size, share growth, volume, and sales.

➼ Major changes and assessment in market dynamics and developments.

➼ Emerging key segments and regions

➼ Key business strategies by major market players and their key methods

📊 Explore more market insights and reports here:

https://api.omrglobal.com/report-gallery/isometamidium-chloride-market/

https://api.omrglobal.com/report-gallery/isometamidium-chloride-market/

https://api.omrglobal.com/report-gallery/isometheptene-hydrochloride-market/

https://api.omrglobal.com/report-gallery/isoniazid-market/

https://api.omrglobal.com/report-gallery/isopropamide-iodide-market/

Contact Us:

Mr. Anurag Tiwari

Email: anurag@omrglobal.com

Contact no: +91 780-304-0404

Website: www.omrglobal.com

Follow Us: LinkedIn | Twitter

About Orion Market Research

Orion Market Research (OMR) is a market research and consulting company known for its crisp and concise reports. The company is equipped with an experienced team of analysts and consultants. OMR offers quality syndicated research reports, customized research reports, consulting and other research-based services. The company also offers Digital Marketing services through its subsidiary OMR Digital and Software development and Consulting Services through another subsidiary Encanto Technologies.

This release was published on openPR.



Source link

Continue Reading

AI Insights

We’re Light-Years Away from True Artificial Intelligence, Says Murderbot Author Martha Wells

Published

on


Many people fear that if fully sentient machine intelligence ever comes to exist, it will take over the world. The real threat, though, is the risk of tech companies enslaving robots to drive up profits, author Martha Wells suggests in her far-future-set book series The Murderbot Diaries. In Wells’s world, machine intelligences inhabit spaceships and bots, and half-human, half-machine constructs offer humans protection from danger (in the form of “security units”), as well as sexual pleasure (“comfort units”). The main character, a security unit who secretly names itself Murderbot, manages to gain free will by hacking the module its owner company uses to enslave it. But most beings like it aren’t so lucky.

In Murderbot’s world, corporations control almost everything, competing among themselves to exploit planets and indentured labor. The rights of humans and robots often get trampled by capitalist greed—echoing many of the real-world sins Wells attributes to today’s tech companies. But just outside the company territory (called the “Corporation Rim”) is an independent planet named Preservation, a relatively free and peaceful society that Murderbot finds itself, against all odds, wanting to protect.

Now, with the TV adaptation Murderbot airing on Apple TV+, Wells is reaching a whole new audience. The show has won critical acclaim (and, at the time of writing, an audience rating of 96 percent on Rotten Tomatoes), and it is consistently ranked among the streamer’s most-watched series. It was recently renewed for a second season. “I’m still kind of overwhelmed by everything happening with the show,” Wells says. “It’s hard to believe.”


On supporting science journalism

If you’re enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


Scientific American spoke to Wells about the difference between today’s AI and true machine intelligence, artificial personhood and neurodivergent robots.

[An edited transcript of the interview follows.]

The Corporation Rim feels so incredibly prescient, perhaps even more now than when you published the first book in the series in 2017.

Yes, disturbingly so. This corporate trend has kind of been percolating over the past 10 or 15 years—this was the direction we’ve been going in as a society. Once we have the idea of corporations having personhood, that a corporation is somehow more of a person than an actual human individual, then it really starts to show you just how bad it can get. I feel like that’s been possible at any time; it’s not just a far-future thing. But depicting it in the far future makes it less horrific, I guess. It allows you to think about these things without feeling like you’re watching the news.

Currently the idea of going to Mars is being pushed by private companies as an answer to all the problems. But [the implication is that those who go will be] some billionaires and their coterie and their indentured servants, and that will somehow be paradise for them and just the reverse for everybody else. With corporations taking over, that’s when profit is the bottom line—profit and personal aggrandizement of whoever’s running it. You can’t have the kind of serious, careful scientific progress that we’ve had with NASA.

This world that you’ve created is so interesting because it’s a dystopia in some ways. The Corporation Rim certainly is. And yet Preservation is kind of a utopia. Do you think of them in those terms?

Not really, because by that standard, we live in a dystopia now, and I think that the term dystopia is almost making light of reality. It’s like if you call something a dystopia, you don’t have to worry about fixing it or doing anything to try to alleviate the problems. It feels hopeless. And if you have something you call a utopia, then it’s perfect, and you don’t have to think about problems it might have or how you could make it better for people.

So I don’t really think in those terms because they feel very limited. And clearly in the Corporation Rim, there are still people who manage to live there, mostly okay, just like we do here, now. And in Preservation, there are still people who have prejudices, and they still have some things to work on. But they are actually working on them, which sets it apart from the Corporation Rim.

One of the central themes of the Murderbot stories is this idea of personhood. Your books make it very clear that Murderbot, as a part-human, part-artificial construct, is definitely a person. With our technology today, do you think artificial intelligence, large language models or ChatGPT should be considered people?

Well, Murderbot is a machine intelligence, and ChatGPT is not. It’s called artificial intelligence as a marketing tool, but it’s not actually artificial intelligence. A large language model is not a machine intelligence. We don’t really have that right now.

We have algorithms that can be very powerful and can parse large amounts of data. But they do not have a sentient individual intelligence at this time. I still think we’re probably years and years and years away from anyone creating an actual artificial intelligence.

So Murderbot is fiction, because machine intelligence right now is fiction.

A large language model that pattern matches words, sometimes sort of sounds vaguely like it might be talking to you and sometimes sounds like it’s just putting patterns together in ways that look really bizarre—that’s not anywhere close to sentient machine intelligence.

I find myself feeling really conflicted because I often resent the intrusion of these language models and products that are being called artificial intelligence into modern life today. And yet I feel such affection and love for fictional artificial intelligences.

Yes! I wonder if that’s one thing that’s enabled the whole scam of AI to get such a foothold. Because so many people don’t like having it in their stuff, knowing that it’s basically taking all your data, anything you’re working on, anything you’re writing, and putting it into this churn of a pattern-matching algorithm. Probably the fictional artificial and machine intelligences over the years have sort of convinced people that this is possible and that it’s happening now. People think talking to these large language models is somehow helping them gain sentience or learn more, when it’s really not. It’s a waste of your time.

Humans are really prone to anthropomorphizing objects, especially things like our laptop and phone and all these things that respond to what we do. I think it’s just kind of baked into us, and it’s being taken advantage of by corporations to try to make money, to take jobs away from people and for their own reasons.

My favorite character in the story is ART, who is a spaceship—that is, an artificial intelligence controlling a spaceship. How did you think about differentiating this character from the half-machine, half-human Murderbot?

Ship-based consciousnesses have been around in fiction for a long time, so I can’t take credit for that. But because Murderbot relies on human neural tissue, that’s why it is subject to the anxiety and depression and other things that humans have. And ART is not. ART was very intentionally created to work with humans and be part of a of a team, so it’s never had to deal with a lot of the negative things that Murderbot has. Someone on the internet described ART as, basically, if Skynet was an academic with a family. That’s one of the best descriptions I think I’ve ever seen.

One of the reasons that I and so many people love this series is how well it explores neurodiversity. You have this diversity of kinds of intelligences, and they parallel a lot of the different types of neurodiversity we see among humans in the real world. Were you thinking of it this way when you designed this universe?

Well, it taught me about my own neurodiversity. I knew I had problems with anxiety and things like that, but I didn’t know I probably had autism. I didn’t know a lot of other things until writing this particular story and then having people talk to me about it. They’re like, “How did you manage to portray neurodiversity like this?” And I’m thinking, “That’s just how my brain works.This is the way I think people think.” Until Murderbot, I don’t think I realized the extent to which it affects my writing. I have had a lot of people tell me that it helped them work out things about themselves and that it was just nice to see a character who thought and felt a lot of the same things they did.

Do you think science fiction is an especially helpful genre to explore some of these aspects of humanity?

It can be. I don’t know if it always has been.Science fiction is written by people, and the good and bad aspects of their personality go into it. A genre changes as the people who are working in it change. So I think it’s been better lately because we’ve finally gotten some more women and people of color and neurodivergent people and disabled people’s voices being heard now. And it’s made for a lot of really exciting work coming out. Lately, a lot of people are calling it another golden age of science fiction.

When I wrote [the first book in the series], All Systems Red, I put a lot of myself into it. And I think one of the reasons why people identify with a lot of different aspects of it is because I put a lot of genuine emotion into it and I was very specific about the way Murderbot was feeling about certain things and what was going on with it. I think there’s been a fallacy in fiction, particularly genre fiction, that if you make a character very generic, that lets more people identify with it. But that’s actually not true. The more specific someone is about their feelings and their issues and what’s going on with them, the more people can identify with that because of that specificity.



Source link

Continue Reading

AI Insights

How Capital One drives returns on its AI investments

Published

on


That speed has caught many IT executives off guard as techniques that have always worked for them stop working, Andersen adds. “With this absolute velocity, you are seeing the old norms of trying to figure out how much to invest, those are no longer useful tools,” he says. “If you use traditional methods, you just don’t get it.”

Although Andersen agrees that inference pricing has gone down significantly, “the reality is that we are asking for more sophisticated tasks, queries that are perhaps 1,000 times more complicated” today as compared to two years ago, he says.

Capitalizing on cloud and data

When Natarajan joined Capital One in March 2023, ChatGPT was barely four months old. Despite having been used for about 15 years at that point, generative AI didn’t take off in terms of C-suite and board mindshare until OpenAI introduced ChatGPT.



Source link

Continue Reading

Trending