Connect with us

Ethics & Policy

Strengthening global AI Safety: A perspective on the Singapore Consensus

Published

on


As artificial intelligence (AI) technologies advance rapidly, societies around the world face a growing urgency to ensure that the AI safety research keeps pace and that these tools are not only powerful but also safe, reliable, and aligned with human values. Given this globally pressing issue, we are proud that Singapore hosted the 2025 Singapore Conference on AI (SCAI), to bring together the best global minds across geographies to produce a significant international milestone in the field of AI safety: the Singapore Consensus on Global AI Safety Research Priorities.

This Consensus reflects shared priorities of over 100 AI experts from 11 countries, including researchers, policymakers, and private sector leaders. Its core objective is to establish a practical, shared research agenda that identifies critical technical areas of AI safety research requiring international attention, ensuring the safe development and deployment of AI.

As representatives of Singapore’s Infocomm Media Development Authority (IMDA), and as members of the OECD.AI Network of Experts, we believe this document holds particular significance globally and aligns closely with the OECD AI Principles, which promote inclusive growth, transparency, robustness, and accountability in AI systems.

Why the Singapore Consensus matters

The Singapore Consensus is not merely a list of ideas, but a response to growing global concern that AI capabilities are outpacing our collective ability to evaluate and govern them. With AI models now influencing everything from education to employment, many of the world’s leading minds agree that robust safety research is essential.

The Consensus outlines three key technical AI safety research areas that deserve urgent and sustained attention:

  1. Risk Assessment
    The primary goal of risk assessment is to understand the severity and likelihood of a potential harm. Risk assessments are used to prioritise risks and determine if they demand specific action. It forms a core research priority as it informs subsequent development and deployment decisions in AI.

The research areas in this category involve developing methods to measure the impact of AI systems for both current and future AI, enhancing metrology to ensure that these measurements are precise and repeatable, and building enablers for third-party audits to support independent validation of these risk assessments. The OECD’s new AI Capability Indicators initiative, which aims to assess AI systems against human-level abilities, directly supports this goal.

  1. Development
    AI systems that are trustworthy, reliable and secure-by-design give people the confidence to embrace and adopt AI innovations. Following the classic safety engineering framework, the research areas in this category suggest technical methods for specifying the desired behaviour, designing an AI system that meets the specification, and verifying that the system meets its specification.
  2. Control
    In engineering, “control” usually refers to the process of managing a system’s behaviour to achieve a desired outcome, even when faced with disturbances or uncertainties, and often in a feedback loop. The research areas in this category involve developing monitoring and intervention mechanisms for AI systems, extending the AI systems’ monitoring mechanisms to the broader AI ecosystem, and societal resilience research to strengthen societal infrastructure to adapt to AI-related societal changes.

The OECD AI Principles, endorsed by numerous regional and global governments, have long emphasised the importance of developing robust, transparent, and accountable AI systems. The Singapore Consensus brings operational clarity to these values by offering a concrete, science-driven path forward. It further provides a powerful tool for both global and regional governments and developers seeking to integrate safety into their AI strategies, namely:

  • A globally aligned research roadmap, ensuring that local systems are developed in accordance with international best practices.
  • A common language for international collaboration, enabling nations, even regional ones like the Association of Southeast Asian Nations (ASEAN), a regional grouping of 10 states in Southeast Asia that aims to promote economic and security cooperation among its members. Its member states are Brunei Darussalam, Cambodia, Indonesia, Lao PDR, Malaysia, Myanmar, Philippines, Singapore, Thailand and Viet Nam, to coordinate efforts in AI research and regulation.
  • Enhanced capacity building by encouraging research institutions and universities to engage with advanced safety research.

A regional perspective: Why this also matters for Southeast Asia

Southeast Asia is a region of digital dynamism, characterised by rapidly growing economies, young populations, and high mobile and internet penetration. As countries accelerate AI adoption to enhance healthcare, education, transport, and public services, ensuring trust in these systems becomes vital.

Secure, reliable and trustworthy AI is not a luxury; it is a prerequisite for long-term adoption and success. It is important that upstream research takes into account regional needs so that future AI development is more inclusive. As AI adoption gains momentum in Southeast Asia, a more holistic approach to building trustworthy AI is necessary. Besides the research priorities outlined in the Consensus, there are also other governance areas that Southeast Asia needs to be concerned about and seek alignment so that AI adoption across the region can be more seamless.

Recognising this, Singapore has invested significant efforts in bringing together Southeast Asia counterparts to make progress on building a trusted AI ecosystem in ASEAN. This is evident in Singapore’s leadership in chairing ASEAN’s AI Governance Working Group, which has been officially designated to oversee and coordinate AI projects in ASEAN. It also serves as the focal point for cooperation with ASEAN’s Dialogue and Development Partners like the US, Japan, India, Korea, the International Telecommunication Union and the World Bank, as well as the industry.

We have launched the ASEAN Guide on AI Governance and Ethics for traditional AI, and extended it to Generative AI. These serve as practical guides for organisations in the region to design, develop and deploy AI responsibly. More importantly, they support alignment within ASEAN and foster interoperability of AI frameworks across jurisdictions. Through these guides, the ASEAN AI Governance Working Group brings in and adapts global principles and best practices (such as the OECD AI Principles) for Southeast Asia.

To ensure that Southeast Asian needs are also better represented in global AI developments, Singapore organised a regional AI Safety Red Teaming Challenge to test advanced AI models for regional values and languages. This challenge included experts from ASEAN member states, such as Indonesia, Malaysia, Thailand, and Vietnam. Other countries involved in the Challenge are ASEAN dialogue partners, including China, India, Japan, and South Korea.

These initiatives are ways in which Singapore helps bring Southeast Asia’s diverse perspectives to global platforms, such as the OECD, and vice versa.

Looking ahead: Partnering for progress

Singapore will continue to work with partners to step up these efforts so that AI developments will serve the global public good. Specifically, the Singapore Consensus is meant to be a living document. It will evolve as technologies change and as we gather more feedback from governments, industry, and civil society. In this spirit, we encourage all stakeholders to share their insights and explore opportunities for technical collaboration.

We see the Singapore Consensus not as an endpoint, but as the beginning of a broader regional and global dialogue on how to advance AI safety with clarity, cooperation, and shared purpose. We are committed to working through multilateral platforms like the OECD and through regional networks to help build a future where AI benefits everyone.

📘 Read the full Singapore Consensus on Global AI Safety Research Priorities here:
https://www.scai.gov.sg/2025/scai2025-report

The post Strengthening global AI Safety: A perspective on the Singapore Consensus appeared first on OECD.AI.



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Ethics & Policy

AI and ethics – what is originality? Maybe we’re just not that special when it comes to creativity?

Published

on


I don’t trust AI, but I use it all the time.

Let’s face it, that’s a sentiment that many of us can buy into if we’re honest about it. It comes from Paul Mallaghan, Head of Creative Strategy at We Are Tilt, a creative transformation content and campaign agency whose clients include the likes of Diageo, KPMG and Barclays.

Taking part in a panel debate on AI ethics at the recent Evolve conference in Brighton, UK, he made another highly pertinent point when he said of people in general:

We know that we are quite susceptible to confident bullshitters. Basically, that is what Chat GPT [is] right now. There’s something reminds me of the illusory truth effect, where if you hear something a few times, or you say it here it said confidently, then you are much more likely to believe it, regardless of the source. I might refer to a certain President who uses that technique fairly regularly, but I think we’re so susceptible to that that we are quite vulnerable.

And, yes, it’s you he’s talking about:

I mean all of us, no matter how intelligent we think we are or how smart over the machines we think we are. When I think about trust, – and I’m coming at this very much from the perspective of someone who runs a creative agency – we’re not involved in building a Large Language Model (LLM); we’re involved in using it, understanding it, and thinking about what the implications if we get this wrong. What does it mean to be creative in the world of LLMs?

Genuine

Being genuine, is vital, he argues, and being human – where does Human Intelligence come into the picture, particularly in relation to creativity. His argument:

There’s a certain parasitic quality to what’s being created. We make films, we’re designers, we’re creators, we’re all those sort of things in the company that I run. We have had to just face the fact that we’re using tools that have hoovered up the work of others and then regenerate it and spit it out. There is an ethical dilemma that we face every day when we use those tools.

His firm has come to the conclusion that it has to be responsible for imposing its own guidelines here  to some degree, because there’s not a lot happening elsewhere:

To some extent, we are always ahead of regulation, because the nature of being creative is that you’re always going to be experimenting and trying things, and you want to see what the next big thing is. It’s actually very exciting. So that’s all cool, but we’ve realized that if we want to try and do this ethically, we have to establish some of our own ground rules, even if they’re really basic. Like, let’s try and not prompt with the name of an illustrator that we know, because that’s stealing their intellectual property, or the labor of their creative brains.

I’m not a regulatory expert by any means, but I can say that a lot of the clients we work with, to be fair to them, are also trying to get ahead of where I think we are probably at government level, and they’re creating their own frameworks, their own trust frameworks, to try and address some of these things. Everyone is starting to ask questions, and you don’t want to be the person that’s accidentally created a system where everything is then suable because of what you’ve made or what you’ve generated.

Originality

That’s not necessarily an easy ask, of course. What, for example, do we mean by originality? Mallaghan suggests:

Anyone who’s ever tried to create anything knows you’re trying to break patterns. You’re trying to find or re-mix or mash up something that hasn’t happened before. To some extent, that is a good thing that really we’re talking about pattern matching tools. So generally speaking, it’s used in every part of the creative process now. Most agencies, certainly the big ones, certainly anyone that’s working on a lot of marketing stuff, they’re using it to try and drive efficiencies and get incredible margins. They’re going to be on the race to the bottom.

But originality is hard to quantify. I think that actually it doesn’t happen as much as people think anyway, that originality. When you look at ChatGPT or any of these tools, there’s a lot of interesting new tools that are out there that purport to help you in the quest to come up with ideas, and they can be useful. Quite often, we’ll use them to sift out the crappy ideas, because if ChatGPT or an AI tool can come up with it, it’s probably something that’s happened before, something you probably don’t want to use.

More Human Intelligence is needed, it seems:

What I think any creative needs to understand now is you’re going to have to be extremely interesting, and you’re going to have to push even more humanity into what you do, or you’re going to be easily replaced by these tools that probably shouldn’t be doing all the fun stuff that we want to do. [In terms of ethical questions] there’s a bunch, including the copyright thing, but there’s partly just [questions] around purpose and fun. Like, why do we even do this stuff? Why do we do it? There’s a whole industry that exists for people with wonderful brains, and there’s lots of different types of industries [where you] see different types of brains. But why are we trying to do away with something that allows people to get up in the morning and have a reason to live? That is a big question.

My second ethical thing is, what do we do with the next generation who don’t learn craft and quality, and they don’t go through the same hurdles? They may find ways to use {AI] in ways that we can’t imagine, because that’s what young people do, and I have  faith in that. But I also think, how are you going to learn the language that helps you interface with, say, a video model, and know what a camera does, and how to ask for the right things, how to tell a story, and what’s right? All that is an ethical issue, like we might be taking that away from an entire generation.

And there’s one last ‘tough love’ question to be posed:

What if we’re not special?  Basically, what if all the patterns that are part of us aren’t that special? The only reason I bring that up is that I think that in every career, you associate your identity with what you do. Maybe we shouldn’t, maybe that’s a bad thing, but I know that creatives really associate with what they do. Their identity is tied up in what it is that they actually do, whether they’re an illustrator or whatever. It is a proper existential crisis to look at it and go, ‘Oh, the thing that I thought was special can be regurgitated pretty easily’…It’s a terrifying thing to stare into the Gorgon and look back at it and think,’Where are we going with this?’. By the way, I do think we’re special, but maybe we’re not as special as we think we are. A lot of these patterns can be matched.

My take

This was a candid worldview  that raised a number of tough questions – and questions are often so much more interesting than answers, aren’t they? The subject of creativity and copyright has been handled at length on diginomica by Chris Middleton and I think Mallaghan’s comments pretty much chime with most of that.

I was particularly taken by the point about the impact on the younger generation of having at their fingertips AI tools that can ‘do everything, until they can’t’. I recall being horrified a good few years ago when doing a shift in a newsroom of a major tech title and noticing that the flow of copy had suddenly dried up. ‘Where are the stories?’,  I shouted. Back came the reply, ‘Oh, the Internet’s gone down’.  ‘Then pick up the phone and call people, find some stories,’ I snapped. A sad, baffled young face looked back at me and asked, ‘Who should we call?’. Now apart from suddenly feeling about 103, I was shaken by the fact that as soon as the umbilical cord of the Internet was cut, everyone was rendered helpless. 

Take that idea and multiply it a billion-fold when it comes to AI dependency and the future looks scary. Human Intelligence matters



Source link

Continue Reading

Ethics & Policy

Experts gather to discuss ethics, AI and the future of publishing

Published

on

By


Representatives of the founding members sign the memorandum of cooperation at the launch of the Association for International Publishing Education during the 3rd International Conference on Publishing Education in Beijing.CHINA DAILY

Publishing stands at a pivotal juncture, said Jeremy North, president of Global Book Business at Taylor & Francis Group, addressing delegates at the 3rd International Conference on Publishing Education in Beijing. Digital intelligence is fundamentally transforming the sector — and this revolution will inevitably create “AI winners and losers”.

True winners, he argued, will be those who embrace AI not as a replacement for human insight but as a tool that strengthens publishing’s core mission: connecting people through knowledge. The key is balance, North said, using AI to enhance creativity without diminishing human judgment or critical thinking.

This vision set the tone for the event where the Association for International Publishing Education was officially launched — the world’s first global alliance dedicated to advancing publishing education through international collaboration.

Unveiled at the conference cohosted by the Beijing Institute of Graphic Communication and the Publishers Association of China, the AIPE brings together nearly 50 member organizations with a mission to foster joint research, training, and innovation in publishing education.

Tian Zhongli, president of BIGC, stressed the need to anchor publishing education in ethics and humanistic values and reaffirmed BIGC’s commitment to building a global talent platform through AIPE.

BIGC will deepen academic-industry collaboration through AIPE to provide a premium platform for nurturing high-level, holistic, and internationally competent publishing talent, he added.

Zhang Xin, secretary of the CPC Committee at BIGC, emphasized that AIPE is expected to help globalize Chinese publishing scholarships, contribute new ideas to the industry, and cultivate a new generation of publishing professionals for the digital era.

Themed “Mutual Learning and Cooperation: New Ecology of International Publishing Education in the Digital Intelligence Era”, the conference also tackled a wide range of challenges and opportunities brought on by AI — from ethical concerns and content ownership to protecting human creativity and rethinking publishing values in higher education.

Wu Shulin, president of the Publishers Association of China, cautioned that while AI brings major opportunities, “we must not overlook the ethical and security problems it introduces”.

Catriona Stevenson, deputy CEO of the UK Publishers Association, echoed this sentiment. She highlighted how British publishers are adopting AI to amplify human creativity and productivity, while calling for global cooperation to protect intellectual property and combat AI tool infringement.

The conference aims to explore innovative pathways for the publishing industry and education reform, discuss emerging technological trends, advance higher education philosophies and talent development models, promote global academic exchange and collaboration, and empower knowledge production and dissemination through publishing education in the digital intelligence era.

 

 

 



Source link

Continue Reading

Ethics & Policy

Experts gather to discuss ethics, AI and the future of publishing

Published

on

By


Representatives of the founding members sign the memorandum of cooperation at the launch of the Association for International Publishing Education during the 3rd International Conference on Publishing Education in Beijing.CHINA DAILY

Publishing stands at a pivotal juncture, said Jeremy North, president of Global Book Business at Taylor & Francis Group, addressing delegates at the 3rd International Conference on Publishing Education in Beijing. Digital intelligence is fundamentally transforming the sector — and this revolution will inevitably create “AI winners and losers”.

True winners, he argued, will be those who embrace AI not as a replacement for human insight but as a tool that strengthens publishing”s core mission: connecting people through knowledge. The key is balance, North said, using AI to enhance creativity without diminishing human judgment or critical thinking.

This vision set the tone for the event where the Association for International Publishing Education was officially launched — the world’s first global alliance dedicated to advancing publishing education through international collaboration.

Unveiled at the conference cohosted by the Beijing Institute of Graphic Communication and the Publishers Association of China, the AIPE brings together nearly 50 member organizations with a mission to foster joint research, training, and innovation in publishing education.

Tian Zhongli, president of BIGC, stressed the need to anchor publishing education in ethics and humanistic values and reaffirmed BIGC’s commitment to building a global talent platform through AIPE.

BIGC will deepen academic-industry collaboration through AIPE to provide a premium platform for nurturing high-level, holistic, and internationally competent publishing talent, he added.

Zhang Xin, secretary of the CPC Committee at BIGC, emphasized that AIPE is expected to help globalize Chinese publishing scholarships, contribute new ideas to the industry, and cultivate a new generation of publishing professionals for the digital era.

Themed “Mutual Learning and Cooperation: New Ecology of International Publishing Education in the Digital Intelligence Era”, the conference also tackled a wide range of challenges and opportunities brought on by AI — from ethical concerns and content ownership to protecting human creativity and rethinking publishing values in higher education.

Wu Shulin, president of the Publishers Association of China, cautioned that while AI brings major opportunities, “we must not overlook the ethical and security problems it introduces”.

Catriona Stevenson, deputy CEO of the UK Publishers Association, echoed this sentiment. She highlighted how British publishers are adopting AI to amplify human creativity and productivity, while calling for global cooperation to protect intellectual property and combat AI tool infringement.

The conference aims to explore innovative pathways for the publishing industry and education reform, discuss emerging technological trends, advance higher education philosophies and talent development models, promote global academic exchange and collaboration, and empower knowledge production and dissemination through publishing education in the digital intelligence era.

 

 

 



Source link

Continue Reading

Trending