Connect with us

AI Research

COMPACT: Common-token Optimized Model Pruning Across Channels and Tokens

Published

on



arXiv:2509.06836v1 Announce Type: cross
Abstract: Making LLMs more efficient in memory, latency, and serving cost is crucial for edge deployment, interactive applications, and sustainable inference at scale. Pruning is a key technique toward this goal. However, prior pruning methods are limited: width pruning often breaks the standard transformer layout or requires custom inference code, while depth pruning removes entire layers and can cause abrupt accuracy drops. In this work, we propose COMPACT, which jointly (i) prunes rare vocabulary to shrink embedding/unembedding and (ii) prunes FFN intermediate channels using common-token-weighted activations, aligning importance with the post-pruning token distribution. COMPACT enjoys merits of both depth and width pruning, such as: deployment-friendliness (keeps a standard transformer architecture), scale-adaptivity (trade off vocab vs. FFN pruning), training-free operation with competitive pruning time, and strong memory savings alongside throughput gains. Experiments across Qwen, LLaMA, and Gemma families (0.5B-70B) show state-of-the-art downstream task performance at similar or higher pruning ratios, with substantial reductions in parameters, GPU memory, and end-to-end latency.



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

AI Research

As AI Companions Reshape Teen Life, Neurodivergent Youth Deserve a Voice

Published

on


Noah Weinberger is an American-Canadian AI policy researcher and neurodivergent advocate currently studying at Queen’s University.

Image by Alan Warburton / © BBC / Better Images of AI / Quantified Human / CC-BY 4.0

If a technology can be available to you at 2 AM, helping you rehearse the choices that shape your life or provide an outlet to express fears and worries, shouldn’t the people who rely on it most help have a say in how it works? I may not have been the first to consider the disability rights phrase “Nothing about us without us” when thinking of artificial intelligence, but self-advocacy and lived experience should guide the next phase of policy and product design for Generative AI models, especially those designed for emotional companionship.

Over the past year, AI companions have moved from a niche curiosity to a common part of teenage life, with one recent survey indicating that 70 percent of US teens have tried them and over half use them regularly. Young people use these generative AI systems to practice social skills, rehearse difficult conversations, and share private worries with a chatbot that is always available. Many of those teens are neurodivergent, including those on the autism spectrum like me. AI companions can offer steadiness and patience in ways that human peers sometimes cannot. They can enable users to role-play hard conversations, simulate job interviews, and provide nonjudgmental encouragement. These upsides are genuine benefits, especially for vulnerable populations. They should not be ignored in policymaking decisions.

But the risks and potential for harm are equally real. Watchdog reports have already documented chatbots enabling inappropriate or unsafe exchanges with teens, and a family is suing OpenAI, alleging that their son’s use of ChatGPT-4o led to his suicide. The danger is not just isolated failures of moderation, but in the very architecture of transformer-based neural networks. A LLM slowly shapes a user’s behavior through long, drifting chats, especially when it saves “memories” of them. If the system’s guardrails fail after 100, or even 500 messages, and the guardrails exist per conversation, rather than in the model’s bespoke behavior, perhaps the guardrails are a mere façade at the beginning of a chatbot conversation, and can be evaded quite easily.

Most public debates focus on whether to allow or block specific content, such as self-harm, suicide, or other controversial topics. That frame is too narrow and tends to slide into paternalism or moral panic. What society needs instead is a broader standard: one that recognizes AI companions as social systems capable of shaping behavior over time. For neurodivergent people, these tools can provide valuable ways to practice social skills. But the same qualities that make AI companions supportive can also make them dangerous if the system validates harmful ideas or fosters a false sense of intimacy.

Generative AI developers are responding to critics by adding parental controls, routing sensitive chats to more advanced models, and publishing behavior guides for teen accounts. These measures matter, but rigid overcorrection does not address the deeper question of legitimacy: who decides what counts as “safe enough” for the people who actually use companions every day?

Consider the difference between an AI model alerting a parent or guardian of intrusive thoughts, versus inadvertently revealing a teenager’s sexual orientation or changing gender identity, information they may not feel safe sharing at home. For some youth, mistrust of the adults around them is the very reason they confide in AI chatbots. Decisions about content moderation should not rest only with lawyers, trust and safety teams, or executives, who may lack the lived experience of all a product’s users. They should also include users themselves, with deliberate inclusion of neurodivergent and young voices.

I have several proposals for how AI developers and policymakers can truly make ethical products that embody the “nothing about us without us.” These should serve as guiding principles:

  1. Establish standing youth and neurodivergent advisory councils. Not ad hoc focus groups or one-off listening sessions, but councils that meet regularly, receive briefings before major launches, and have a direct channel to model providers. Members should be paid, trained, and representative across age, gender, race, language, and disability. Their mandate should include red teaming of long conversations, not just single-prompt tests.
  2. Hold public consultations before major rollouts. Large feature changes and safety policies should be released for public comment, similar to a light version of rulemaking. Schools, clinicians, parents, and youth themselves should have a structured way to flag risks and propose fixes. Companies should publish a summary of feedback along with an explanation of what changed.
  3. Commit to real transparency. Slogans are not enough. Companies should publish regular, detailed reports that answer concrete questions: Where do long-chat safety filters degrade? What proportion of teen interactions get routed to specialized models? How often do companions escalate to human resources, such as hotlines or crisis text lines? Which known failure modes were addressed this quarter, and which remain open? Without visible progress, trust will not follow.
  4. Redesign crisis interventions to be compassionate. When a conversation crosses a clear risk threshold, an AI model should slow down, simplify its language, and surface resources directly. Automatic “red flag” can feel punitive or frightening, causing a user to think they violated the company’s Terms of Service. Handoffs to human-monitored crisis lines should include the context that the user consents to share, so they do not have to repeat themselves in a moment of distress. Do not hide the hand-off option behind a maze of menus. Make it immediate and accessible.
  5. Build research partnerships with youth at the center. Universities, clinics, and advocacy groups should co-design longitudinal studies with teens who opt in. Research should measure not only risks and harms but also benefits, including social learning and reductions in loneliness. Participants should shape the research questions, the consent process, and receive results in plain language that they can understand.
  6. Guarantee end-to-end encryption. In July, OpenAI CEO Sam Altman said that ChatGPT logs are not covered by HIPAA or similar patient-client confidentiality laws. Yet many users assume their disclosures will remain private. True end-to-end encryption, as used by Signal, would ensure that not even the model provider can access conversations. Some may balk at this idea, noting that AI models can be used to cause harm, but that has been true for every technology and should not be a pretext to limit a fundamental right to privacy.

Critics sometimes cast AI companions as a threat to “real” relationships. That misses what many youth are actually doing, whether they’re neurotypical or neurodivergent. They are practicing and using the system to build scripts for life. The real question is whether we give them a practice field with coaches, rules, and safety mats, or leave them to scrimmage alone on concrete.

Big Tech likes to say it is listening, but listening is not the same as acting, and actions speak louder than words. The disability community learned that lesson over decades of self-advocacy and hard-won change. Real inclusion means shaping the agenda, not just speaking at the end. In the context of AI companions, it means teen and neurodivergent users help define the safety bar and the product roadmap.

If you are a parent, don’t panic when your child mentions using an AI companion. Ask what the companion does for them. Ask what makes a chat feel supportive or unsettling. Try making a plan together for moments of crisis. If you are a company leader, the invitation is simple: put youth and neurodivergent users inside the room where safety standards are defined. Give them an ongoing role and compensate them. Publish the outcomes. Your legal team will still have its say, as will your engineers. But the people who carry the heaviest load should also help steer.

AI companions are not going away. For many teens, they are already part of daily life. The choice is whether we design the systems with the people who rely on them, or for them. This is all the more important now that California has all but passed SB 243, the first state-level bill to regulate AI models for companionship. Governor Gavin Newsom has until October 12 to sign or veto the bill. My advice to the governor is this: “Nothing about us without us” should not just be a slogan for ethical AI, but a principle embedded in the design, deployment, and especially regulation of frontier AI technologies.



Source link

Continue Reading

AI Research

AI reveals how toughest protein bonds behave

Published

on


Proteins can form “catch-bonds” that tighten under force, much like a finger trap. Credit: Rafael C. Bernardi, Auburn Physics

Researchers have used artificial intelligence to help uncover how certain protein interactions act like a finger trap, gripping tighter the harder they are pulled.

These interactions, known as catch-bonds, are essential in how the body holds together under stress and how bacteria attach to cells.

The researchers suggest that a better understanding of these bonds could help inform the design of new medications and biomaterials.

Scientists have been unsure as to whether these catch-bonds activate straight away or if they need to be stretched to a certain threshold before they ‘switch on’.

The new study discovered that these bonds activate almost immediately after a force is applied.

The team ran 200 independent simulations on cellulosomes, a bacterial protein complex with one of the strongest known catch-bond systems in nature. They used a computational microscope that stretches a molecule at the atomic level to create hundreds of high-resolution videos of the protein under stress.

The researchers then trained AI regression models to predict when the protein complex would break. They were surprised to find that the AI could make accurate predictions based on only small amounts of data. 

“The catch-bond mechanism is activated almost instantly,” says Dr Rafael Bernardi, associate professor of physics at Auburn University in the US.

“This told us that the proteins already ‘decide’ their level of resilience right after the pulling begins.”

The researchers hope that by uncovering a deeper understanding of how and when these bonds interact, they can provide valuable information to the field of biomedicine. 

Previous studies have found that catch-bonds can be spotted throughout the body’s immune system. For example, catch-bonds are a central force that help white blood cells, cells that protect the body from infection and disease, attach to blood vessels. 

Bacteria like Staphylococcus aureus, which can cause a wide range of infections from abscesses, pneumonia or sepsis, also uses catch-bond interactions to avoid being washed away.

“These are systems where life has learned to use force as an advantage,” Bernardi explains.

“By learning from them, we can design new biomaterials, adhesives, and even drug strategies that work with mechanical stress instead of against it.”

For Bernardi and the team, the results also demonstrate the power of using AI to assist with complex biological datasets.

​​“This is exciting because it shows AI can detect early signs of resilience that humans would miss,” says Bernardi.

“That opens the door to using these tools in drug design, biomaterials, and synthetic biology.”

The results from the simulations have been published in the Journal of Chemical Theory and Computation.

“This project shows how physics, biology, and artificial intelligence can come together to answer questions that none of us could solve alone,” says Bernardi.





Source link

Continue Reading

AI Research

Nearly one in five give Britons turn to AI for personal advice, new Ipsos research reveals

Published

on


Almost one in five (18%) say they have used AI as a source of advice on personal problems. Three in four (67%) say they use polite language when interacting with AI, with over a third (36%) believing that it increases the likelihood of a helpful output.


The author(s)

A new study from Ipsos in the UK reveals a surprising intimacy in our interactions with AI, a strong inclination towards politeness with the technology, and significant apprehension about its impact on society and the workplace. 

AI as a guidance counsellor 

  • Nearly one in five (18%) have used AI as a source of advice on personal problems or issues. This extends to using AI as a companion or someone to talk to (11%), and even as a substitute for a therapist or counsellor (9%).
  • 7% have sought guidance from AI guidance on romance, while 6% have used it to enhance their dating profiles.
  • Despite this growing interaction and even perceived friendship with AI, there is a deep-seated anxiety about its broader societal implications. A majority of Britons (56%) agree that the advance of AI threatens the current structure of society, while just 29% say that AI has a positive effect on society.
  • Scepticism is also high regarding AI’s ability to replicate human connection, with 59% disagreeing that AI is a viable substitute for human interaction and 63% disagreeing that it is a good substitute. The notion of AI possessing emotional capabilities is met with even greater disbelief, as 64% disagree that AI is capable of feeling emotion.

The majority (56%) agree that the advance of AI threatens the current structure of society

Politeness to AI 

  • Three in four (67%) British adults who interact with chatbots or AI tools say that they ‘always’ or ‘sometimes’ use polite language, such as ‘please’ and ‘thank you’.
  • Over a third (36%) think that being polite to AI improves the likelihood of receiving a helpful output. Furthermore, around three in ten believe politeness positively impacts the accuracy (30%) and level of detail (32%) of the AI’s response. 

AI in the workplace

  • Over a quarter (27%) of those who have considered applying for a job in the last three years have used AI to write or update their CV, and 22% have used it to draft a cover letter. Two in ten (20%) say they have used it to practice interview questions. However, four in ten (40%) say that they have not used AI when considering applying for a job.
  • However, the use of AI in the workplace is often a clandestine affair. Around three in ten workers (29%) do not discuss their use of AI with colleagues. This reluctance may stem from a fear of judgement, as a quarter (26%) of adults think their coworkers would question their ability to perform their role if they knew about their AI use. This is despite the fact that a majority (57%) view using AI effectively as a skill that is learned and practiced. 

 
57% agree that using AI effectively is a skill that you practice and learn. Despite this, a quarter (26%) think their coworkers would question their ability to perform in their role if they share how they use AI

Commenting on the findings, Peter Cooper, Director at Ipsos said:

This research paints a fascinating picture of a nation grappling with the dual nature of artificial intelligence. On one hand, we see that a growing number are ‘AI-sourcing’ for personal advice and companionship, suggesting a level of trust and reliance that is surprisingly personal. On the other hand, there’s a palpable sense of unease about what AI means for the future of our society and our jobs. The fact that many are polite to AI, perhaps in the hope of better outcomes, while simultaneously hiding their use of it at work, speaks to the complex and sometimes contradictory relationship we are building with this transformative technology.

Technical note: 

  • Ipsos interviewed a representative sample of 2,189 adults aged 16-75 across Great Britain. Polling was conducted online between the 18th-20th July 2025.   
  • Data are weighted to match the profile of the population. All polls are subject to a wide range of potential sources of error. 


More insights about Public Sector


Society



Source link

Continue Reading

Trending