Connect with us

AI Research

Multimodal SAM-adapter for Semantic Segmentation



arXiv:2509.10408v1 Announce Type: cross
Abstract: Semantic segmentation, a key task in computer vision with broad applications in autonomous driving, medical imaging, and robotics, has advanced substantially with deep learning. Nevertheless, current approaches remain vulnerable to challenging conditions such as poor lighting, occlusions, and adverse weather. To address these limitations, multimodal methods that integrate auxiliary sensor data (e.g., LiDAR, infrared) have recently emerged, providing complementary information that enhances robustness. In this work, we present MM SAM-adapter, a novel framework that extends the capabilities of the Segment Anything Model (SAM) for multimodal semantic segmentation. The proposed method employs an adapter network that injects fused multimodal features into SAM’s rich RGB features. This design enables the model to retain the strong generalization ability of RGB features while selectively incorporating auxiliary modalities only when they contribute additional cues. As a result, MM SAM-adapter achieves a balanced and efficient use of multimodal information. We evaluate our approach on three challenging benchmarks, DeLiVER, FMB, and MUSES, where MM SAM-adapter delivers state-of-the-art performance. To further analyze modality contributions, we partition DeLiVER and FMB into RGB-easy and RGB-hard subsets. Results consistently demonstrate that our framework outperforms competing methods in both favorable and adverse conditions, highlighting the effectiveness of multimodal adaptation for robust scene understanding. The code is available at the following link: https://github.com/iacopo97/Multimodal-SAM-Adapter.



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

AI Research

Using AI for homework and social media bans in BBC survey results – BBC

Published

on



Using AI for homework and social media bans in BBC survey results  BBC



Source link

Continue Reading

AI Research

Back to School – With Help From AI – Terms of Service with Clare Duffy

Published

on




Back to School – With Help From AI – Terms of Service with Clare Duffy – Podcast on CNN Podcasts


Kirk suspect reportedly confesses, Tesla stock, ‘tooth-in-eye’ surgery & more

5 Things

Listen to
CNN 5 Things

Mon, Sep 15


On your computer
On your mobile device
Smart speakers

US
World
Politics
Business

podcast

New technologies like artificial intelligence, facial recognition and social media algorithms are changing our world so fast that it can be hard to keep up. This cutting-edge tech often inspires overblown hype — and fear. That’s where we come in. Each week, CNN Tech Writer Clare Duffy will break down how these technologies work and what they’ll mean for your life in terms that don’t require an engineering degree to understand. And we’ll empower you to start experimenting with these tools, without getting played by them.

Back to School – With Help From AI

Terms of Service with Clare Duffy

Sep 16, 2025

Kids are heading back to school. One thing students, teachers and parents can expect to encounter this year is artificial intelligence, which has raised all kinds of questions, both positive and negative. So, how can you make sure your student is navigating AI safely and successfully? Dr. Kathleen Torregrossa has been an educator for 37 years in Cranston, Rhode Island. She explains how teachers are using AI in the classroom, and what families need to know about its impact on learning.  

This episode includes a reference to suicide. Help is available if you or someone you know is struggling with suicidal thoughts or mental health matters. In the US: Call or text 988, the Suicide & Crisis Lifeline. Globally: The International Association for Suicide Prevention and Befrienders Worldwide have contact information for crisis centers.

CNN Sans ™ & © 2016 Cable News Network.



Source link

Continue Reading

AI Research

Lewis Honors College introduces ‘Ideas that Matter’ program series

Published

on


LEXINGTON, Ky. (Sept. 16, 2025) — This fall, the Lewis Honors College (LHC) launches its “Ideas that Matter” series, a program connecting students with leading scholars, innovators and changemakers on issues shaping today’s world — from free speech and artificial intelligence to nonprofit innovation.

LHC Director of College Life Libby Hannon, who initiated the series, said the goal is to spark lively dialogue.

“The ‘Ideas that Matter’ discussions combine intellectually engaging questions with interactive conversations and allow our students to speak with some of the most forward-thinking scholars, changemakers and entrepreneurs from Lexington and beyond,” Hannon said.

The series begins Sept. 18 with University Research Professor Neal Hutchens, Ph.D., who will explore the historical and legal background of free speech and academic freedom in campus life. His talk, 5-6 p.m. in the Lewis Scholars Lounge, will conclude with an interactive Q&A.

“I’m especially looking forward to the conversation part of the evening, where we engage in and model the kind of vibrant back-and-forth that is crucial to maintaining systems of free speech and academic freedom,” Hutchens said.

On Oct. 6, Lewis Lecturer Sherelle Roberts, Ph.D., will moderate a panel of experts on artificial intelligence as they discuss “The Future of Earth and AI,” including the current and potential impacts of artificial intelligence on the future of work, the economy and the environment.

“Artificial Intelligence is quickly becoming a part of our everyday lives. Some even believe AI will transform our world as dramatically as the Industrial Revolution,” Roberts said. “This event will get our students thinking critically about our possible AI-driven future, while also having some fun.”

The event will begin at 5:30 p.m. with movie snacks and will transition into the panel discussion at 6 p.m., featuring faculty and staff from a variety of disciplines. The movie, an animated film that conceptualizes our AI-powered future, will begin at 7 p.m.

The final event of the semester on Nov. 11, will spotlight local nonprofit Operation Secret Santa (OSS), 5-6 p.m. in the Lewis Scholars Lounge. Founder Katie Keys and honors program alum Lucy Jett Waterbury will share the story of OSS’s creation in 2016 and its growing impact on the community.

“Operation Secret Santa is built on the belief that no child should face barriers to feeling loved and celebrated,” said Keys. “We meet families where they are, right at their doorsteps, bringing not only gifts and food, but the reminder that their village sees them and cares.”

“From (Katie’s) big heart, she has built a big, yet lean and efficient, nonprofit that has one very simple goal, to bring joy to Kentucky kids at Christmas time,” Waterbury said.

Through this series, LHC offers students a chance to engage with pressing issues, broaden their perspectives and learn directly from those making a difference.



Source link

Continue Reading

Trending