events

Congress tackles broadband, AI and energy in a busy week of hearings. Broadband Breakfast’s Resilient Critical Infrastructure Summit is on Thursday.

Our Findings

Finding 1: Teachers valued many different criteria but placed highest importance on accuracy, inclusiveness, and utility. 

We analyzed 61 rubrics that teachers created to evaluate AI. Teachers generated a diverse set of criteria, which we grouped into ten categories: accuracy, contextual awareness, engagingness, fidelity, inclusiveness, output variety, pedagogical soundness, user agency, and utility. We asked teachers to rank their criteria in order of importance and found a relatively flat distribution, with no single criterion emerging as one that a majority assigned highest importance. Still, our results suggest that teachers placed highest importance on accuracy, inclusiveness, and utility. 13% of teachers listed accuracy (which we defined as mathematically accurate, grounded in facts, and trustworthy) as their top evaluation criterion. Several teachers cited “trustworthiness” and “mathematical correctness” as their most important evaluation criteria, and another teacher described accuracy as a “gateway” for continuing evaluation; in other words, if the tool was not accurate, it would not even be worth further evaluation. Another 13% ranked inclusiveness (which we defined as accessible to diverse cognitive and cultural needs of users) as their top evaluation criterion. Teachers required AI tools to be inclusive to both student and teacher users. With respect to student users, teachers suggested that AI tools must be “accessible,” free of “bias and stereotypes,” and “culturally relevant.” They also wanted AI tools to be adaptable for “all teachers.” One teacher wrote, “Different teachers/scenarios need different levels/styles of support. There is no ‘one size fits all’ when it comes to teacher support!” Additionally, 11% of teachers reported utility as their top evaluation criterion (defined as benefits of using the tool significantly outweigh the costs). Teachers who cited this criterion valued “efficiency” and “feasibility.” One added that AI needed to be “directly useful to me and my students.” 

In addition to accuracy, inclusiveness, and utility, teachers also valued tools that were relevant to their grade level or other context (10%), pedagogically sound (10%), and engaging (7%). Additionally, 8% reported that AI tools should be faithful to their own methods and voice. Several teachers listed “authentic,” “realistic,” and “sounds like me” as top evaluation criteria. One remarked that they wanted ChatGPT to generate questions for coaching colleagues, “in my voice,” adding, “I would only use ChatGPT-generated coaching questions if they felt like they were something I would actually say to that adult.” 

Table 1. Codes for the top criteria, along with definitions and examples. 

Teachers expressed criteria in their own words, which we categorized and quantified via inductive coding.

We have summarized teachers’ evaluation criteria on the chart below:

Finding 2: Teachers’ evaluation criteria revealed important tensions in AI edtech tool design.

In some cases, teachers listed two or more evaluation criteria that were in tension with one another. For example, many teachers emphasized the importance of AI tools that were relevant to their teaching context, grade level, and student population, while also being easy to learn and use. Yet, providing AI tools with adequate context would likely require teachers to invest significant time and effort, compromising efficiency and utility. Additionally, tools with high degrees of context awareness might also pose risks to student privacy, another evaluation criterion some teachers named as important. Teachers could input student demographics, Individualized Education Plans (IEPs), and health records into an AI tool to provide more personalized support for a student. However, the same data could be leaked or misused in a number of ways, including further training of AI models without consent. 

Another tension apparent in our data was the tension between accuracy and creativity. As mentioned above, teachers placed highest importance on mathematical correctness and trustworthiness, with one stating that they would not even consider other criteria if a tool was not reliably accurate or produced hallucinations. However, several teachers also listed creativity as a top criterion – a trait produced by LLMs’ stochasticity, which in turn also leads to hallucinations. The tension here is that while accuracy is paramount for fact-based queries, teachers may want to use AI tools as a creative thought-partner for generating novel, outside-the-box tasks – potentially with mathematical inaccuracies – that motivate student reasoning and discussion. 

Finding 3: A collaborative approach helped teachers quickly arrive at nuanced criteria. 

One important finding we observed is that, when provided time and structure to explore, critique, and design with AI tools in community with peers, teachers develop nuanced ways of evaluating AI – even without having received training in AI. Grounding the summit in both teachers’ own values and concrete problems of practice helped teachers develop specific evaluation criteria tied to realistic classroom scenarios. We used purposeful tactics to organize teachers into groups with peers who held different experiences with and attitudes toward AI than they did, exposing them to diverse perspectives they may not have otherwise considered. Juxtaposing different perspectives informed thoughtful, balanced evaluation criteria, such as, “Teaching students to use AI tools as a resource for curiosity and creativity, not for dependence.” One teacher reflected, “There is so much more to learn outside of where I’m from and it is encouraging to learn from other people from all over.” 

Over the course of the summit, several of our facilitators observed that teachers – even those who arrived with strong positive or strong negative feelings about AI – adopted a stance toward AI that we characterized as “critical but curious.” They moved easily between optimism and pessimism about AI, often in the same sentence. One teacher wrote in her summit reflection, “I’m mostly skeptical about using AI as a teacher for lesson planning, but I’m really excited … it could be used to analyze classroom talk, give students feedback … and help teachers foster a greater sense of community.” Another summed it up well: “We need more people dreaming and creating positive tools to outweigh those that will create tools that will cause challenges to education and our society as a whole.”

Customer speakers include CarShield Founder, President and COO Steve Proetz; Topgolf Director of Global Technology Delivery Doug Klausen; GetixHealth CTO David Stuart; HD Supply Vice President of IT Emil DiMotta III and more, along with Cisco partners and leaders 

SAN JOSE, Calif., Sept. 15 2025 — Cisco (NASDAQ: CSCO) today announced its luminary customers and partners headlining WebexOne, Cisco’s annual AI Collaboration and Customer Experience event, taking plance from September 28 – October 1, 2025 in San Diego. This year, executives from top global brands will take the stage to highlight how Cisco is addressing today’s demands for AI-powered innovations for the employee and customer experience. 

WHO: Webex by Cisco, a leader in powering employee and customer experience solutions with AI, is hosting its annual signature event, WebexOne. 

WHAT: The multiday event will explore trending topics shaping today’s workforce across generative AI, customer experience, and conferencing and office tech. WebexOne will feature the latest innovations from Cisco, executive-led sessions on product and strategy news, and customer conversations with inspiring leaders from the world’s leading brands. 

• Featured Brands and Customers: More than 50 Webex customers and partners will speak at WebexOne, including Conagra Brands, Kennedy Space Center, Brightli and more. All will address how they’re partnering with Cisco to revolutionize customer experiences and collaboration with AI. 

• Luminary Speakers: Ryan Reynolds, acclaimed Actor, film Producer, and Entrepreneur, will be the closing keynote. Ryan will explore the art of creative leadership, storytelling, and innovation across entertainment, business, and beyond. Deepu Talla, Vice President of Robotics and Edge AI at NVIDIA, will offer a visionary look at the new era of AI, highlighting the transformative possibilities ahead. 

• Inspiring Cisco Leaders: Cisco executives, including Jeetu Patel, President and Chief Product Officer, Anurag Dhingra, SVP & GM of Cisco Collaboration, Aruna Ravichandran, SVP and Chief Marketing & Customer Officer, and others will take the stage to discuss Cisco’s vision for artificial intelligence, customer experience, and collaboration. They will also showcase the latest technology revolutionizing the future of work and customer experience, and discuss how they integrate with Cisco’s broader product portfolio. 

Immersive Training: 

All attendees will also have the option to attend a training program that offers hands-on demos, 200+ hours of learning from 82 classes and labs, and 100+ breakout sessions featuring top customers and Cisco speakers. 

Cisco will also announce its fourth-annual Webex Customer Award winners at the event. 

WHEN: 

September 28 – October 1, 2025, beginning at 9 a.m. PT 

WHERE: 

In-person: Marriott Marquis, San Diego Marina 

Broadcast virtually: Using the Webex Events app 

For press interested in behind-the-scenes exclusive access onsite at WebexOne, please contact Webex PR at webexpr@external.cisco.com. For general registration, please visit the link here.