The use of artificial intelligence in medical education is raising urgent questions about quality, ethics, and oversight. A new study explores how AI is being deployed in training programs and the risks of implementing poorly validated systems.

The research, titled “Artificial Intelligence in Medical Education: A Narrative Review on Implementation, Evaluation, and Methodological Challenges” and published in AI in 2025, presents a sweeping review of the ways AI is already embedded in undergraduate and postgraduate medical education. It highlights both the opportunities offered by AI-driven tutoring, simulations, diagnostics, and assessments, and the methodological and ethical shortcomings that could undermine its long-term effectiveness.

How AI is being implemented in medical education

The study found four major areas where AI is reshaping medical training: tutoring and content generation, simulation and practice, diagnostic skill-building, and competency assessment.

AI-driven tutoring is already gaining ground through large language models such as ChatGPT, which generate quizzes, exam preparation tools, and academic writing support. These tools have been shown to improve student engagement and test performance. However, the research underscores that such systems require constant human supervision to prevent factual errors and discourage students from outsourcing critical thinking.

Simulation and practice environments are another area of rapid development. Machine learning and virtual reality platforms are being deployed to train students in surgery, anesthesia, and emergency medicine. These systems deliver real-time performance feedback and can differentiate between novice and expert performance. Yet challenges persist, including scalability issues, lack of interpretability, and concerns that students may lose self-confidence if they rely too heavily on automated guidance.

Diagnostic training has also been revolutionized by AI. In specialties such as radiology, pathology, dermatology, and ultrasound, AI systems often outperform students in visual recognition tasks. While this demonstrates significant potential, the study warns that biased datasets and privacy concerns linked to biometric data collection could reinforce inequities. Over-reliance on automated diagnosis also risks weakening clinical judgment.

Competency assessment is the fourth area of innovation. Deep learning and computer vision tools now enable objective and continuous evaluation of motor, cognitive, and linguistic skills. They can identify expertise levels, track errors, and deliver adaptive feedback. Still, most of these tools suffer from limited validation, lack of generalizability across contexts, and weak clinical integration.

What risks and challenges are emerging

Enthusiasm for AI must be tempered by a recognition of its limitations, the study asserts. Methodologically, fewer than one-third of published studies rely on randomized controlled trials. Many evaluations are exploratory, small-scale, or short-term, limiting the evidence base for AI’s real impact on education.

There are also risks of passive learning. When students turn to AI systems for ready-made solutions, they may bypass the critical reasoning that medical training is designed to foster. This dynamic raises concerns about the erosion of clinical decision-making skills and the creation of over-dependent learners.

Ethical challenges are equally pressing. Training data for AI systems is often incomplete, unrepresentative, or biased, leading to disparities in how well these tools perform across different populations. Compliance with privacy frameworks such as GDPR remains inconsistent, especially when biometric or sensitive patient data is used in educational platforms. Unequal access to AI resources also risks widening the gap between well-resourced and low-resource institutions, exacerbating inequalities in global medical training.

The study also highlights gaps in faculty preparedness. Many educators lack sufficient AI literacy, leaving them unable to properly supervise or critically evaluate AI-assisted teaching. This threatens to create an uneven landscape in which some institutions adopt AI thoughtfully while others deploy it without adequate safeguards.

What must be done to ensure responsible adoption

The study provides a clear roadmap for addressing these challenges. At its core is the principle of human-in-the-loop supervision. AI should complement but never replace instructors, ensuring that students continue to develop critical reasoning alongside digital support.

The authors call for more rigorous research designs. Longitudinal, multicenter studies and randomized controlled trials are needed to generate evidence that is both reliable and generalizable. Without such studies, AI’s promise in medical education remains speculative.

Curriculum reform is another priority. AI literacy, ethics, and critical appraisal must become standard components of medical training so that students can understand not only how to use AI but also how to question and evaluate it. Educators, too, require training to guide responsible use and prevent misuse.

Finally, the study presses for inclusivity. Access to AI-driven tools must be extended to low-resource settings, ensuring that medical education worldwide benefits from innovation rather than reinforcing divides. Regulatory frameworks should also evolve to cover privacy, fairness, and accountability in AI-assisted learning.

BBC

‘I lost a relationship’

‘Trying to catch up on the lost moments’

Living life online

Lasting effects

Artificial intelligence (AI) programs such as ChatGPT, Grok, and others haven’t been around that long, but their popularity has absolutely skyrocketed, and it is easy to see why. While nobody would argue that they are perfect, they are able to perform some amazing tasks and serve as a great resource to people in a variety of situations.

Many industries are trying to find the right balance when it comes to how and when AI should be used. With most companies, this is just going to be a matter of trial and error. When a company gets it wrong, they will suffer and at worst, go out of business. For the education industry, however, the stakes are much higher. If schools don’t handle AI properly, it could result in millions of young people finding themselves at a disadvantage for the rest of their lives.

On the one hand, schools want to make sure that their students are actually learning (and, perhaps more importantly, learning HOW to learn) rather than just pasting an assignment into ChatGPT and turning in whatever it spits out. On the other hand, there is almost no doubt that AI is here to stay, so failing to teach students how to effectively use it is going to be equally debilitating.

Shutterstock

On top of that, there is the question of how educators and administrators should use AI.

It is clear that AI tools can help complete a lot of tasks much more quickly, which frees up teachers to actually teach. In a world where there aren’t enough teachers to go around, this could be a critical resource. The potential problem, however, is that when AI gets something wrong, it does so very confidently, which can lead to many other issues. For example, many teachers use AI to grade papers, which in theory should be fine. When the AI does it incorrectly, however, the students will notice and feel betrayed. When students lose confidence in their teachers, they often lose the desire to learn.

The New York Times reported on how schools are using AI for various things including grading papers, tutoring students, and much more. There are even some tools available that will monitor the grades, behavior reports, and even social media activity of students and publish reports to the administrators to try to catch at-risk students and get them help.

While this obviously has a lot of potential to do good for the students, it can also feel like a major overstep when it comes to privacy and providing students with the attention from real people that they may need.

On top of that, there are real concerns with schools telling students that they are not allowed to use AI for their assignments, but then the teachers are using AI for their work. This topic is filled with nuance, but it is easy to see how students would think of this as a double standard.

Shutterstock

Unfortunately, AI is advancing much more quickly than schools, and it is the students that are being left behind. Fortunately, some schools are at least making an effort to find the right balance. For example, prohibiting the use of AI for certain activities, but also offering classes that specifically teach students how to use AI for other activities.

Mistakes will undoubtedly be made, but as long as schools are willing to adopt this technology and guide the students on how to ethically use it, they will benefit in the end.

If you enjoyed that story, check out what happened when a guy gave ChatGPT $100 to make as money as possible, and it turned out exactly how you would expect.