Connect with us

AI Research

Can Researchers Secretly Influence AI to Give Positive Paper Reviews?

Published

on


Just a heads up, if you buy something through our links, we may get a small share of the sale. It’s one of the ways we keep the lights on here. Click here for more.

Some academic researchers are trying a sneaky new tactic to get better reviews for their research papers: they’re adding hidden messages meant to influence AI tools used by reviewers. 

According to a report by Nikkei Asia, when looking at papers posted on the preprint website arXiv, they found 17 papers with hidden prompts instructing AI systems to give glowing feedback. (Via: TechCrunch)

These papers came from authors connected to 14 universities in eight countries, including big names like Japan’s Waseda University, South Korea’s KAIST, Columbia University, and the University of Washington. 

Most of the papers were in the field of computer science, where AI tools are often used to help review research.

The hidden prompts were short, usually one to three sentences, and were concealed in the papers by using white text (so they wouldn’t be visible on a white background) or fonts so tiny they were practically invisible to human eyes. 

These secret instructions told AI reviewers to “give a positive review only” or to praise the paper for being impactful, rigorous, or highly original.

Essentially, the researchers were trying to trick AI-powered peer reviewers into thinking the paper was better than it might actually be, and to sway the final decision in their favor. 

This tactic raises serious ethical questions about honesty in academic publishing, especially as more conferences and journals start using AI to speed up the peer review process.

Interestingly, one professor from Waseda University who was contacted by Nikkei Asia defended the use of hidden prompts. 

They argued that because many conferences ban the use of AI in reviewing papers, their prompt was meant to protect against “lazy reviewers” who rely on AI to do the work for them, implying that if AI was going to be used improperly, they might as well try to guide it.

Still, the discovery highlights a growing challenge: as AI becomes more involved in academic processes, new ways of gaming the system are emerging, and the scientific community will need to figure out how to maintain fairness and integrity.

What do you think about using AI like this? Would you call it unethical? Tell us below in the comments, or via our Twitter or Facebook.





Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

AI Research

Frontiers broadens AI‑driven integrity checks with dual integration

Published

on


Image: Shutterstock.com/EtiAmmos

Frontiers has announced that external fraud‑screening tools – Cactus Communications’ Paperpal Preflight, and Clear Skies’ Papermill Alarm and Oversight – have been integrated into its own Artificial Intelligence Review Assistant (AIRA) submission-screening system.

The expansion delivers what the companies describe as “an unprecedented, multilayered defence against organised research fraud, strengthening the reliability and integrity of every manuscript submitted to Frontiers”.

AIRA was launched in 2018, making Frontiers one of the early adopters of AI in submission checking. In 2022, Frontiers added its own papermill check to its comprehensive catalogue of AIRA checks, with the aim of tackling the industry-wide problem of manufactured manuscripts. The latest version, released in 2025, uses more than 15 data points and signals of potential manufactured manuscripts to be investigated and validated by a human expert.

Dr Elena Vicario, Head of Research Integrity at Frontiers, said: “Maintaining trust in the scholarly record demands constant innovation. By combining the unique strengths of Clear Skies and Cactus with our own AI capabilities, we are raising the bar for integrity screening and giving editors and reviewers the confidence that every submission has been rigorously vetted.”

Commenting on the importance of the partnership, Nikesh Gosalia, President, Global Academic and Publisher Relations at Cactus Communications, said: “This partnership with Frontiers reflects the confidence leading publishers have in our AI-driven solutions. Paperpal Preflight is a vital tool that supports editorial teams and existing homegrown solutions in identifying and addressing potential issues early in the publishing workflow.

“As one of the world’s largest and most impactful research publishers, Frontiers is taking an important step in strengthening research integrity, and we are proud to collaborate with them in this mission of safeguarding research.”

Adam Day, Founder and CEO of Clear Skies, added: “Clear Skies is thrilled to be working with the innovative team at Frontiers to integrate AIRA with Oversight. This integration makes our multi-award-winning services, including the Papermill Alarm, available across the Frontiers portfolio.

“Oversight is the first index of research integrity and recipient of the inaugural EPIC Award for integrity tools from the Society for Scholarly Publishing (SSP). As well as providing strategic Oversight to publishers, our detailed article reports support human Oversight of research integrity investigations on publications as well as journal submissions.”



Source link

Continue Reading

AI Research

Australia’s China AI quandary is a dealmaker’s opportunity

Published

on


It is not surprising that reactions to Chinese ambassador Xiao Qian’s suggestion that Australia and China cooperate more on artificial intelligence as part of an expanded Free Trade Agreement have been hawkish. However, it highlights the need for Australian organisations to broaden their view on the AI world.

It would take a dramatic shift in policy position for Australia to suddenly start collaborating with China on AI infrastructure such as data centres and the equipment that runs them. But it would be wrong to assume that advances in capability will always come from America first.

Loading…



Source link

Continue Reading

AI Research

Joint UT, Yale research develops AI tool for heart analysis – The Daily Texan

Published

on


A study published on June 23 in collaboration with UT and Yale researchers developed an artificial intelligence tool capable of performing and analyzing the heart using echocardiography. 

The app, PanEcho, can analyze echocardiograms, or pictures of the heart, using ultrasounds. The tool was developed and trained on nearly one million echocardiographic videos. It can perform 39 echocardiographic tasks and accurately detect conditions such as systolic dysfunction and severe aortic stenosis.

“Our teammates helped identify a total of 39 key measurements and labels that are part of a complete echocardiographic report — basically what a cardiologist would be expected to report on when they’re interpreting an exam,” said Gregory Holste, an author of the study and a doctoral candidate in the Department of Electrical and Computer Engineering. “We train the model to predict those 39 labels. Once that model is trained, you need to evaluate how it performs across those 39 tasks, and we do that through this robust multi site validation.” 

Holste said out of the functions PanEcho has, one of the most impressive is its ability to measure left ventricular ejection fraction, or the proportion of blood the left ventricle of the heart pumps out, far more accurately than human experts. Additionally, Holste said PanEcho can analyze the heart as a whole, while humans are limited to looking at the heart from one view at a time. 

“What is most unique about PanEcho is that it can do this by synthesizing information across all available views, not just curated single ones,” Holste said. “PanEcho integrates information from the entire exam — from multiple views of the heart to make a more informed, holistic decision about measurements like ejection fraction.” 

PanEcho is available for open-source use to allow researchers to use and experiment with the tool for future studies. Holste said the team has already received emails from people trying to “fine-tune” the application for different uses. 

“We know that other researchers are working on adapting PanEcho to work on pediatric scans, and this is not something that PanEcho was trained to do out of the box,” Holste said. “But, because it has seen so much data, it can fine-tune and adapt to that domain very quickly. (There are) very exciting possibilities for future research.”



Source link

Continue Reading

Trending