scieee AI-readable full text Open interactive document viewer

The Dark Corners of Open Science

Ioannidis, Alex

Abstract

Open Science infrastructures have significantly advanced global knowledge sharing, enabling wider access, collaboration, and transparency in research. However, alongside these achievements, we face substantial challenges from spam and malicious activities that threaten the integrity of scholarly communications and pollute the scholarly graph. These challenges include the exponential growth of AI-generated content that blurs the line between legitimate research and sophisticated fabrication, rampant plagiarism facilitated by easily accessible digital content, and predatory journals that exploit the openness of publication channels for commercial gain. Further, covert and aggressive data harvesting practices threaten to take down repositories, while the dual-use nature of open platforms can inadvertently facilitate unethical uses of openly shared research. Addressing these challenges demands rigorous governance, novel technical implementations such as advanced machine-learning classifiers to detect spam, and coordinated community-driven moderation policies. In this session, we explore practical experiences and innovative solutions from managing Zenodo, a large-scale open science infrastructures, focusing on balancing openness with robust security measures. We discuss emerging practices to mitigate risks, enhance metadata quality, and uphold the credibility and fairness of open science systems. The presentation aims to engage the community in a critical discussion about proactive strategies and collaborative approaches to safeguard open science from exploitation.

Full text

The Dark Corners of Open Science Alex Ioannidis CERN IT Department, Zenodo This work is licensed under Creative Commons Attribution 4.0 International (CC-BY) 10.5281/zenodo.17150790 Sep 16, 2025 “The road to hell is paved with good intentions” Spammers - the Sin Last month ●Out of 21k new accounts → 408 banned 1.8% ●Out of 115k new records → 1,049 deleted 0.9% Overall ●Out of 1M accounts → 240k banned 23.8% ●Out of 7M records → 1.1M deleted 15.8% ●Automated filters ●User reports, manual review Spammers - Contrapasso ●False-positives ●Search noise ●Polluting the scholarly graph Spammers - the Toll Harvesters - the Sin ●Investigate access patterns and blocking IPs/UAs ●Tiered rate-limits ○Anonymous vs. Authenticated ●Bulk data access ●Infrastructure scaling/optimizing ○Time-consuming and costly Harvesters - Contrapasso Falsifiers - the Toll ●“DoS attackˮ on human resources ○Legal offices, Data Privacy Officers ○CERN, European Commission, other infra providers ●Conspiracy theories get equal platform with rigorous research ●Public loss of faith in expertise ●AI arms race Technical issues → Ethical dilemmas External threats → Systemic issues Our Descent so far ●Spammers - obvious bad actors, easy to identify and block ●Harvesters - aggressive users pushing our infrastructure to its limits ●Predatory publishers - exploiting our openness for profit ●Falsifiers - AI-generated nonsense and conspiracy theories undermining trust in science ●Weʼre constantly learning ●Thereʼs more we can do ●“As open as possible, as closed as necessaryˮ The Ascent: Living with Paradox No clean solutions, only trade-offs The Need for Transparency ●Be (also) open about… ○…limitations ○…policy and due-process ○…costs of running infrastructure ●Develop and share… ○…operational knowledge ○…community standards “Invisible” Work …but essential for open science to function ●Never planned ●Never explicitly funded ●Implicitly absorbed costs Image Credits Gustave Doré illustrations 1861 - Public Domain, via Internet Archive, Wikimedia Commons William Blake illustrations 182427 - Public Domain, via GetArchive Botticelli illustrations 1480s - Public Domain, via Wikipedia Commons Eugene Delacroix 1822 - Public Domain, via Wikipedia Commons Funders: Operational sustainability is not overhead, but foundation Infrastructures: Stop pretending this is easy! Start demanding support Researchers: These are your infrastructures! Help us protect them These dark corners are real… Bonus slides ●Computer virus databases → used to create new malware ●Conservation data → poachers use to find endangered species ●Depression‑detection models → repurposed for exclusion ●Network analysis of information flows → reused to steer fake news Dual-Use research - the Sin ●Detection and evaluation is already an issue ●Ethics committees donʼt scale ●Open Science against humanity ●Weʼre not alone though… Dual-Use research - Contrapasso and Toll