scieee AI-readable full text Open interactive document viewer

A Curated Collection of Software Quality Tools for Research: Insights from the EVERSE Technology Watch

Bajare, Shraddha

Abstract

This work developed as part of the EVERSE - European Virtual Network for Research Software Excellence project, presents an initial curated collection of research software quality tools captured in the EVERSE Technology Watch. This includes a diverse set of research software quality tools, accompanied by key metadata outlining quality indicators and dimensions.These tools have been specifically selected to align with, adapt to, and extend the needs of various research communities, offering a comprehensive resource for improving software quality in research environments. Together with the EVERSE RSQKit, this collection aims to provide researchers and software engineers with an organised repository of information to evaluate and adopt tools to support and FAIRness within scientific research communities.The ongoing development of this resource will continue to incorporate new tools and insights, supporting the evolving landscape of research software quality.Acknowledgements Organisation: Square Kilometre Array ObservatoryProject: EVERSE - European Virtual Network for Research Software ExcellenceA recording of this session is available on YouTube: https://youtu.be/FrgYiUyuxKo

Full text

Presentation Title Insights from EVERSE Technology Watch A curated collection of software quality tools for research 11th Sept 2025 Shraddha Bajare, Software Quality Engineer SKA Observatory Slide / EVERSE European Virtual Institute for Research Software Excellence (Software for science communities by the communities) REFERENCE FRAMEWORK https://everse.software/ 2 Image 1: Science clusters and project partners Source: EVERSE project documents and site Image 1: Reference framework Source: EVERSE project documents and site Slide / EVERSE’s Software Quality Network and Services EVERSE aims - to create a framework for research software and code excellence, collaboratively designed and championed by the research communities - in pursuit of building a European network of Research Software Quality and setting the foundations of a future Virtual Institute for Research Software Excellence 3 Image 3: EVERSE software quality network and services Source: EVERSE project documents Slide / EVERSE: Research Software Framework Three-Tier Software Model Analysis Code Prototype Tools Research Software Infrastructure ●Framework to understand diverse landscape of software in research ●Intent behind research software ●Focusing on purpose for which the software is being built ●Framework for addressing specific challenges at each tier of software 4 Slide / A curated collection of software quality tools for research • How do we know that we are collecting something sensible?  Strategy - To build a shared understanding of tools and technologies for software quality within the EVERSE ecosystem. From Ideas to Structure - Refinement Process - Collected, grouped, and assessed tools Iterated and narrowed the list - Focused on usefulness and relevance to research software practices How it started - Brainstormed early ideas - Started with a naive plan - Mapped tools to EVERSE RSQKit components - Asked ourselves: What tools do we use ? What do we want from a Tech Watch ? Collaboration - Internal Brainstorming Engaged internal EVERSE teams. Clarified use cases and expectations - Wider Engagement Ran workshops across the network Collected tool suggestions from different domains real-world use case 5 Slide / Ideas and Use cases 6 Image 4: MIRO workshop ideas and use cases Source: SKAO project MIRO board Slide / EVERSE Technology Watch/Radar ●What is it? ○A curated catalogue of tools and services for research software quality ○Tools which are designed to assess, measure and improve software quality ○Categorised and presented on alignment with the established quality dimensions as segment https://everse.software/TechRadar/ 7 Image 4: EVERSE Tech Radar Source: EVERSE Techradar site Slide / Structure Quality Dimensions (Segments) ●Compatibility ●FAIRness ●Flexibility ●Functional Suitability ●Interaction Capability ●Maintainability ●Performance Efficiency ●Reliability ●Safety ●Security ●Sustainability Tool classification (Rings) ●Analysis Code ●Prototype Tools ●Research Software Infrastructure 8 Slide / ●Linters & Static Analyzers (e.g., Pylint, SonarQube) ●Testing Frameworks (e.g., Pytest, JUnit) ●Documentation Tools (e.g., Sphinx, Doxygen) ●Dependency & Environment Managers (e.g., Docker) ●CI/CD & Automation Tools (e.g., GitHub, Jenkins) Tools: Types and Metadata Entries Example Tool Metadata 9