scieee AI-readable full text Open interactive document viewer

NFDIxCS: Guarantee Levels of the Research Data Management Container (RDMC)

Ayon, Safial Islam; Al Laban, Firas; Bernoth, Jan; Goedicke, Michael

Abstract

Effective management of research data and software is essential for promoting open and trustworthy research. Structured methods are needed to ensure that research artifacts remain accessible and easy to locate, in line with the FAIR principles of making research data and software findable, accessible, interoperable, and reusable [1, 2]. However, fully implementing these principles remains challenging.Several research data management initiatives, such as the National Research Data Infrastructure (NFDI) and the European Open Science Cloud (EOSC), aim to support a cultural shift towards openness. The NFDIxCS consortium [3], part of the NFDI, has a core mission to develop infrastructure that supports operational services across the diverse Computer Science (CS) field and implement FAIR principles. A central concept of this project is the Research Data Management Container (RDMC) [4], which encapsulates research data, software, and contextual information into a 'time capsule' for long-term archiving and future use. After creating an RDMC, this container will be connected to a Reusable Execution Environment (REE), allowing the time capsule to be unpacked and executed within a predefined environment.Creating an RDMC requires a workflow to encapsulate research data, software, its external components, the context, and other related materials into a single container. Based on several personas [5], we have developed a workflow and designed a wizard to facilitate this process. This workflow enables the underlying management platform to create badges that indicate the expected quality of the content. Currently, these badges are referred to as guarantee levels, providing information on aspects such as metadata quality, long-term achievability and sustainability, and privacy of research artifacts.In this presentation, we give an introduction into the workflow for creating an RDMC, outline the concept of RDMC guarantee levels, and engage the community in discussing potential shortcomings and challenges in developing these guarantee levels. References Wilkinson, M. D. et al.: The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data 1/3, p. 160018, 2016, DOI: 10.1038/sdata.2016.18 Chue Hong, N. P. et al.: FAIR Principles for Research Software (FAIR4RS Principles). Research Data Alliance, 2022. DOI:10.15497/RDA00068 Goedicke, M. et al.: National Research Data Infrastructure for and with Computer Science (NFDIxCS). Zenodo, 2024. DOI:10.5281/zenodo.10557968 Goedicke, M.; Lucke, U.: Research Data Management in Computer Science - NFDIxCS Approach. Gesellschaft für Informatik, Bonn, 2022. DOI: 10.18420/inf2022_112 Bernoth, J.; Al Laban, F.; Lucke, U.: Utilizing Personas to Create Infrastructures for Research Data and Software Management. Gesellschaft für Informatik e.V, 2024. DOI: 10.18420/INF2024_180

Full text

NFDIxCS: Guarantee Levels of the Research Data Management Container (RDMC) Safial Islam Ayon, Dr Firas Al Laban, Jan Bernoth, Michael Goedicke Research Data Management Container (RDMC) •Central Hypothesis of NFDIxCS: •Research Data and Research Software are not the same but it is linked together with its research context •Solution Concept: •Design a Research Data Management Containers (RDMC) as a time capsule for research data and software •Digital, referenceable object •Describable with Metadata •Manage access and workflow •Additionally design and implement a hosting platform RDMCs 2 NFDIxCS.org 2025-02-26 RDMC Reusable Execution Environment 2025-02-26 3 NFDIxCS.org NFDI(xCS) Platform Copy data/software Reusable Execution Environment Connecting Active Containers: Integration with Services and Infrastructure •Interact with platform for e.g. artifact review processes •Use metadata to connect to knowledge graphs •Create an execution environment to run the software with its data •Integrate quality metrics by providing guarantee levels 2025-02-26 4 NFDIxCS.org Guarantee in Research Software Engineering •Research software is iterative and improves over time. •Guarantee is important for future development. •Verification ensures: •Functional correctness. •Alignment with system requirements. •Potential for reusability and reproducibility. •Confidence Through Guarantees: •Data and Software behaves as expected. •Supports validation, feedback, and requirements. 5 NFDIxCS.org 2025-02-26 Why Integrate Guarantees into RDMC? 2025-02-26 6 NFDIxCS.org •Flexibility for Diverse Needs: •Guarantees are shaped by chosen standards and methodologies. •Not all containers need long-term preservation or full standardization. •Encourages Best Practices: •Guarantee responsibility lies with RDMC creators. •Choice of metadata, sealing, and tools impacts long-term quality. •Structured and well-documented artifacts enhance research integrity. •Hashing and sealing to maintain data quality over time. •Controlled access mechanisms help maintain quality and security. Why Integrate Guarantees into RDMC? (2) 2025-02-26 7 NFDIxCS.org •Informs About Missing Dimensions: •Highlights areas for improvement. •Provides opportunities to integrate best practices. •Transparency for Container Readiness: •The guarantees of an RDMC depends on the methods and standards chosen by its creator. •RDMC ensures transparency but does not enforce specific guarantee levels. •Supporting Decision-Making: •RDMC helps users make informed decisions by showing how well processes are followed. •Stakeholders can evaluate an RDMC’s trustworthiness based on creator-provided guarantees. Stakeholders' Interaction with RDMC Guarantees 2025-02-26 8 NFDIxCS.org Stakeholders Users Policy Makers Decision Makers Creators (Owner) Owner's Benefits in RDMC Guarantees 2025-02-26 9 NFDIxCS.org ▪Understand how RDMCs are created and the quality of services used. ▪Compare RDMCs with best practices. ▪Identify gaps and improve reliability. ▪Improve RDMCs by learning from guarantees. Stakeholders Users Policy Makers Decision Makers Creators (Owner) Summary •Guarantee measures define the quality and consistency of RDMCs •They ensure reliable, secure data management across research projects. •Different dimensions of guarantee provide flexibility to balance effort and security. •Guarantees make RDMCs adaptable for diverse research needs and environments. •They play a key role in enhancing the trustworthiness and long-term usability of RDMCs. 2025-02-26 16 NFDIxCS.org 17 NFDIxCS.org Safial Islam Ayon Research Assistant, NFDIxCS University of Potsdam [email protected] 2025-02-26 Appendix RDMC Creation Process 2025-02-26 19 NFDIxCS.org Guarantee Dimensions –RDMC Creation 2025-02-26 20 NFDIxCS.org RDMC External Components Security Artifact Evaluation Sealing Reusable Environment Metadata RDMC Creation Manual Creation Use Existing Artifacts Automatic Process Guided Wizard Guarantee Dimensions - Artifact Evaluation 2025-02-26 21 NFDIxCS.org RDMC External Components Security RDMC Creation Sealing Reusable Environment Metadata Artifact Evaluation No Badge Artifacts Evaluated (Functional and Reusable) Artifacts Available Results Validated (Reproduced and Replicated) Guarantee Dimensions - Security 2025-02-26 22 NFDIxCS.org RDMC External Components Sealing Artifact Evaluation RDMC Creation Reusable Environment Metadata Security No security, no encryption Minimal security, possible encryption Full encryption, secure access Guarantee Dimensions - External Components 2025-02-26 23 NFDIxCS.org RDMC Reusable Environment Security Artifact Evaluation Sealing RDMC Creation Metadata External Components External links only Some local, some external All resources stored locally Guarantee Dimensions - Reusable Environment 2025-02-26 24 NFDIxCS.org RDMC External Components Security Artifact Evaluation Sealing RDMC Creation Metadata Reusable Environment Not Includes Recording Docker Ngnix Future dimensions that can be consider •Cross-platform integration •Community-based reviews & feedback •Automated metadata extraction •Scalability (for handling large datasets or complex workflows). •Interdisciplinary compatibility. •Data management plan and Software management plan. 2025-02-26 25 NFDIxCS.org