CoARA Boost CF1 - Final Knowledge Exchange Event Presentations Catalogue

Boost CoARA CASCADE FUNDING CALL 1 KNOWLEDGE EXCHANGE PRESENTATION CATALOGUE List of presentations 1. CENTRIA COMPETENCES 2. TREASURE - Transforming Research Assessment through Responsible Research training of Early-Stage Researchers: A pilot study 3. Reforming Assessment Policies and Practices at Joanneum Research 4. OSCAR - Open Science Collaboration for Research Career Advancement and Policy Innovation at UNIRI and UCY 5. CoARA ExPECT – Exchange & Promote Evaluation Criteria Changes Together 6. IDEA - Integrating Diversity in Evaluation and Assessment of Researchers – Experiences from Amsterdam 7. Impact-based assessment of the translational research in the Italian research hospitals 8. Catalysing research assessment reform in a small and specialist university: Reimagining our Academic Framework and evaluating its implementation in a revised academic performance review exercise 9. Reforming Research Assessment in the University of Carthage Towards a Qualitative Original Approach, Multidisciplinary Model and Sustainable Procedures 10. New Assessment Tools for Internal Programs of the Czech Academy of Sciences 11. Piloting new approaches and metrics for research assessment. A first step for a real transformation. 12. FEDRA – An institutional FAIR data lakE for transparent, inclusive, and reproDucible Research Assessment 13. Participatory Diversification of Research Assessment in the Humanities: A Citizens’ Council approach 14. Assessing the quality of ‘non-standard’ research outputs in Business and Management: an institutional pilot study 15. ECE4CoARA - Effective Community Engagement for a successful CoARA action plan implementation at the Open University of Catalonia (UOC): a community engagement case study at institutional level. 16. Managing the cultural transition associated with research assessment reform 17. Qualitative KPIs Tailored for Creative Industries: A Pilot Study on Film-Making, Wearables, and Game Development 18. Reform of researchers’ assessment in the University of Gdańsk 19. ReAss - Towards a Qualitative Paradigm: Rethinking Research and Researchers Assessment at Blanquerna, Universitat Ramon Llull 20. Impact Narratives for biomedical research: a Co-creation Approach to fair implementation 21. Strengthening the Qualitative Criteria for the Researcher Assessment at Häme University of Applied Sciences 22. Evaluating the Impact of Reformed Research Assessment and the use of Narrative CVs in Academic Career Promotion at Swansea University 23. AURA - Advancing Sofia University St Klimen Ohridski’s Research Assessment Towards Open Research CENTRIA COMPETENCES Johanna Jansson Director (RDI) Centria University of Applied Sciences Cascade Boost Cascade Funding Call 1 Knowledge Exchange Event 7.11.2025 CENTRIA UNIVERSITY OF APPLIED SCIENCES 11/10/2025 2 COARA AT CENTRIA •The agreement signed 6/2023 •CoARA action plan 2024–2027 published in Zenodo 6/2024 •Funding granted for development from CoARA Cascade Funding call 6/2024 •CENTRIA COMPETENCES – Developing and piloting the framework for competence management to enhance qualitative research(er) assessment in the university of applied sciences •Institutional pilot project •30 000 € •1.12.2024–30.11.2025 11/10/2025 3 CENTRIA COMPETENCES AS A TOOL FOR IMPLEMENTING COARA •Developing career paths in line with the CoARA Agreement •The pilot project's goal is to develop and test the Centria Competences framework to support competence management •Highlighting and emphasizing different competencies promotes career planning for all staff •Ensuring diverse competencies within units and teams •The framework serves as a tool in recruitment and salary development assessment •Centria’s CoARA Action Plan 2024–2027 and the updated strategy 2025–2028 share common objectives 11/10/2025 4 CENTRIA COMPETENCES – PROJECT STAGES 1. Specification of competence areas / December 2024–March 2025 •Centria management group •Eight small group discussions within units (RDI, education, administration), 52 participants •Benchlearning initiative (five Finnish universities of applied sciences engaged in CoARA development) 2. Development of the assessment framework / February–June 2025 •Preliminary four competence areas turned into six •Diverse background material used for developing the framework (e.g. from Committee for Public Information, FINCAM/Responsible Research) •Defining the descriptions of different levels within each competence area 3. Pilot testing of the framework / August–October 2025 •Eight teams (team manager + 2-3 team members = 26 persons) chosen to the pilot •Training for managers 9/2025 •Testing the framework in teams 10/2025 •Gathering feedback from managers and team members 10/2025 •Refining the assessment framework 11/2025 11/10/2025 5 EXAMPLE OF CENTRIA COMPETENCE PROFILE 11/10/2025 6 FIVE LEVELS OF COMPETENCE: 1. NO COMPETENCE 2. NOVICE 3. INTERMEDIATE 4. ADVANCED 5. LEADING EXPERT 1. 2. 3. 4. 5. THE (EXPECTED) INSTITUTIONAL CHANGES BROUGHT BY THE CENTRIA COMPETENCES MODEL •A shared, concrete model for discussing and planning competences across the entire organization •Centria’s annual cycle will be updated so that competence planning is better linked to budgeting and working time planning than current development discussions •Internal processes need to be refined to enable effective competence planning •In the long term, the implementation of the model supports Centria’s strategic goal of sustainable competences and meaningful work 11/10/2025 13 THANK YOU! KIITOS! 11/10/2025 14 Transforming Research Assessment through Responsible Research training of Early-Stage Researchers: An institutional pilot project Inês A. T. Almeida* Ana dos Santos Carvalho, Bruno Direito, Catarina Domingues Elsa S. Henriques, Fernando V. Borges, Jorge Noro, Maria João Neves, Paulo J. Oliveira, João Ramalho-Santos, Tracey Weissgerber* University of Coimbra ines.a.[email protected] [email protected]t www.uc.pt/iii/treasure CoARA Boost Cascade Funding Call 1 – Knowledge Exchange Event M11 November 07, 2025, online tracey.weissg[email protected] 24-CoARA-022 Goal: to formally recognize & reward graduate (master’s, doctoral) students for implementing a valuable and diverse set of reproducible, reusable and open research practices and outputs in their dissertation & thesis research. AIMS: VALUE DIVERSE RESEARCH PATHS, PRACTICES AND OUTPUTS Thesis Research article STUDY DESIGN STEP-BY-STEP PROTOCOL SOFTWARE & CODE DATA MATERIALS TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 OUTPUTS: Co-created List of rewarded Practices & Outputs PREREGISTRATION OF STUDY DESIGN & REGISTERED REPORTS OPEN SOFTWARE & CODE DATA SHARING OPEN REUSABLE MATERIALS SCIENCE COMMUNICATION STAKEHOLDER ENGAGEMENT OR CITIZEN SCIENCE UNIQUE RESOURCE IDENTIFIERS AUTHOR CONTRIBUTION STATEMENTS REPORTING NULL RESULTS OPEN EDUCATIONAL RESOURCES REPORTING GUIDELINES STEP-BY-STEP PROTOCOL EVIDENCE SYNTESIS TECHNIQUES REPLICATION REPRODUCIBLITY STUDIES PREPRINTS Reproducible, reusable and open research practices STUDENT A STUDENT B STUDENT C Students are motivated to choose (a) practices/outputs that best fit their field and project; (b) few practices / outputs but implement them well: 2 or 3 for PhDs, and 1 or 2 for Masters, depending also on the workload required for the implementation. The criteria focus on quality. TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 https://doi.org/10.5281/zenodo.15785596 OUTPUTS: Interdisciplinary Training & Certification Program Cross-course optional course units offered to all PhD and Masters’ candidates at the University of Coimbra Test cohort - students enrolled: 18 (course unit I) + 9 (course unit II) Reproducible, reusable and open research II: Implementing the Certification (enrollment: thesis last year –1 semester, 1ECTS) Reproducible, reusable and open research I: Introduction to Certification (enrollment: start of thesis development –1 semester, 1ECTS) •Strategic planning: Review progress, modify plan as needed •Review & feedback on practices and outputs from peers & teaching staff •Finalize practices and outputs •Share lessons learned •Approval: successful implementation of planned practices/outputs •Hands-on "how to" sessions introducing practices & program criteria •Students: •Select a few practices or outputs to implement •Draft an implementation plan •Revise plan (feedback from supervisor, teaching staff) •Final output: Implementation plan approved by supervisor TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 https://www.uc.pt/en/iii/treasure/outputs/curricular-units-2025-2026/ TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 ACHIEVEMENTS •Raise awareness about reproducible, reusable and open research practices and outputs, evaluate with the evaluated: •Program and list co-created with masters’ and PhD candidates, supervisors and course coordinators from 9 faculties, 17 courses, 12 R&D units (local board) •Connect and collaborate with other institutional initiatives and actors (project team, rectorate, stakeholders, projects) •Build an interdisciplinary collaborative network to discuss research assessment across disciplines Designed by rawpixel.com / Freepik Short-term [through participating students] •encourage supervisors and other researchers to adopt new practices and outputs, across disciplines •collect examples of good research practices and outputs from different fields to inspire others Long-term •reward supervisors whose students consistently participate •develop procedures to recognize programs and faculties that consistently implement practices and outputs •incorporate rewarded skills into hiring & promotion criteria AIMED IMPACT FOR INSTITUTIONAL CHANGE @Microsoft TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 PROJECT TEAM: ACROSS FACULTIES, R&D UNITS, DISCIPLINES & ROLES Contacts: e-Mail: [email protected] Website: https://www.uc.pt/iii/treasure/ All outputs: OSF page:https://osf.io/tjdqs/ Zenodo CoARA Boost CF1 dedicated folder: https://zenodo.org/communities/coara_boo st_cascade_funding/ TREASURE | CoARA Boost CF1 Knowledge Exchange M11 | 07.11.2025 RAPP-JR Reforming Assessment Policies and Practices in JOANNEUM RESEARCH CoARA 2nd Review 07/11/2025, 09:00 –12:00, CEST https://us06web.zoom.us/j/86717590887?pw d=ZILyWf4dptKQyQzT2bxPHSUpkIhdGG.1 Helene Schiffbänker, Gerit Anders, Florian Holzinger This project has received funding from the European Union’s Horizon Europe Research and Innovation program under Grant Agreement No. 101131826 Impact on ecosystem level 8 JR as national pioneer for discussing / implementing CoARA principles in BES JR shared experiences, mutual learning with other Austrian non-university research organisations CEO is reaching out to Austrian network of applied research organisations (Forschung Austria) to discuss excellence in applied research RAPP-JR learning 9 •RAPP resources enabled pushing CoARA principles: •Internal awareness raising •External outreach to other applied research organisations Momentum of BOOST funding was successfully used •Time and capacity to start implementation process are limited •CoARA is not first priority •Change processes take time! Implementation requires resources.. JOANNEUM RESEARCH Forschungsgesellschaft mbH POLICIES Institut für Wirtschafts-, Sozialund Innovationsforschung Standort Graz: Leonhardstrasse 59, A-8010 Graz Tel.: +43 316 876-1488 Standort Wien: Haus der Forschung, Sensengasse 1 A-1090 Wien Tel.: +43 1 581 75 20 Standort Klagenfurt: Lakeside B13b 9020 Klagenfurt am Wörthersee Tel.: +43 316 876-7553 [email protected] www.joanneum.at/policies THANK YOU!! For feedback, questions please contact: [email protected] OSCAR CoARA Boost Teaming project - Final Knowledge Exchange Event - November 7, 2025 Prof. Dr. Sc. Saša Zelenika University of Rijeka, Croatia a.i. Rector’s Advisor for Strategic Projects szelenik[email protected] HE CoARA Boost „Open Science Collaboration for Research Career Advancement and Policy Innovation at UNIRI and UCY – OSCAR” (with European Office of Cyprus (EOC)) as one of the first 25 (and only 3 Teaming) projects – started December 1, & kick-off December 13, 2024: - aim: institutional change and fostering of advanced research culture while advocating OS at policy level; - OS to be integrated into research assessment, raising awareness on OS; - enhancement of research assessment practices @ UNIRI and UCY, also based on UCY research-on-research principles and on qualitative assessment aspects (with responsible use of quantitative metrics); - mutual transfer of knowledge, capacity building, promotion of OS; - university libraries to provide support; - UCY to develop its own CoARA AP based on UNIRI experience. 1st Cascade Funding Call: facilitating institutional change University of Rijeka (UNIRI), Croatia University of Cyprus (UCY) European Office Cyprus (EOC) EOC is a dynamic, non-profit, non-governmental organisation. Aims to ensure accurate and timely dissemination of information to its members, establish contacts with key figures in the EC & EP, monitor policy developments, and connect with other Brussels-based offices, networks, and organisations. UCY, January & April 2025 UNIRI: September 2025 Achievements (1) – knowledge exchange and capacity building Why, how, what, who, when, where zenodo.org/records/15648857 (DOI: 10.5281/zenodo.15648857) June 2025 Part of the „CoARA Boost Cascade Funding Beneficiaries” Zenodo community” (1st CoARA Boost Deliverable at all) Achievements (2) – CoARA AP Guidelines https://zenodo.org/records/15526193 (10.5281/zenodo.15526193) May, 2025 Achievements (3) – OS practices (in RA) https://zenodo.org/records/16353490 (DOI: 10.5281/zenodo.16353490) July, 2025 Strategic Areas and Activities Achievements (4) – UCY CoARA AP Based on UNIRI experience and the AP Development Guidelines, UCY produced its own CoARA AP whose official endorsement is imminent → first comprehensive UCY framework for reforming RA, bringing together CoARA principles with institutional priorities, providing clear pathways and setting actions to make OS an integral part of how research is evaluated and recognised at UCY. CoARA ExPECT Exchange & Promote Evaluation Criteria Changes Together Teaming Project Coordinator:Miki Kallio, Oulu University (Finland) Partners: Markku Ihonen, Tampere University (Finland) Stefan Riedel, Ruhr University Bochum (Germany) CoARA Boost Cascade Funding Call 1–2nd Knowledge Exchange Event, 07.11.2025 CoARA ExPECT –Our Goal(s) & Main Achievements Overarching Goal: Foster a culture of responsible research assessment that emphasises 1) Quality, 2) Impact, 3) Sustainability, and 4) Diversity across academic communities. Specific Project Goal: Raise awareness for the necessity to reform research assessment according to shared values made explicit in CoARA‘s Agreement on Reforming Research Assessment Main Achievements Intensified exchange between the project-partners and further institutions Production of 19 videos addressing various aspects of research assessment CoARA ExPECT –Main Achievements Short instructional videos Foundations and Significance of Responsible Research Assessment Assessment Processes: Strategic Planning, Preparing and Implementing Evaluator Guidelines and Instructions for varying purposes and career stages Assessment Criteria and Tools (Mis-)Use of Metrics CoARA ExPECT –Video Topics Foundations and Significance of Responsible Research Assessment What I need to know about responsible research assessment? Changing the culture of responsible research assessment –understanding and supporting a holistic approach Research integrity and responsibility in research and its assessment Assessment Processes: Strategic Planning, Preparing and Implementing Assessment situations, processes and actors: What, who and how Addressing unconscious bias, advancing inclusiveness, and non-discrimination in research assessment Transparency in assessment processes: Ensuring Clear and Openly Available Criteria and Objectives Recognising Open Science in responsible researcher assessment Evaluator Guidelines and Instructions for different purposes and career stages Evaluator‘s instructions: Assistant Professor and Postdoctoral Researcher Evaluator‘s instructions: Associate Professor Evaluator‘s instructions: Professor Principles and guidelines for selecting and training evaluators Assessment Criteria and Tools What is a Career Assessment Matrix and how to use it? Narrative CVs: What they are and why they matter Crafting a Narrative CV –quality over quantity How to assess the quality of research Assessing interaction, knowledge transfer and impact Evaluations in positions focused on teaching (Mis-)Use of Metrics Why the h-index is inadequate for researcher evaluation Why journal-based metrics should not be used in researcher evaluation CoARA ExPECT – First Glance What I need to know about responsible research assessment? Example Video (introduction [1:40]) CoARA ExPECT – Full Glance https://zenodo.org/records/17548429 Comprehensive Document with the project‘s profile, brief summaries of the videos and links to the videos is (very soon) available on Zenodo Start of CoARA ExPECT – Finetuning 1. 3. 2. 4. Producing the Videos Community Engagement Face2FaceMeetings and Workshops Broadcasting the Results at our Universities, in the CoARA Community and beyond CoARA ExPECT – Our Roadmap Raise awareness for the necessity to reform our assessments of research to make holistic evaluations of researchers based on transparent criteria standard… …TOGETHER! IDEA: Integrating Diversity in Evaluation and Assessment of Researchers –Experiences from Amsterdam María de los Ángeles Crespo López Vrije Universiteit Amsterdam Context: DEI in R&R ●DEI is shaped by 1) hiring, 2) R&R, and 3) working practices ● VU’s Diversity Office Colorful Staff Action plan addressed the first two so far, but no focus on DEI in R&R. ●R&R reforms at VU Amsterdam are transforming researcher evaluation —shifting from quantity-based metrics to fairer, quality-focused criteria in research, education and leadership. ● VU’s central R&R program translated into faculty policies with evaluation criteria for Assistant, Associate, and Full Professors, but DEI remains under-addressed. Funded by CoARA Boost Footer text - Faculty or Research Institute name9 1. Include DEI explicitly in R&R policies 2. Unbiased recruitment & evaluation procedures 3. More centralization 4. Address care-taking and leaves 6. Inclusive leadership 5. Don’t forget students, PhD candidates & postdocs 7. Reward DEI work Recommendations action plan To be (co-)developed further Footer text - Faculty or Research Institute name10 Final considerations and next steps Next steps: ●Workshop 4: Refine the action plan for the VU. ●Deliver outcomes to the R&R and Diversity teams. ●Disseminate findings and materials. How to make impact and keep the conversation going? Follow-ups? OSF page Contact information: Marián Crespo: [email protected] Krishma Labib: [email protected] IMPACT-BASED ASSESSMENT OF THE TRANSLATIONAL RESEARCH IN THE ITALIAN RESEARCH HOSPITALS Valeria Elisa Contarino, Project Coordinator President Associazione Ricercatori in Sanità –Italia (ARSI) 2 ° Knowledge Exchange Event, 7 November 2025 PURPOSE Agreement on Reforming Research Assessment (ARRA) •The Istituti di Ricovero e Cura a Carattere Scientifico (IRCCS) are public and private research hospitals in Italy •Currently, the IRCCS research assessment is based on quantitative indicators (50% IF) •The Associazione Ricercatori in Sanità –Italia (ARSI) has a network of research professionals across the IRCCSs (researchers, research technicians, librarians, etc) Propose a framework for RESEARCH ASSESSMENT in IRCCS that combines QUALITATIVE INDICATORS based on real-world benefits and impact QUANTITATIVE METRICS Collect and analyze data from researchers applying the framework to build a collective evaluation WHAT ARE THE MAIN ACHIEVEMENTS OF THE PROJECT? TRAININGS Part 1: FRAMEWORK EXPLANATION 170 participants to the trainings on the impact-based framework •Official trainings organized in 5 IRCCS (4 public, 1 private) •Spontaneous participation of researchers from 10 additional IRCCS (9 public, 1 private) TRAININGS Part 2: FRAMEWORK APPLICATION •Practical application of the impact-based framework: •85 participants •50 research projects: qualitative benefit-based indicators + quantitative impact metrics SURVEYS Part1: FRAMEWORK EXPLANATION •Collection of 84 post-training surveys Part 2: FRAMEWORK APPLICATION •Collection of 50 post-application surveys SURVEYS How would you rate the real-world impact of IRCCS research? To what extent does the current IRCCS research assessment incentivise the achievement of real-world impact? None Low Moderate High None Low Moderate High MEETINGS @MINISTRY OF HEALTH •5 Feb: Introductory meeting to present purposes and planned activities of the CoARA project with the Director General - Research and Innovation (DG Research) •24 Sep: Update meeting to discuss achievements and proposals with DG Research and 4 directors of ministerial offices •2 Oct: Operative meeting (online) to discuss the implementation of the first changes with 2 Directors of ministerial offices PROJECT PROGRESS MONITORING Milestone 1 Kick-off meeting 14/03/25 Deliverable 1 Kick-off meeting report 30/03/25 Milestone 2 Trainings on the framework 24/06/25 KPI 1 IRCCS professionals = 100 24/06/25 1° Knowledge Exchange Event 2° Knowledge Exchange Event Milestone 3 Real-world data collection 24/10/25 KPI 2 Surveys = 50 28/10/25 Milestone 4 Wrap-up meeting Planned M12 Deliverable 2 Wrap-up meeting report Planned M12 THANK YOU FOR YOUR AT TENTION Associazione Ricercatori in Sanità –Italia (ARSI) Catalysing research assessment reform in a small & specialist university CoARA Knowledge Exchange Event 7 November 2025 Dr Julie Northam, Director of Research Main achievement 1: Revised Academic Framework 1. Research skills and professional development 2. Research design & development 3. Research conduct and management 4. Scholarly outputs and knowledge generation 5. Knowledge exchange and impact 6. Research culture and leadership Domains Examples of potential outputs (usually a tangible product of research) Behaviours and values Examples of potential indicators (reflects evidence or a sign of contribution, leadership or esteem) 2. Research design & development (conception, planning, and preparation of research projects) • Well-developed, peer-reviewed or externally commended research or KE funding proposals (including unfunded) • Ethics approvals and risk assessments • Team-based research design and development (mono or interdisciplinary) • Stakeholder mapping • Co-created or community-led research plans • Involvement of public contributors or service users in shaping research questions and design • Incorporation of digital inclusion and accessibility for diverse participants •Incorporation of responsible use of AI and algorithmic transparency • Research integrity and ethics •Ethical and transparent practices in AI and digital tools • Inclusivity in research design • Intellectual curiosity and rigour • Effective collaboration and co-creation with stakeholders • Risk mitigation planning • Seeks funding and income aligned to role and career stage to sustain RKE activity • Number/value/success rate of grant applications • Peer review comments or funder feedback on submitted proposals •Evidence of responsible research planning (e.g., research data management plans) • Participation in training or mentorship for grant development • Evidence of meaningful involvement of public contributors in design, governance, or dissemination • Evidence of use of accessible digital platforms or tools in research participant engagement Main achievement 1: Revised Academic Framework Role How the role aligns to the Academic Framework for RKE Lecturer The role holder will begin to establish their research identity by contributing to one or more RKE domains. They will be supported to engage with high-quality research activities, build collaborations, and develop their capacity by participating in areas such as bidding, outputs, and knowledge exchange. Contributions may be focused but should demonstrate integrity, curiosity, and the potential for influence. Main achievement 2: Revised Personal Research Plan Narrative format linking reflection, planning, and support Maps to domains in Academic Framework CoARA-aligned indicators and guidance Main achievement 3: Culture and capacity Building shared understanding •Narrative CV and PRP workshops for 30+ colleagues •Led by Dr Jo Cresswell and CoARA core team •Improved literacy and confidence in qualitative evaluation Resources developed •PRP guidance and exemplars •Narrative CV guidance •Video micro-guides Institutional change at HSU Individual Researchers more confident articulating quality and influence PRPs prompting reflection on development and impact Leadership Reviewers trained to evaluate narratives not numbers Deeper dialogue between researchers and line managers Institutional Development process being adopted for whole Academic Framework Shift in culture: from outputs → contributions & values Lasting impact of our CoARA project: •Changed how we talk about research quality and success •Built shared confidence in recognising diverse contributions •Strengthened research culture and leadership at every level hsu.ac.uk [email protected] 01202 436 200 A leading health sciences university for applied research, with talented staff and students committed to research excellence and undertaking research that has a positive impact on the economy, society, culture, public policy or services, health, or quality of life. Thank you TRUST2COARA Final knowledge exchange event Impact of Project (24-CoARA-049 ) Reforming Research Assessment in the University of Carthage Towards a Qualitative Original Approach : Multidisciplinary Model and Sustainable Procedures Presented by : Pr. Mohamed Gargouri 11/10/2025 1 CoARA workshop, July 17, IBEC, Barcelona 11/10/2025 8 Event on Zenodo community: https://zenodo.org/communities/jornadacoaracatalunya/recor ds?q=&l=list&p=1&s=10&sort=newest Achievement in progress: >> December 2nd, 2025 Final conference of the TRUST2COARA Project • UCAR strategy (President, UCAR) • Presentation of the TRUS2COARA Project and results • Research Evaluation Mechanisms in Tunisia (DG ATEA) • Impactful research (DG, ANPR) • Research Assessment at the Institute for Bioengineering of Catalonia: Experience and Insights (IBEC) • An Interdisciplinary Research Experience (University of Sfax) • INSAT Doctoral School Adjustments (UCAR) • IBEC and Open Science: Building a Culture of Openness (IBEC) 11/10/2025 9 Achievement in progress: Dissemination on platform « Sustainable research » in https://pmo.ucar.rnu.tn/ •Dissemination of TRUST2COARA results. •Dissemination of research evaluation reform practices or propositions at UCAR. •Dissemination of CoARA principles and international best practices. •Promotion of qualitative, inclusive, and impact-oriented assessment. •Promotion interdisciplinary collaboration. 11/10/2025 10 Main results: Survey on current research evaluation practices 11/10/2025 11 15% 24% 0% 9% 9% 6% 2% 0% 9% 0% 0% 2% 6% 8% 9% 18% 9% 10% 38% 24% 27% 29% 35% 30% 40% 32% 27% 29% 30% 42% 0% 12% 27% 15% 17% 10% DOCTORANT POST-DOCTORANT ASSISTANT CONTRACTUEL MAÎTRE ASSISTANT MAÎTRE DE CONFÉRENCES PROFESSEUR ACTUAL RESEARCH ASSESSMENT Je ne sais pas Entièrement qualitatif Principalement qualitatif A peu près égal Principalement métriques Entièrement métriques 10% 28% 18% 6% 9% 4% 4% 0% 18% 9% 4% 2% 19% 20% 36% 15% 22% 14% 58% 32% 27% 38% 43% 42% 4% 20% 0% 24% 9% 28% 4% 0% 0% 9% 13% 10% DOCTORANT POST-DOCTORANT ASSISTANT CONTRACTUEL MAÎTRE ASSISTANT MAÎTRE DE CONFÉRENCES PROFESSEUR PREFERRED RESEARCH ASSESSMENT Je ne sais pas Entièrement qualitatif Principalement qualitatif A peu près égal Principalement métriques Entièrement métriques 11/10/2025 12 91,7% 8,3% 6,3% 2,1% 32,0% 20,0% 52,0% 16,0% 9,1% 18,2% 54,5% 36,4% 14,3% 10,7% 71,4% 14,3% 13,0% 17,4% 65,2% 21,7% 20,4% 22,4% 67,3% 12,2% NON RÉPONSE CRITÈRE APPLIQUÉ PERCEPTION POSITIVE PERCEPTION NÉGATIVE MULTIDISCIPLINARITY –PHD MANUSCRIPT EVALUATION Doctorant Post-doctorant Assistant contractuel Maître Assistant Maître de Conférences Professeur 11/10/2025 13 91,7% 8,3% 6,3% 2,1% 24,0% 40,0% 72,0% 4,0% 18,2% 27,3% 72,7% 9,1% 11,8% 17,6% 70,6% 17,6% 21,7% 17,4% 73,9% 4,3% 26,5% 20,4% 63,3% 10,2% NON RÉPONSE CRITÈRE APPLIQUÉ PERCEPTION POSITIVE PERCEPTION NÉGATIVE SOCIAL IMPACT OF RESEARCH –ACADEMIC RECRUITMENT Doctorant Post-doctorant Assistant contractuel Maître Assistant Maître de Conférences Professeur To enhance the relevance and impact of doctoral research, we have updated the PhD project template to include the following sections: ▪Societal impact, ▪Multidisciplinary dimension, ▪Dissemination of results, ▪Ethics and scientific responsibility. The changes in INSAT-DS brought about by TRUST2COARA project: Improvements in the PhD project template 14 Admission was mainly based on academic performance. Now, we aim for a broader evaluation of the candidate’s profile, including: ▪Awards or distinctions, ▪Interviews. The changes in INSAT-DS brought about by TRUST2COARA project: Changes in PhD admission criteria for registration 15 The meeting report for the individual follow-up committees have also been updated with new questions to better understand the project’s scope, including: ▪Candidate’s perception of the potential impact of their research, ▪Multidisciplinary aspects of the project, 16 The changes in INSAT-DS brought about by TRUST2COARA project: Strengthening individual monitoring 2025 Doctorial Days Impact of their research on society as seen by doctoral students 17 1 Portada CoARA Boost project: Piloting new approaches and metrics for research assessment. A first step for a real transformation Begoña Miñarro Vivas, UAB Xavier Ariño Vila, UAB 2 Separador d’apartat 01 Key achievements of the project & institutional changes implemented 3 Diapositiva amb només text Overview 4 Diapositiva amb només text 1. Engagement and Community Building 470 people reached in dissemination activities 48 306 116 CoARA and Research Impact (18/2/2025) Research assessment reform: how does it affect you?’ (4/4/2025) 1st UAB Open Science Day (28/10/2025) 47 researchers and research staff involved in the focus groups 47 Researchers and research staff involved in 5 focus groups (R1, R2, R3-R4, Research Leaders, Research staff) 5 Diapositiva amb només text 2. Pilot: Key Institutional Change Talent UAB Call 7 Applications Old assessment criteria New assessment criteria • Quality of academic production in the last ten years (60%) • Direction of research lines (35%) • Accreditation of research by recognised organisations (5%) • Contribution to the advancement of knowledge in the area (15%) • Scientific impact (50%) • Social impact (10%) • Research leadership and strategic alignement (20%) • Research accreditations (5%) Applications (Evaluation in progress) 6 Diapositiva amb només text 3. Capacity building 4 Training courses and 97 researchers trained •THE PATH TO IMPACT: SUPPORT MATERIAL AND GOOD PRACTICES •IMPACT NARRATIVES IN RESEARCH •NEW ASSESSMENT TALENT CALL FOR POTENTIAL APPLICANTS •NEW ASSESSMENT TALENT CALL FOR EVALUATORS 38 32 21 6 7 Diapositiva amb només text 4. Lessons learned and Sustainability of the reform process Arts & Humanities Sciences Health Sciences Social Sciences and Law Engineering R1 R2 R3 R4 Researcher with academic role Quantitative analysis: Survey about the research asssessment system with 269 answers (Still open) Qualitative analysis of focus groups (5 focus groups) Road Map and sustainability plan 8 Diapositiva amb només text 4. Lessons learned and Sustainability of the reform process Talent Call remain with new criteria Periodic Training Periodic dissemination activities 9 Contraportada FEDRA An institutional FAIR data lakE for transparent, inclusive, and reproducible Research Assessment Knowledge Exchange Event November 07, 2025 - online Matteo Gionfriddo, Alessandra Cerato, Luigi Erriquens, Antonina Maria Marino, Paolo Tealdi, Arianna Montorsi, Federica Cappelluti Participatory Diversification of Research Assessment in the Humanities: A Citizens’ Council approach Csanád Bodó, Eötvös Loránd University, Budapest, [email protected]! CoARA Knowledge Exchange Event 2; November 7, 2025 The context •ELTE Eötvös Loránd University is the leading Hungarian higher education institution with 4000 employed researchers •At ELTE's largest faculty, the Faculty of Humanities, with 18 institutes and 71 departments, a complex system for assessing individual research performance has been developed and implemented – based on metrics •Institutional resistance to the CoARA reform – stemming from a perspective that closely links quantitative research assessment to promotion in university rankings Objectives •to reform the existing system by developing a qualitatively based recommendation to diversify the assessment of individual researchers from a wide range of disciplines working in the Faculty, focusing on peer review and the societal impact of research •to develop a novel methodology of reforming qualitative assessment as a bottom-up initiative that achieves its institutional impact through the involvement and commitment of participants The Citizens’ Council: a participatory approach •Based on an adapted version of Citizens’ Jury, the bottom-up method often used in participatory research, we developed what we call the Citizens' Council •The Citizens' Council was convened from a random sample of the Faculty's research community, stratified by gender, academic career stage and the relative size of the researcher’s institute or department •Throughout the reform process, the Citizens' Council developed the qualitative and diversified assessment in a deliberative way and reached consensus on decisions The Council’s work •Three all-day workshops in May-June, 2025, attended by 25 researchers and an external expert on research assessment •14 recommendations for the Faculty’s leadership •E. g., quantitative research assessment should be paired with narrative selfassessment and be subject to peer review in the following three areas: •research excellence •research support •research impact Main achievements •Distinction between two types of individual research assessment: •Selective research assessment •Supportive research assessment, optional and mutual in the first phase, mandatory after first revisions •The Faculty’s leadership responded to the Recommendations and identified two main issues •peer review cannot be linked to committee-level decisions within the existing structures •limited availability of human resources — The Faculty’s leadership put it this way: "Due to the current excessive workload (and disproportionate remuneration), we consider only voluntary implementation to be feasible for the time being" The impact of the pilot •Optional pilot assessment for researchers •Dissemination and communication, e.g. plenary talk and roundtable discussion at the Hungarian Academy of Sciences •In summary, the pilot project aimed to introduce the CoARA principles into an institutional environment with limited support. The participatory implementation of the project resulted in the CoARA principles becoming part of the research community's discourse on research assessment ASSESSING THE QUALITY OF ‘NON-STANDARD’ RESEARCH OUTPUTS IN BUSINESS AND MANAGEMENT: AN INSTITUTIONAL PILOT STUDY PROF. STEVE JOHNSON, PROF. KAREN SAYER,DR. CHRISTINE SAMY & MS LIZ CABLE AGENDA 2 1. Project Overview 2. Responses to Challenges 3. Main Achievements and Institutional Changes PROJECT OVERVIEW This pilot has been exploring the use and fair and robust assessment of ‘nonstandard’ research outputs—such as poetry, film, photo essays, digital media— within Business & Management, and other disciplines. It supports CoARA goals by developing alternative, evidence-based approaches to research assessment. CoARA action plan 2025 ECE4CoARA project Effective Community Engagement for a successful CoARA action plan implementation at the UOC: a community engagement case study at institutional level Feb 2025 (M2) - Jan 2026 (M13) 1. A UOC community engaged with/in CoARA 2. A solid and sustainable reform process at UOC 3. A community engagement case study at institutional level To mature our internal reform process and fully integrate our institutional plan into the University’s daily life through an active and effective engagement of our community. Mission Expected results Main achievements ECE4CoARA project Effective Community Engagement for a successful CoARA action plan implementation at the UOC: a community engagement case study at institutional level WP1 - UOC community engagement The UOC community is starting the discussion on practicalities related to the CoARA alignment at UOC. The UOC's CoARA Action Plan 2024-2027 is being incorporated by the Doctoral School, Research groups, Research projects, and Academic staff which have joined the debate. WP2 - Pilots on internal processes We have open channels to ensure participation, including anonymous participation 4 different debates are running from October 22 to the end of November, to gather ideas and proposals to generate a list of recommendations on the different assessment processes for each group. https://decidim-coara.techlab.uoc.edu/ WP2 - Pilots on internal processes Criteria and procedures are being discussed for each evaluation process: ● For the anual assessment of PhD students. ● For faculty promotion. ● For research groups. Evaluation instruments are also being assessed. Institutional changes ECE4CoARA project Effective Community Engagement for a successful CoARA action plan implementation at the UOC: a community engagement case study at institutional level Institutional changes The scope is being debated, not only within the institution, but also the need for change in local and national policies. https://decidim-coara.techlab.uoc.edu/assemblies/Unitat-D Institutional changes A cultural change in the evaluation system could be promoted, based on community proposals that influence the implementation of the plan. https://decidim-coara.techlab.uoc.edu/assemblies/PDI/ Gràcies Gracias Thank you