Co-designing XR features with off-highway vehicle operators: Case study for a unifying approach to useful, safe, ethical and impactful XR technology innovation

THEIAXR has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No. 101092861. Any information of results reflects only the author’s view and the European Commission is not responsible for any use that may be made of the information it contains. Case study for a unifying approach to useful, safe, ethical and impactful XR technology innovation CO-DESIGNING XR FEATURES WITH OFF-HIGHWAY VEHICLE OPERATORS MAKING THE NON-PERCEIVABLE PERCEIVABLE Sarah Bacher1, Tanja Brodbeck1, Manuel Kulzer-Braun1, Sophie Doublet2, Anastasia Sergeeva2 1 Stuttgart Media University of Applied Sciences, 2 University of Luxembourg 2 2025. 11. 28. About us THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Sarah Bacher Tanja Brodbeck Manuel Kulzer-Braun Anastasia Sergeeva Sophie Doublet 3 2025. 11. 28. About THEIAXR ›EU-funded research project ›Jan 2023 –Dec 2025 ›Research & Innovation Action (RIA) THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 4 2025. 11. 28. Aim of the Project / Working Contexts Making the invisible visible for off-highway machines ›3 working contexts: Snow groomers, Reach stackers and Excavators ›Use of Extended Reality Source: HdM Source: Kalmar Source: HdM THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 5 2025. 11. 28. The Problem THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 6 2025. 11. 28. The Problem THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 7 2025. 11. 28. The Problem XR Effectiveness Efficiency Safety THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 8 2025. 11. 28. The Problem ›So why not just build XR functions for off-highway vehicles (in a traditional way)? Past negative experiences with cabin technologies Limited attention and high-risk environments Solutions get rejected Azodo (2025), Costa et al. (2017), Horberry et al. (2016) THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 9 2025. 11. 28. The Problem ›So why not just build XR functions for off-highway vehicles (in a traditional way)? Past negative experiences with cabin technologies Limited attention and high-risk environments Solutions get rejected XR only works when operators shape it. Azodo (2025), Costa et al. (2017), Horberry et al. (2016) THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 16 2025. 11. 28. Our Transdisciplinary Co-Design Approach THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Approach based on: Rosson & Carroll (2002), Sanders & Stappers (2008), Real & Schmittinger (2022), Lawrence et al. (2022) 17 2025. 11. 28. Frameworks for Privacy and Ethics THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Article 25 of the GDPR, Friedman et al. (2013), Norman (2024) 18 2025. 11. 28. Workshops to understand the core values Identify Put into the context THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 What if... 19 2025. 11. 28. RESULTS THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 20 2025. 11. 28. Results: Scenarios & Visualisations THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 21 2025. 11. 28. Results: Scenarios & Visualisations THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Visualisations: HdM in cooperation with TUD 22 2025. 11. 28. Results: Scenarios & Visualisations THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Visualisations: HdM in cooperation with TUD 23 2025. 11. 28. Results: Scenarios & Visualisations THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Visualisations: HdM in cooperation with TUD 24 2025. 11. 28. Results: XR prototypes THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025 Picture: Prinoth Simulation: VTT Picture: TU Dresden 25 2025. 11. 28. Result: XR Design Guidelines for privacy and ethics THEIA-XR | Sarah Bacher, Tanja Brodbeck, Sophie Doublet, Anastasia Sergeeva | UnitedXR 2025