Supplementary Material - Abstract Expert Interview Questions for Accelerating DevSafeOps through Large Language Models: Opportunities and Challenges

* Required Opportunities and Risks of LLM-enabled Tools and Automations Your information Participant ID * 1 AutomotiveAutonomous Vehicles or ADAS Functions AutomotiveOther safety relevant applications AutomotiveNon safety relevant functions Other Which area are you working in? 2 How long have you been working in this domain?(including relevant PhD years) 3 OEM Software supplier Other Which one is true about your company: 4 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 1/8 Manager or Product Owner Software Developer System or Function Developer Verification and Validation Engineer Safety Engineer Other Please specify your role: 5 Providing inputs to the programmers (E.g., requirements, software architectures, ...) Writing Codes Reviewing Codes Receiver of softwares (e.g., Testing, integration of software with other components, ...) Other Which case is true in your case: 6 I confirm my informed consent I decline to participate Project Description:“Assuring Safety for Rapid and Continuous Deployment for Autonomous Driving” (ASSERTED) is a research project that started in November 2021 and funded by Sweden’s Innovation Agency (Diarienummer: 2021-02585). Our research goal is to explore methods for coping better with the safety of autonomously driving vehicles for rapid and continuous development and deployment. The project is funded by Sweden’s Innovation Agency (Vinnova) and is a collaboration between Volvo Cars, Zenseact, and Chalmers. Consent Confirmation:Ivoluntarily agree to participate in this study, and I understand that my answers will be anonymized, handled according to GDPR, and may be used for research purposes within the ASSERTED project.By ticking this box, I confirm that I have read and understood the ASSERTED – Informed Consent Form(Oct. 2025) . * 7 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 2/8 Your experience with using AI tools Context: In our study AI is referred to LLM-based tools Yes No Do you have any experience with Large Language Models in your daily tasks? * 8 If yes, which Model and for what task? 9 What are the potential / advantages of these tools? 10 What are the limitations / disadvantagesof these tools? 11 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 3/8 LLM-Driven Knowledge Support What do you see as the main strengths / limitations / concerns of existing third-party LLM tools (e.g., Chat GPT, Gemini, Copilot) when applied to your work? 12 What errors might occur in this use case? 13 What impact could those errors have on the final artifact? 14 Are there detection or mitigation mechanisms in place to catch such errors? 15 Any other comments or concerns? 16 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 4/8 VLM-Based Runtime Monitoring andEvent Detection What errors might occur in this use case? 17 What impact could those errors have on the final artifact? 18 Are there detection or mitigation mechanisms in place to catch such errors? 19 Any other comments or concerns? 20 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 5/8 LLM-Based Safety Analysis and Requirement Engineering What errors might occur in this use case? 21 What impact could those errors have on the final artifact? 22 Are there detection or mitigation mechanisms in place to catch such errors? 23 Any other comments or concerns? 24 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 6/8 LLM-Driven Code Generation and Verification Generate Fast, Eliminate Fast What errors might occur in this use case? 25 What impact could those errors have on the final artifact? 26 Are there detection or mitigation mechanisms in place to catch such errors? 27 How do you evaluate the strengths and weaknesses of this process? 28 Any other comments or concerns? 29 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 7/8 This content is neither created nor endorsed by Microsoft. The data you submit will be sent to the form owner. Microsoft Forms AI in My Role: Opportunities and Risks Make my work easier / more efficient Take over boring or repetitive tasks Might reduce parts of my role Could replace my role entirely I won't use it, or it should be forbidden in my tasks Other What impact do you think AI tools will have on your job? 30 What tasks would you want an AI tool to help you with at work? 31 Any final comment? 32 02/11/2025, 07:55 Opportunities and Risks of LLM-enabled Tools and Automations https://forms.office.com/Pages/DesignPageV2.aspx?origin=NeoPortalPage&subpage=design&id=bnb6gUmjZ0iL9Ks14lCgj0ZfIlp-tixNpA5qVFPC1PZUMUg3… 8/8