Complementary material of the paper Investigating LLM-based tools to support Usability, Accessibility, User eXperience in HCI activities: A Systematic Literature Mapping

Complementary material of the paper Investigating LLM-based tools to support Usability, Accessibility, User eXperience in HCI activities: A Systematic Literature Mapping Version for review August 2025 Selected papers classified by domain and year The table list the papers accepted after the cut using the inclusion and exclusion criteria by reading the title and the abstract only, and after the quality assessment through in-depth reading. Title Domain Year “I felt listened to”: Evaluating an AI-Powered Reflection Tool for Care Partners Health 2025 A Context-Aware Onboarding Agent for Metaverse Powered by Large Language Models Metaverse 2024 A Conversational Human-Computer Interface for Smart Energy System Simulation Environments Simulation 2024 A Seamless ChatGPT Knowledge Plug-in for the Labour Market LLMs 2024 A User-Centered Framework to Empower People with Parkinson’s Disease Health 2024 Academic Advising Chatbot Powered with AI Agent Education 2025 ACKnowledge: A Computational Framework for Human Compatible Affordance-based Interaction Planning in Real-world Contexts Automation 2025 AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts UX 2022 AI-Driven Text-to-Multimedia Content Generation: Enhancing Modern Content Creation Media 2024 AI-Enabled Conversational Journaling for Advancing Parkinson’s Disease Symptom Tracking Health 2025 AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools LLMs 2025 AltCanvas: A Tile-Based Editor for Visual Content Creation with Generative AI for Blind or Visually Impaired People Accessibility 2024 Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations LLMs 2025 An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors LLMs 2024 AssistantGPT: Enhancing User Interaction with LLM Integration LLMs 2024 1 Title Domain Year Automated Test Transfer across Android Apps using Large Language Models LLMs 2025 Beyond User Experience: Technical and Contextual Metrics for Large Language Models in Extended Reality Media 2024 BIDTrainer: An LLMs-driven Education Tool for Enhancing the Understanding and Reasoning in Bio-inspired Design Education 2024 Blindviz - Intelligent Navigation and Environmental Awareness for the Visually Impaired Accessibility 2025 Boosting Children’s Reading Motivation with LLM-Generated Story Crossovers LLMs 2024 Brickify: Enabling Expressive Design Intent Specification through Direct Manipulation on Design Tokens UX 2025 Canvil: Designerly Adaptation for LLM-Powered User Experiences LLMs 2025 Closing the Loop between User Stories and GUI Prototypes: An LLM-Based Assistant for Cross-Functional Integration in Software Development LLMs 2025 CodeA11y: Making AI Coding Assistants Useful for Accessible Web Development Education 2025 CoExploreDS: Framing and Advancing Collaborative Design Space Exploration Between Human and AI UX 2025 CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaboration LLMs 2023 DeclarUI: Bridging Design and Development with Automated Declarative UI Code Generation Automation 2025 Design Principles for Generative AI Applications 2024 DesignRepair: Dual-Stream Design Guideline-Aware Frontend Repair with Large Language Models Accessibility 2025 Distinguishing GUI Component States for Blind Users using Large Language Models UX 2025 Does ChatGPT Generate Accessible Code? Investigating Accessibility Challenges in LLM-Generated Source Code Accessibility 2024 Does GenAI Make Usability Testing Obsolete? Accessibility 2025 ElderEase AR: Enhancing Elderly Daily Living with the Multimodal Large Language Model and Augmented Reality Metaverso 2025 Emotion-Aware Chatbot with Cultural Adaptation for Mitigating Work-Related Stress UX 2023 Empirical Evidence on Conversational Control of GUI in Semantic Automation Automation 2024 Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models Accessibility 2024 Enhancing Accessibility in Software Engineering Projects with Large Language Models (LLMs) Accessibility 2025 Enhancing Healthcare Information Accessibility Through a Generative Medical Chatbot Health 2024 Enhancing the Podcast Browsing Experience through Topic Segmentation and Visualization with Generative AI LLMs 2024 Enhancing UX Evaluation Through Collaboration with Conversational AI Assistants: Effects of Proactive Dialogue and Timing UX 2024 2 Title Domain Year Enhancing Yoga Pose Recognition Using Large Language Models with Real-World Dataset Integration for Personalized Fitness Assistance LLMs 2025 EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration UX 2025 Evaluating a Large Language Model on Searching for GUI Layouts LLMs 2023 Examining Usability and Student Experience of ChatGPT as a Learning Tool on Moodle in Higher Education Education 2024 Exploration of Large Language Model Application in University Information Service Systems LLMs 2024 Farsight: Fostering Responsible AI Awareness During AI Application Prototyping UX 2024 From Voices to Worlds: Developing an AI-Powered Framework for 3D Object Generation in Augmented Reality LLMs 2025 GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality LLMs 2024 Generating Automatic Feedback on UI Mockups with Large Language Models LLMs 2024 Generative AI Agents, Build a Multilingual ChatGPT-based Customer Service Chatbot Accessibility 2024 Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Model LLMs 2025 GeneyMAP: Exploring the Potential of GenAI to Facilitate Mapping User Journeys for UX Design UX 2025 Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning Accessibility 2025 Gesture and Audio-Haptic Guidance Techniques to Direct Conversations with Intelligent Voice Interfaces LLMs 2025 Grounding with Structure: Exploring Design Variations of Grounded Human-AI Collaboration in a Natural Language Interface Automation 2024 Human+Human or Human+AI: A Comparative Analysis of a Narrative Visualization Design Guide LLMs 2024 IdeationWeb: Tracking the Evolution of Design Ideas in HumanAI Co-Creation LLMs 2025 Improve User Experience of Augmented Reality Tour Guide Application by Using ChatGPT Metaverse 2023 Improving Conversational User Interfaces for Citizen Complaint Management through enhanced Contextual Feedback LLMs 2024 Interface Matters: Exploring Human Trust in Health Information from Large Language Models via Text, Speech, and Embodiment Automation 2025 In-Vehicle Artificial Intelligence Agent System with Local Large Language Models for Agent Selection and Vehicle Control Health 2025 Ivie: Lightweight Anchored Explanations of Just-Generated Code UX 2024 LayoutCopilot: An LLM-Powered Multi-Agent Collaborative Framework for Interactive Analog Layout Design Automation 2025 LLM-powered Multimodal Insight Summarization for UX Testing LLMs 2024 Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation LLMs 2024 MapIO: A Gestural and Conversational Interface for Tactile Maps Accessibility 2025 3 Title Domain Year Memory Reviver: Supporting Photo-Collection Reminiscence for People with Visual Impairment via a Proactive Chatbot LLMs 2024 MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback UX 2024 Multi User Centered Design (MUCD) in Mobile UI/UX Development for Kampung Batik Laweyan UX 2024 NarrAD: Automatic Generation of Audio Descriptions for Movies with Rich Narrative Context Accessibility 2025 NLDesign: A UI Design Tool for Natural Language Interfaces Design 2024 NoTeeline: Supporting Real-Time, Personalized Notetaking with LLM-Enhanced Micronotes Education 2025 One Step at a Time: Combining LLMs and Static Analysis to Generate Next-Step Hints for Programming Tasks Education 2024 Pre-AI and post-AI design: balancing human Creativity and AI Tools in the Industrial Design Process Education 2025 PrISM-Q&A: Step-Aware Voice Assistant on a Smartwatch Enabled by Multimodal Procedure Tracking and Large Language Models UX 2024 ProductMeta: An Interactive System for Metaphorical Product Design Ideation with Multimodal Large Language Models Design 2025 ReadingQuizMaker: A Human-NLP Collaborative System that Supports Instructors to Design High-Quality Reading Quiz Questions Education 2023 Reimagining Public Utilities through AI-Driven User-Centric Multimodal Interaction: A Case Study on the Lighthouse System Accessibility 2024 Research on AI-Powered Employee Feedback Tools UX 2025 ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models Accessibility 2025 Script & Shift: A Layered Interface Paradigm for Integrating Content Development and Rhetorical Strategy with LLM Writing Assistants UX 2025 SimUser: Generating Usability Feedback by Simulating Various Users Interacting with Mobile Applications Design 2024 Since U Been Gone: Augmenting Context-Aware Transcriptions for Re-Engaging in Immersive VR Meetings UX 2025 Smart Sheba: Enhancing Elderly User Experience with LLMEnabled Chatbots and User-Centered Design Health 2025 SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers Accessibility 2024 SummAct: Uncovering User Intentions Through Interactive Behaviour Summarisation UX 2025 Supporting dementia caregivers in Peru through chatbots: generative AI vs structured conversations Health 2024 Talk2Data: A Natural Language Interface for Exploratory Visual Analysis via Question Decomposition UX 2024 Task Assessment of XoNLI: A Natural Language Interface for Occupational Exoskeletons Health 2024 The Co-Creative Design Framework for Hybrid Intelligence Design 2025 The Impact of Generative AI Coding Assistants on Developers Who Are Visually Impaired Accessibility 2025 Towards Building a Mobile App for People on the Spectrum Accessibility 2023 4 Title Domain Year UICrit: Enhancing Automated Design Evaluation with a UI Critique Dataset Design 2024 User Centric Evaluation of Code Generation Tools Development 2024 User Experience with LLM-powered Conversational Recommendation Systems: A Case of Music Recommendation UX 2025 Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomies Human-AI Interaction 2025 VideoA11y: Method and Dataset for Accessible Video Description Accessibility 2025 VirtualMe: A Large Language Model-Powered Chatbot for Enhanced Human Computer Interaction Accessibility 2025 VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language Models UX 2024 VizAbility: Enhancing Chart Accessibility with LLM-based Conversational Interaction Accessibility 2024 Voice-Based Conversational Agents and Knowledge Graphs for Improving News Search in Assisted Living Health 2023 VR, AR, gamification and AI towards the next generation of systems supporting cultural heritage: addressing challenges of a museum context Education 2024 WhatIF: Branched Narrative Fiction Visualization for Authoring Emergent Narratives using Large Language Models Design 2025 Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces Accessibility 2025 5