Animated Multimedia Application Design

Available on zenodo – DOI : 10.5281/zenodo.17959552 Memorandum on Animated Multimedia Application Design Ergonomic Constraints Author: Abdelkrim Mebarki Master’s Program in Computer Science – Artificial Intelligence & Applications Department of Computer Science – Faculty of Mathematics and Computer Science University of Science and Technology of Oran December 16, 2025 1. What is ergonomics Ergonomics – Scientific discipline concerned with understanding interactions between humans and digital systems, and with applying theoretical principles, empirical data, and design methods to optimize user well-being and overall system performance. The main goal is to adapt software and hardware environments to the human’s cognitive, perceptual, and physical specificities to ensure efficiency, comfort, safety, and usability in HCI (human–computer interaction). In the context of Computer Science, ergonomics—often referred to as HCI Ergonomics — focuses on design of digital systems that align with human perceptual, emotional, physical and cognitive capabilities and limitations. It integrates knowledge from cognitive psychology, perception theory, design science, and computer engineering to ensure that users can interact with high level complex systems effectively and intuitively. Ergonomics goes beyond aesthetic or functional considerations; it encompasses cognitive load, information processing, task performance, and emotional experience of the user. Its ultimate goal is producing interfaces and interaction models that minimize the errors, enhance the user satisfaction, and support the learning and the productivity across diverse contexts—multimedia environments, virtual reality systems, or assistive technologies. 1. The Role of Ergonomics in Multimedia Systems In multimedia animated applications (MAA), ergonomics is central for ensuring that technological sophistication translates into meaningful, usable, and satisfying user experiences. The ergonomic dimension studies the interaction between the human and the system, aiming optimization of comfort, efficiency, and cognitive accessibility. Unlike purely functional software, MAAs integrate multiple perceptual channels: visual, auditory, and haptic — thus increasing the complexity of user interactions. This multidimensional sensorial experience requires a user-centered approach, where design options and decisions stem from an in-depth understanding of users’ needs, contexts, and cognitive abilities. 1.1. User-Centered Design: Foundation of Ergonomic Quality A multimedia application can achieve ergonomic coherence only when this ergonomic is designed around the user, not around the technology. User-centered design (UCD) identifies and integrates user expectations, capacities, and limitations throughout the development cycle. The main goal is to adapt the system to the user rather than forcing this user to adapt to the system. Understanding User Needs Users of MMA have both final needs (the final purpose of use – Learning, playing, producing, or communicating) and immediate needs (The subsequent tasks required to reach that purpose – Navigating, reading, or adjusting parameters). For instance, an educational animation must simultaneously support learner’s cognitive assimilation process (final need) and ease of interaction with didactic content (immediate need). Considering Basic Human Activities A multimedia system engages elementary tasks (reading, listening, speaking, selecting, or manipulating visual elements). The ergonomic challenge lies in the harmonization of these modalities to minimize cognitive load and prevent sensory interference. For example – Combining spoken explanations with animated visuals enhances comprehension, but redundant text and speech may produce overload of information. Target Audience and Knowledge Base The knowledge level and cultural background of the target audience should determine the interface’s complexity and the symbolism of its visual and auditory coding. A children’s storytelling app requires simple Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 2 of 7 metaphors, large buttons, and intuitive icons, whereas a professional 3D animation tool addresses experts expecting precision controls and technical terminology. Ergonomic design must thus be adaptive and context-aware. 1.2. User Integration Throughout the Design Process Ergonomic design involves human users before, during, and after the design stages: • Before design – Collect user data through interviews, observation, questionnaires to define user profiles and identify critical tasks. • During design – Involve users in prototyping and iterative evaluation. Feedback helps align design choices and options with user expectations and detect the usability issues early. • After deployment – Perform usability testing and continuous improvement to assess the longterm comfort and satisfaction in real work conditions. This participatory approach transforms customers from end-user passive recipients into real active codesigners ensuring that final application truly reflects their functional and emotional needs and expectations. 1.3. Separation Between Staging and HMI Scenarios In multimedia animation, two complementary design dimensions coexist and have to be carefully distinguished yet harmonized: Staging Scenario (Content Scenario) This scenario defines the narrative and multimedia content flow—Sequence of animations, sounds, and visual transitions that express meaning or tell a story. The content scenario belongs to the domain of pedagogy, storytelling, or artistic design and determines what the user perceives in the scene. Human–Machine Interaction (HMI) Scenario On the other hand, the communication scenario specifies how the user acts within the system. It is a structured set of possible actions, access points, and responses that define interaction logic. A coherent HMI scenario must ensure that: • The navigation is intuitive and consistent across all the modules. • The feedback from the user actions is immediate and understandable. • The access to functions respects user goals and perceptual hierarchies. The challenge here is to ensure that the narrative dynamics (content) and the interaction dynamics (HMI) complement rather than conflict with one another. For example, interactive buttons should not disrupt animation flow, and animated sequences should not obscure the essential controls. 1.4. Coherence and Accessibility in Interface Design An ergonomic multimedia interface should present a coherent set of actions, easily learnable and predictable. The organization of application menus, visual icons, and spatial zones must reflect the user tasks logic rather than the own developer’s logic. Accessibility principles (readability, contrast, timing of animations, and audio clarity) have to be respected too, to accommodate diverse users including those with sensory or motor impairments. 2. Staging scenario and communication scenario In multimedia animated applications (MAA), the design process involves multiple overlapping and distinct scenarios defining how the content is created, presented, and experienced by users. Among these, the staging scenario and the communication scenario play complementary and fundamentally different roles: - While the staging scenario governs the organization of multimedia scene contents - What is shown, said, or played; - The communication scenario governs the Human-Machine interaction mechanisms – How the user and the system exchange information. Understanding and separating these two definition layers is essential for achieving coherence between the semantic narrative logic of the application and the formal interactive logic. 2.1. The Staging Scenario: The Narrative and Multimedia Dimension The staging scenario (Content or presentation scenario) defines the dramaturgic organization of the multimedia scenes that constitute the application. It includes elements related to the expressive and narrative composition of the virtual world: ➔ Actors – Graphical or animated entities that perform actions or convey messages. Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 3 of 7 ➔ Speech and sounds – Dialogues, narrations, audio effects → Understanding & emotion. ➔ Decors and environments – Visual / Spatial settings in which the action takes place. What does the user see, hear, experience as part of the story or the information being conveyed? This scenario is presented as the audiovisual script of the application—comparable to a film director’s script—organizing the sequencing of scenes, transitions, and multimodal effects. Its goal is semantic coherence and aesthetic impact, ensuring that multimedia resources (text, sound, image) are synchronized and meaningful in conveying the intended transmitted message. 2.2. The Communication Scenario: The Interactive Dimension This scenario describes the dynamic exchange of actions and feedback between the user and the application defining how the system perceives user inputs, interprets them, and responds through appropriate outputs across various communication channels. How does the user act on the system, and how does the system react in return? The communication scenario encompasses: ➔ The actions available to the user – Clicking, selecting, speaking, manipulating virtual objects, navigating in 3D space… ➔ The responses generated by the application – Animations triggered, data displayed, sounds played, interface transitions… ➔ The technical dimension of interaction, including the involved peripherals – Keyboard, mouse, headset, sensors… and the rendering devices – Screen, speakers, VR headset… ➔ The layout and synchronization of communication channels – Visual, auditory, tactile… which have to be coherent to maintain immersion and intelligibility. Thus, this scenario defines the application’s interaction architecture – The structure of dialogues between the human and the machine, the feedback mechanisms, and the response timing, ensuring that the system’s reactivity and usability correspond to user’s cognitive expectations and abilities. 2.3. Complementarity and Design Coherence Although distinct, the two scenarios must operate in synergy: ➔ The staging scenario constructs the meaning and emotional rhythm of the experience. ➔ The communication scenario guarantees that the user can navigate, control, and influence this experience through intuitive interaction. For instance, in an educational simulation: ➔ The staging scenario defines the narrative flow—characters explaining a concept, animations showing phenomena. ➔ The communication scenario defines how the learner interacts—Clicking to start animation, answering questions, or choosing paths through the content. Separating scenarios allows modularizing design – Artistic team refine storytelling and audiovisual coherence, while interaction designers focus on interface usability and technical responsiveness. 3. Ergonomic Constraints in Multimedia Animated Applications The design of Multimedia Animated Applications (MAA) must take into account a wide range of ergonomic constraints that influence both user performance and comfort. These ergonomic constraints arise from the physical, cognitive, informational, and organizational dimensions of human interaction with the technology ecosystem. Their integration ensures that multimedia systems remain accessible, efficient, and psychologically acceptable to the intended audience. 3.1. Physical Constraints Physical ergonomics concerns the relationship between human body and physical environment of the multimedia system. In the context of MAA, this definition includes the arrangement of devices (keyboard, mouse, screen, sensors, virtual reality headsets, haptic devices, etc.) in relation to the user's body posture and movements. Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 4 of 7 The design should exploit human sensory and motor capacities for each perceptual dimension—vision, hearing and haptic—while respecting physiological limitations: ➔ Fields of perception – Central and peripheral vision. ➔ Levels of perception – Color discrimination, sound frequency sensitivity, and tactile resolution. ➔ Angles and distances of perception – Influencing visibility and spatial localization. ➔ Sensitivity to contrasts and brightness. ➔ Thresholds of fatigue and sensory overload. ➔ Detection and interpretation of three-dimensional cues – Depth, movement, perspective. By respecting these parameters, we ensure that the multimedia experience remains comfortable, perceptible, and non-fatiguing, particularly during prolonged use or immersive sessions. 3.2. Informational Constraints The most important dimension in multimedia applications : Informational ergonomics focuses on organization and presentation of information to match the user’s perceptual and tendencies of behaviors. In multimedia animation, behavioral stereotypes—that is, culturally or cognitively conditioned patterns of attention and reaction— are central in design. In this context, users interpret visual and auditory signals according to learned conventions: red for danger, upward motion for progress, or a click sound for validation. The designer must thus anticipate and align with these expectancy patterns ensuring that system messages are immediately understandable without complex interpretations. An ergonomic interface communicates clearly, predictably, and redundantly across modalities while avoiding cognitive confusion or perceptual contradictions or missed interpretations. 3.3. Systemic and Organizational Constraints Beyond individual interaction, multimedia applications are part of a larger socio-technical environment. Systemic ergonomics examines the extension of the restricted human– machine couple to include the entire production and operational global system—from software architecture and network infrastructure to teamwork organization and management of workflow. It recognizes that usability depends not only on the interface itself but also on: ➔ The coordination between human operators, automated processes, and digital tools. ➔ The distribution of tasks between human judgment and system automation. ➔ The compatibility of hardware/peripherals and software components. ➔ The maintenance and adaptability of the system across different contexts. In multimedia production and deployment, ergonomic design must therefore integrate both individual and collective dimensions, ensuring consistency between technical tools, organizational structures, and user practices. 3.4. Cognitive Constraints Another main dimension in MAA: Cognitive ergonomics deals with mental processes involved in interaction—Including: Perception, memory, learning, decision-making and problem-solving. The user’s ability to process multimedia information depends on several interrelated factors: ➔ Mental workload – Increasing with the complexity of tasks, the number of simultaneous stimuli, or the pace of interaction. ➔ Feedback and knowledge of results – Guiding learning and self-regulation. ➔ Social and emotional context – The user’s isolation, anxiety, or fear, which may influence attention and motivation. A well-designed multimedia system must minimize cognitive overload by organizing information hierarchically, supporting progressive learning, and providing immediate, meaningful Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 5 of 7 feedback. It should also maintain an optimal balance between stimulation and control to sustain engagement without causing any stress or confusion. 4. Example of constraints Constraint Type of Ergonomics Explanation Minimize the number of channels Cognitive ergonomics Reduces mental load by limiting the number of simultaneous sensory or informational channels (visual, auditory, haptic) ensuring that the user’s attention is not divided among too many stimuli & improving comprehension & reaction time. Lighten & simplify – Do not encumber Cognitive ergonomics + Informational ergonomics Helps reducing information density and visual clutter, making perception and interpretation easier → It prevents overload & facilitates selective attention & decision-making. Follow the habit & the trend Informational ergonomics Relies on behavioral stereotypes & user expectations – Icons, gestures, menu positions… Aligning with established habits ensures intuitive & and reduces the learning curve. Follow the scenario & accompany it Systemic / Organizational ergonomics + Cognitive ergonomics Ensures coherence between the interface & the narrative flow. The interface must accompany the evolution of content guiding user actions logically within the global system of interaction. Define each action level – Importance, prerequisite, result Cognitive ergonomics Refers to the hierarchization of actions based on cognitive priority &task relevance → Helps users focus on essential operations first & understand dependencies between actions. Association: Action – Channel Informational ergonomics Ensures that each action is transmitted through the most appropriate channel improving consistency & multimodal coherence. Channel layout (priority?) Physical ergonomics + Informational ergonomics Spatial and temporal organization of communication channelsmust respect perceptual fields & attentional priorities combining physical perception principles with information layout design. 4.1. Summary of Relationships Type of Ergonomics Associated Constraints Focus Area Physical Channel layout Spatial perception & motor accessibility Informational Habit & trend, Action–Channel association, Channel layout Clarity, coherence, & perceptual organization Cognitive Minimize channels, Lighten & simplify, Define action levels Mental workload, learning, decision processes Systemic/Organizational Follow the scenario & accompany it Coordination – System, task, & narrative flow 5. Ergonomic Constraints and Immersion in Virtual Reality Applications Immersion in virtual or multimedia environments is a psychophysiological phenomenon emerging from the interaction between the technological mediation and the cognitive human perception. It relies on two intertwined components: ➔ Presence → The subjective sensation of being physically/psychologically located in a mediated environment. ➔ Interactivity → the degree to which the user can act upon and receive coherent feedback from the system in real time. Each type of ergonomics modulates these two primary components by facilitating—or hindering—the user’s perceptual stability, control, and cognitive engagement. 5.1. 1. Physical Ergonomics Effect on Presence ➔ Increase: Realistic spatial correspondence between user’s physical body and virtual space enhances body ownership and proprioceptive coherence (e.g., correct eye–screen distance, motion tracking, haptic feedback). ➔ Decrease: Poor calibration, latency, heavy devices, or uncomfortable postures break perceptual continuity and reduce the sense of embodiment. Effect on Interactivity ➔ Increase: Ergonomic interfaces reduce physical effort and reaction time, which makes actions feel immediate and natural. Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 6 of 7 ➔ Decrease: Non-intuitive controllers, fatigue, or motion sickness disrupt the fluency of interaction and limit the engagement. Example – VR game, well-calibrated hand tracking strengthens both presence (feeling of “being there”) and interactivity (feeling of “doing there”). 5.2. 2. Informational Ergonomics Effect on Presence ➔ Increase: Clear, coherent, and multisensory information maintains perceptual realism and narrative continuity → Users feel embedded in a meaningful and coherent environment. ➔ Decrease: Overload, inconsistency, or ambiguous cues break the perceptual frame and remind the user of the artificiality of the medium and the creation. Effect on Interactivity ➔ Increase: Information ergonomics supports intuitive comprehension of system states and available actions—users naturally know what they can do and how. ➔ Decrease: Excessive data or complex visual hierarchies increase cognitive friction, slowing down action–feedback loops. Example – Adaptive soundscapes guiding attention without overwhelming the user strengthen immersion through perceptually ergonomic balance. 5.3. 3. Organizational Ergonomics Effect on Presence ➔ Increase: Well-organized environment (lighting, space layout, teamwork synchronization) ensures the continuity between real and virtual contexts, maintaining orientation and comfort. ➔ Decrease: Disorganization, interruptions, or mismatched contexts break the illusion of continuity, pulling the user back to the physical real world. Effect on Interactivity ➔ Increase: When system and user tasks are harmonized (predictable responses, efficient task flow), interactivity becomes the most seamless and meaningful. ➔ Decrease: Technical delays, unstable networks, or incoherent task distribution introduce more latency and degrade the interactive fluency. Example – Collaborative VR workspace, synchronized task management enhances both interactivity (coordinated action) and presence (shared virtual space). 5.4. 4. Cognitive Ergonomics Effect on Presence ➔ Increase: When the cognitive load is optimal, users maintain the attentional focus and the emotional involvement, sustaining the illusion of being really in the environment. ➔ Decrease: Excessive mental demand, confusion, or poorly aligned affordances cause breaks in the user attention (“cognitive dissonance”), weakening the feeling of presence. Effect on Interactivity ➔ Increase: Cognitive ergonomics ensures that actions correspond to user expectations— decisions are quick, feedback is understandable, and learning is so implicit. ➔ Decrease: If users must consciously think about interface mechanics instead of task goals, interactivity becomes so mechanical rather than immersive. Example – In an educational simulation, well-designed cognitive cues (color coding, spatial grouping, feedback) allow users to interact fluidly and remain mentally absorbed. Summary – Ergonomics is not a constraint but condition of immersion. When physical, informational, organizational, and cognitive ergonomics are correctly balanced: ➔ Presence is reinforced through perceptual & emotional coherence. ➔ Interactivity is optimized through intuitive and responsive controls. Inversely, neglecting only one dimension—such as cognitive overload or poor physical calibration—creates ruptures of immersion that remind the user they are interacting with a machine, not inhabiting an environment. Memorandum on Animated Multimedia Application Design (A. Mebarki, 2025) Page 7 of 7 6. Managing Ergonomic Constraints to Enhance Control, Analysis, and Decision in Multimedia Animated Applications 6.1. Control: Supporting Efficient and Intuitive Interaction Ergonomic management in the control phase focuses on enabling the user to act naturally and efficiently within the multimedia environment involving: ➔ Reducing cognitive and physical load – Interfaces should minimize unnecessary gestures, redundant channels, or visual clutter. ➔ Consistency & predictability – Layout, feedback, and interaction logic should follow user habits and perceptual patterns, ensuring almost rapid learning and reducing the error rates. ➔ Multisensory coherence – Ergonomics ensures that visual, auditory, and haptic cues are synchronized and meaningful reinforcing user’s feeling of control over system’s responses. ➔ Adaptive control mechanisms: Input devices, gestures, or gaze tracking can adapt sensitivity and feedback according to user profiles, fatigue levels, or environmental conditions. Example – 3D learning environment: Ergonomic calibration of navigation controls (speed, angle, depth cues) allows users maintaining precise manipulation without discomfort or disorientation. 6.2. Analysis: Facilitating Perception and Interpretation The analysis phase concerns the user’s capacity to perceive, interpret, and understand the multimedia content and the system feedback. Constraints are managed to optimize the information flow and perceptual balance: ➔ Selective stimulation – Avoid sensory overload by prioritizing key information through contrast, motion, and sound hierarchy. ➔ Perceptual grouping – Apply Gestalt principles (proximity, similarity, continuity) ensuring clarity in visual scenes or the animated sequences. ➔ Temporal ergonomics – The pace of animation, transition time, and response delay should correspond to the human perceptual thresholds and the reaction times. ➔ Information structuring – The interface must support cognitive ergonomics by segmenting the complex data into digestible units: Layers, sequences, perspectives… Example – Interactive simulation, clear visual emphasis on changing parameters (color shifts, subtle motion…) guides the user attention and analytical reasoning without any visual fatigue. 6.3. Decision: Supporting Cognitive Processing and Action Selection At this stage, ergonomics intervenes reducing mental workload and assisting the user in making accurate and confident choices: ➔ Cognitive ergonomics – Interfaces have to align with the user’s mental models, providing clear cause–effect links between all actions and outcomes. ➔ Feedback & anticipation – Real-time ergonomic feedback (visual, auditory, and haptic) enhances situational awareness, allowing proactive rather than only reactive decisions. ➔ Error tolerance & recovery – The ergonomic design integrates mechanisms for reversible actions, confirmations, and visual cues enabling corrections. ➔ Personalization & adaptation – Decision aids can adjust complexity or presentation style according to user expertise and his cognitive state. Example – Immersive design application, ergonomic decision aids—predictive suggestions or multimodal alerts—helping the user evaluating design options without any cognitive overload. 6.4. Ergonomic Integration and the Rendering System Managing these constraints also affects the entire multimedia rendering pipeline: ➔ Ergonomic calibration influences frame rate, latency and synchronization, ensuring the perceptual continuity process. ➔ It governs resource allocation (e.g., adaptive resolution, sound compression) to preserve smooth interaction without compromising the sensory realism. ➔ It connects peripheral ergonomics (input/output devices) with software ergonomics (interface logic), forming a coherent human–machine system.