Full text
LONG PAPER Universal Access in the Information Society https://doi.org/10.1007/s10209-025-01226-2 activities, to stay informed, to acquire new knowledge, to adopt tools to stay competitive and to beable to endure and thrive in this environment. Digital accessibility, especially web accessibility, becomes a necessary condition to avoid exclusion and marginalization, and to guarantee equal opportunities for all vulnerable communities such as Persons with Disabilities (PwD). PwD are able to navigate the Web with the assistance of assistive technologiessuch as screen readers, screen magnifiers and other products. However, if websites fail to adhere to accessible development standards, they are unable to be accessed successfully by PwD, resulting in limited or erroneous access to web content. The digital barriers that have been generated or persistently exist impede the transformation that society needs to be able to adapt to constant technological progress and reap the benefits that this progress offers in order to improve the quality of life of its citizens. Accessibility is a quality of software that supports different user interaction scenarios, settings and technologies. 1 Introduction In today’s interconnected world, technology has a profound impact on our daily lives. The digital landscape has undeniably reshaped how we live, work, and interact. Its access is essential to social interactions, to carry out our daily Ivana Harari [email protected] Sergio Luján-Mora [email protected] Javier Díaz [email protected] 1 Faculty of Informatics, National University of La Plata, 50 Street and 120, La Plata, Buenos Aires 1900, Argentina 2 Department of Software and Computing Systems, University of Alicante, Carretera San Vicente s/n, Alicante, San Vicente del Raspeig 03690, Spain Abstract This article analyses web accessibility, not only from a regulatory point of view, but also from the emotional burden it implies and affects people with disabilities (PwD). In Argentina a significant number of e-government servicesfor citizens are available only on the Web, without proper accessibility considerations, increasing the marginalization and loss of autonomy. Argentina still fails in digital accessibility according to the biennial reviews of the Convention on the Rights of PwD. For this reason, research on the perception of accessibility was developed with the participation of 53 PwD, based on their experiences of interacting with Argentine websites. Also, a technical evaluation of web accessibility according to Web Content Accessibility Guidelines (WCAG 2) standard is included, in order to have a comparative analysis between what is perceived at user experience (UX) perspective and what is automatically validated. Several usability evaluation techniques considering accessibility were used such as interviews and questionnaires for the perception accessibility evaluation, and heuristic evaluation and cognitive walkthrough for the technical accessibility evaluation. After this comprehensive study important reflections emerged. The human impact and UX must be factored into technical accessibility criteria. An unmet accessibility criterion can generate several deep emotional aspects. The perception of web accessibility is built through multiple experiences in which people face barriers not only from the interaction with each particular website. Web developers have to listen to the voices of PwD, to gain a better understanding of their experiences and advocate for their rights creating a more accessible and inclusive web. Keywords Disability · Web accessibility · User experience · Usability evaluation methods · WCAG Accepted: 6 May 2025 © The Author(s) 2025 Web accessibility evaluation from the perception of people with disabilities: case of Argentina IvanaHarari1· SergioLuján-Mora2· JavierDíaz1 1 3
Universal Access in the Information Society Users with disabilities, in a digital poverty condition or in other vulnerable situations, might require access to and use of websites and applications through specific interaction contexts [1]. Insufficient access to the Web can mean that PwD are placed in vulnerable situations in society and exposed to serious risks of discrimination, poverty and social exclusion. Accessibility affects the user experience (UX) at an emotional level in a more profound way than any other software feature. Compared to usability, this goes beyond the level of satisfaction, it is to be able to access or not to access web content and services, it is to feel considered as a potential user or to feel totally excluded [2]. At present, web accessibility is regulated in many countries. Most nations and regions in the world have laws and policies that promote digital accessibility, especially for public websites. The approval of the Convention on the Rights of Persons with Disabilities (CRPD) of the United Nations (UN) [3] has promoted the development of the regulatory framework on digital accessibility in the countries that have adhered to it. Argentina adhered to the CRPD in May 2008 and in November 2010, the Law 26.653 was unanimously adopted. This law concerns the accessibility of the content of websites belonging to public sector bodies, with a particular focus on ensuring that citizens with disabilities and the elderly are able to access said content [4, 5]. Regarding the level of compliance with the CRPD, there are disparities and different progress among the Member States that have adhered to it. The latest UN review on accessibility in Argentina determined that the level of compliance is still pending, and that accessibility problems must be addressed from several aspects that have not yet been resolved [6]. For this reason, it is important to know the actual accessibility compliance level of Argentine websites, with a focus on how it really affects PwD, as well as their assessment and emotional impact. It is necessary to inquire about their emotions when interacting with a website that is accessible and one that is not, even more when the transaction or service is only available online. It is important to consider the human factors involved in the user interaction, before performing a transaction or task in a software system, while developing it and after its completion as specified by Norman in his definition of UX [7]. Therefore, the purpose of this article is to analyze the assessment or degree of awareness of web accessibility based on the experience of the PwD. Aspects of human factors and the transversality and integrality of accessibility will be taken into account. For this purpose, 53 PwD were consulted and commented on their experiences of using Argentine websites and applications and expressed their degree of assessment regarding perceived accessibility. This analysis was complemented with the technical and normative evaluation of accessibility in order to also have a comparative analysis between what is automatically validated and what is perceived at an experimental level by PwD. In the following section, web accessibility will be approached from the normative and legal aspect in Argentina in order to provide the context of the research developed. This is followed by a review of literature related to the area of research. Then, the web accessibility analysis process is explained from the assessment and perception of the PwD consulted, including details of the sample, methodology, instruments used and the main results obtained from the research. It also describes the technical and normative evaluation of the websites referenced by PwD. Finally, the conclusions of the study and future work are detailed. 1.1 Web accessibility legal framework in Argentina According to Argentine Law 26.653, web accessibility refers to “the possibility that the webpage content can be understood and consulted by people with disabilities and by users who have different configurations in their equipment or programs” [5]. This law was unanimously approved in November 2010 and is in compliance with the CRPD through Law 26.378 related to Argentina’s adhesion to CRPD and its facultative protocol [4]. This law obliges the National State and its three powers (executive, legislative and judicial), public service entities as well as organizations with subsidies, contracts or other relationships with the State, to provide accessible websites. The Oficina Nacional de TecnologíasInformáticas (ONTI) (in English, the National Office of Information Technology) of Argentina regulates the bases and criteria for applying accessibility. Its latest act of September 2019 refers to the guidelines WCAG 2.0 [8]. Specifically, it requires compliance with accessibility criteria of priority A and AA of that recommendation [9]. Since Law 26.653, the Argentine provinces have been adhering to it, establishing their own legal regulations, as is the case of Law 15.115: on Accessibility in information, approved in the Province of Buenos Aires, in 2019 [10]. There were also other important initiatives such as that of the Banco Central de la Nación Argentina (BCRA) (in English, Central Bank of the Argentine Republic), which expanded its regulatory framework to improve accessibility to the financial system for all PwD thorough Communication “A” 7517 of May 2022 [11]. In its Sect. 3, it proposes to consider the WCAG 2.0 recommended by ONTI for financial and banking websites -including home bankingto guarantee accessibility for PwD. With regard to the CRPD, the UN carries out biennial reviews of the degree of compliance by each adhered State, 1 3
Universal Access in the Information Society through a specific committee for this purpose. In its latest review report of Argentina, in December 2023 [6], it expresses its concern, among other issues, about the following state of situation: ●Little progress in ensuring and improving accessibility in key areas such as education, health, access to justice and public transport; ●Lack of accessibility of the electronic documentation management system and the web platform for remote procedures for citizens, as well as of the governmental mobile application. These points highlight the transversal and integral scope of accessibility that must be applied in e-government, e-health, transport, e-commerce, e-education and other areas. The use of the Internet is essential nowadays to carry out important activities for the community and even more so when there are functionalities and transactions that are only available on the Web. Applying accessibility governmental mobile applications is also requested. Although they are not required by Law 26.653, they have been emerging significantly in recent times with essential services for citizens. The UN review committee’s report [6] shows that accessibility is still an unresolved issue in the country, that there are still digital barriers in access to information and services available to the citizens, mainly those with disabilities. This means that even if people have assistive technologies and adaptations in their devices to browse web pages or access mobile applications [12], if these websites arenot designed and developed in compliance with accessibility standards, interaction and access to them will be unsuccessful. This situation leads to a lack of autonomy and violates the rights of PwD to access information [13]. Argentina does not have any regulations on the usability or quality of use of software. Accessibility is a quality related to usability, but it has more profound implications if we analyze it in terms of human factors [14]. One issue is a time-consuming navigation to locate a desired option within a web page, and an even more serious problem is a complete or partial inability to access it. One difficulty may be the high-cost of performing a task but another is to overcome the accessibility barriers before dealing with those usability problems. According to Norman [7], User Experience (UX) encompasses all aspects of the end-user’s interaction with the company, its services, and its products. ISO 9241 − 210, which deals with ergonomics of human-system interaction, also defines UX as “A person’s perceptions and responses that result from the use and anticipated use of a product, system or service” [15]. But, in the digital experiences of PwD, the emotional issues that are manifested in the lack of accessibility are also of a different kind. Accessibility barriers can have a profound impact on the emotional and psychological well-being of individuals with disabilities. When people encounter obstacles in accessing digital content or services and also, in other products and places, it can lead to feelings of isolation, frustration, anger, feeling disrespected and undervalued. A lack of accessibility can affect their self-esteem and mental health, leading to an increased risk of anxiety and depression [16]. It is crucial to recognize that accessibility is not just about compliance, but also about creating inclusive experiences that respect the dignity and autonomy of all users. 1.2 Literature review Both the CRPD and the International Classification of Disability Functioning and Health (ICF) [17] recognize that the participation of PwD in activities is fundamental and that this can be affected by environmental factors and the context in which PwD live. They define disability as a situation, not a characteristic of individuals, and that it can be aggravated or intensified by interacting with social or environmental barriers that obstruct their full, effective and equal participation in society. The CRPD, in turn, endorses accessibility as it specifically states in Article 9 to ensure access to the physical environment, to transportation, to information and communications, including software systems and to other facilities and services open or provided to the public [6]. During the COVID-19 pandemic, the critical importance of digital access and inclusion was dramatically highlighted [18]. With widespread lockdowns and social distancing measures, the Web became an essential tool for education, healthcare, employment, and social connection to maintain social ties, highlighting the need for inclusive digital spaces [19]. After that, several services and procedures still remain exclusively online. In this sense, it is important to carry out a survey on literature in the field of study, considering the last years. To cite a few examples, a Springer Link query on all metadata including terms such as “Web Accessibility Perception of People with Disabilities” in the last 5 years showed 362 results, in IEEE Xplore Digital Library it showed 13 results and, in Wiley Online Library, Computer Science returned 328 results. In the case of Taylor & Francis Online returned 6,658 results considering all the open access journals. The queries from which the above results were obtained are detailed in Appendix A. Analyzing the works found, we can highlight those that address advances in accessibility such as facial recognition of emotions, robotics and disability, Artificial Intelligence (AI), home automation and smart cities. Others carry out 1 3
Universal Access in the Information Society compliance in most of them, regardless of whether the country had specific legal regulations on eHealth accessibility or not. In relation to large-scale analysis of web accessibility, Martins, B. and Duarte, C [25]. conducted a systematic study by applying automatic accessibility evaluation to 2,884,498 web pages from 166,311 websites in different countries. Among their main findings, they found an average of 30 errors per page and only 0.5% of the websites in the sample are accessible, considering WCAG 2.1 level A and AA. According to the literature reviewed, it can be concluded that the lack of accessibility is a recurrent problem that still persists and is worldwide. Also, studies conducted by Alajarmeh, N [24]. , Borowska-Besztaet al. [23], Gutierrez et al. [21], and MartínezTorán, M. and Sendra, C [20]. revealed that digital barriers are present in different types of websites such as health, banking, education or for training or job search, infringing people’s rights to access information that is fundamental to their daily activities. Finally, important research on formal metrics and questionnaires for assessing UX and subjective issues over the last decades was discussed. Beyond usability satisfaction questionnaires such as System Usability Scale (SUS), there are others specific to UX [26]. These may include User Experience Questionnaire (UEQ), meCUE or AttrakDiff questionnaires such as those described by Díaz-Oreiroet al. [27]. In these cases, they use pre-established categories about the software such as complicated/easy, recommended/not recommended, confusing/clear, unpredictable/ unpredictable, among others. The UEQ study by Laugwitzet al. [28] uses a scale with 6 categories. It qualifies if the application is attractive, that is, if users like or dislike the product; if it is easy to get familiar with and learn to use; if it is effective, if users can solve their tasks without unnecessary effort. Other factors also include flexibility, whether users feel in control of the interaction and finally, stimulation, whether they find it exciting and motivating to use the product and to use it again. In contrast to the literature analyzed, our study differs in that it does not use categories of possible qualifications about the products used, but rather about the users’ own emotions. The focus is on how PwD feelwhen using accessible or non-accessible websites. The perceptions, thoughts, subjective and emotional aspects experienced by people in these digital experiences are investigated. In addition, another differential issue to take into account is that the categories considered in this study were defined through a participatory process with PwD, they came as a result of people’s own interventions and opinions. studies on accessibility applied to accessible tourism, accessible museums, as well as on electoral voting systems, educational platforms or health systems. However, the related works relevant to this article were based on the accessibility of websites and web applications and how this affects PwD. MartínezTorán, M. and Sendra, C. conducted research on digital accessibility and its different applications on a population of 390 PwD from different provinces of Spain [20]. Among their most interesting findings is the community’s need for access to the Web for training and job search. This work emphasizes the need to improve accessibility in order to be able to access the same content and services used by the majority of people. They request to use the same websites or mobile applications as everyone else, without any particular group being excluded. In their study, on students with disabilities in higher education in Spain, Gutierrez et al. [21]claim to have to face six barriers that still exist beyond current legislation. Among the barriers to be faced, such as teaching, communicational, architectural, social and institutional barriers, there is alack of digital accessibility mainly in websites, educational materials, repositories and web platforms of educational institutions. The investigation conducted by Finkelstein, A. and Gross, T. in Israel shows the importance of integrating the experiences of PwD in research and information about their rights [22]. Based on 61 PwD surveys and 9 focus groups, the results show that the most important barriers they face are stigma, bureaucracy and digital inaccessibility. These are issues that affect decisions and limit the behaviors of PwD both in everyday life and in significant stages of life. Borowska-Besztaet al.conducted an analysis on accessibility in banking apps [23]. They examined a selection of mobile banking apps from four Polish banks that had to adapt and make their apps accessible due to complaints from customers with disabilities who reported financial exclusion. Despite the adaptations made, and the fulfilment of several accessibility criteria, the study indicates that this is not enough. More guidelines are needed to improve the usability and accessibility of these applications, resulting from further involvement and research on the interaction and navigation of PwD. Alajarmeh, N.conducted exploratory research on the accessibility of public health websites in some 25 countries [24]. From Latin America, it includes Mexico and Brazil. These official websites provide reliable information on appropriate health advice, medical advice on disease prevention and control, and relevant topics such as the COVID19 pandemic. The health websites allow citizens to be kept informed about essential health issues, mainly by avoiding informal, arbitrary or fake sources of information. One of the main findings of the study is the lack of accessibility 1 3
Universal Access in the Information Society people who experience disability first in older age compared to those who experience it earlier in life. This analysis implies that older individuals are often assumed not to identify with a disability identity, while younger individuals are more likely to do so. In terms of age, 16 participantswere between 20 and 35, 18 between 36 and 50, 11 between 51 and 65, and 8 over 66 years old. Regarding the level of studies in progress or completed, 7 participantshad received primary educationonly, 22 had secondary education, 11 had post-secondary trades and 13 had university education. Regarding the different assistive technologies, the PwD used, and considering that several participantsselected more than one technology, we have: ●Screen readers (14 PwD); ●Screen settings i.e., high contrast (21 PwD); ●Magnifiers (18 PwD); ●Captioning (9 PwD); ●Keyboard interaction (20 PwD); ●Plain language, simple organization and help (47 PwD); ●Neither flashes nor movements without user control (32 PwD). Finally, regarding the use of devices for web browsing, 38 PwD prefer the computer for important or large transactions and the mobile phone for communication, mobilityand social networks, while 11 only use computers and 4 only mobile phones. 2.2 User data collection for accessibility perception assessment Before starting the evaluation process of the perception of accessibility, PwD were introduced to the research team and a presentation of the objectives and the steps of the evaluation were given. It was emphasized that it was not the people who would be evaluated but the websites they referred to. They were also asked about the requirements to be taken into account in the evaluation process. All the participants were asked for informed consent with their rights, indicating that they could leave the research at any time, and that the websites would be analyzed, not the people who use them. The methods of user data collection were by an initial questionnaire and a subsequent personalized interview. Of the 53 participants, 39 answered the questionnaire and participated in the interview in person, the remaining 14 remotely. The physical place and the virtual space were adapted with the resources requested by PwD. A sign language interpreter was available, screen readers and screen magnifiers were installed and configured, and headphones were made available. 2 Materials and methods The aim of our research is to evaluate PwD’s perception of accessibility based on their experiences in a broadest sense, considering the transversality and integrity of accessibility. The accessibility perception may come from not only as a result of PwD’s experiences using or trying to use websites required to carry out their daily activities, but also as a result of a conjunction of feelings, emotional traces and memory obtained in multiple and continuous experiences interacting with the digital environment and other contexts as a whole. In order to have a comparative analysis between what is perceived at an experimental level and what is automatically validated, a technical and normative evaluation of accessibility of websites is included. The methodological process consists of two consecutive main phases: ●Evaluation of the perception of accessibility: includes the calling for PwD with different disabilities, computer literacy and age, the data collection through questionnaires and individual interviews and the analysis of the results of the accessibility evaluation regarding PwD perception; ●Technical evaluation of the accessibility: includes the selection of websites most referenced by PwD, the normative evaluation according to WCAG 2.1 standard and the analysis of the compliance degree. The following sections discuss methodological issues, the sample of users and data collection instruments used. Then, the results obtained in both evaluations will be explained, and finally, the comparative analysis between perception and technical evaluation of accessibility is explained in the Sect. 6 Discussion. 2.1 Sample of users When PwD were invited to participate in the inquiry process, they were asked about their disability, age, computer literacy, technical requirements to use the computer and preferred devices to access the Web. In this study 53 PwD participated. There were 8 blindparticipants; 14 witha visual disability; 3 withautism; 3 deaf; 2 had hearing disability; 2 had dyslexia; 10 had a physical disability in upper extremities and 11 were elderly people. Each individual indicated his or her own disability status and self-identified with a profile.Older participantsstated that they had some hearing, motor and visual impairments related to the age, “.because of the age”, they said. On this point, Leahy discusses the tendency to separate or reject elderly people from disability [29]. He suggests that there is a difference in the identification processes of 1 3
Universal Access in the Information Society tool for testing issues of contrast, reading order, semantic structure of headings, link texts, accessibility names, language definition, accessibility of forms, among other important accessibility features; ●Screen readers: NVDA for Windows was used and mobile screen readers such as Talkback for Android and VoiceOver for IOs. These are very important tools for analyzing both keyboard and gesture-based sequential interaction, also able to analyze the perception of content through listening; ●Other tools:several software programs were used for manual checks on the websites to be analyzed and to subject them to different interaction scenarios. For simulatorsof different visual conditions the Chrome extension Web Disability Simulator was used, as well asmagnifiers such as built-in browser zoom. To simulate an interaction of a person with dyslexia, Dyslexia simulator extension for Chrome was utilized, and finally a Windows Resizer toolwas installed to check the responsive design. 3 Results of the comprehensive accessibility evaluation process In this section we analyze the results obtained from the integral evaluation process carried out on the accessibility of Argentine websites, which included both a study on the perceived accessibility based on the experiences of use of people with disabilities, and a technical analysis of the sites referenced by them. 3.1 Results regarding experiences of use Through the questionnaire and the interview, valuable information was obtained from PwD. The interview method allowed many participantsto elaborate on their experiences of use, referring to more than one Argentine website: 12 PwD reported on their experience with one website, 20 people on two websites and 21 on three websites. In total, 109 experiences or cases of use were reported and commented on. Some people referred to the same website. According to the type of website, 16 commented experiences of use were about government websites; 45, about commercial websites; 11, about health websites; 5, about information websites; 9, about educational websites; and 20, about banking websites. The government websites included public services websites and mobile web applications. In the commercial category, transport websites, supermarkets, delivery systems, free market and travel systems were considered. In healthcare, social security websites were consulted, as well as The questionnaire used in this research is included in Appendix B. It consisted of three parts.The first part is to find out about the characteristics and profile of the participants. The second part isto ask PwD about their user interaction experiences or use cases of websites they had used or tried to use and that they wanted to give their opinion on. The other part of the questionnaire is about subjective questions. The questions in the first part that PwD had to answer were: Which Argentinewebsites would you like to comment on accessibility based on good or bad experiences of use? What kind of application was it, i.e., governmental, educational, commercial, entertainment, banking? Was it the only way to perform the task in mind? Were you able to achieve your objectives or tasks on the website and how, with or without difficulty, with or without help? Finally, they were asked if they experienced any difficulties in using the website, such as problems in perceiving or understanding the content, in interaction and navigation, or if they experienced technological problems such as the website did not support assistive technologies, a non-standard browser or a slow connection. The subjective part of the questionnaire consisted of open-ended questions to allow people to make a final and conclusive analysis of their experiences of using the websites discussed. The questions were: How did you feel before you had to use a website to perform a task or transaction? How did you feel after using it, whether you achieved your goal or not? Why did you think that there were still inaccessible websites despite legislation? Finally, they were asked if they thought that technological advances such as AI could help to improve accessibility and inclusion. All 53 PwD answered the questionnaire. Although the questionnaire gave them the possibility to read and complete it at their own time, the open-ended subjective questions in the second part of the questionnaire were answered very briefly.Complementing this with a semi-structured in-depth individual interview conducted with PwD after responding to the questionnaire, gave them the opportunity to reflect on the difficulties and barriers they experienced, and to better explain their feelings and emotions. 2.3 Tools for technical accessibility evaluation In the technical accessibility evaluation process, there was no user participation. This process consisted of an exhaustive study on the selected Argentine websites that required the following instruments or technological tools: ●WAVE Chrome extension: this web accessibility evaluation tool, version 3.2.7.2, was required to analyze many WCAG accessibility criterions. It is a very useful 1 3
Universal Access in the Information Society they detected accessibility failures due to content perception problems; in 44, they detected interaction and navigation problems; in 28, they detected comprehension problems; and in 15 experiences of use their assistive technologies were not supported by the website. Figure 2 illustrates these results. Through the interviews, some adjustments were made to the above categories. Inadequate or insufficient alternative texts, such as describing an image using the name of the image file or explaining different images with the same text, were considered as comprehension problems by 5 PwD, and were internally computed as a perception failure, as referenced in the WCAG [8]. Other perception problems were considered as comprehension failures by PwD such as lack of subtitles, overloading with information, unclear organization. In other cases, interaction and operable accessibility problems such as too many steps to reach an option mainly using screen readers or presence of distracting animations or movements were considered as perception problems by PwD. 3.2 Results regarding emotional issues After discussing experiences of use, PwD had to complete the open-ended and subjective part of the questionnaire. In addition to the surveys, they were able to reflect on these digital experiences and clearly express their feelings. During the participants’ reports on their experiences in using the websites, many feelings came to the surface, as described below. This is accompanied by expressions and phrases that were striking, worthy of being highlighted. ●Feeling marginalization: due to the fact that the sites they visited did not cater for their interaction requirements.Most of the PwD, exactly 41 individuals, websites for appointments at doctors’ surgeries and hospitals. At the banking level, home banking and virtual wallet applications were mentioned. In terms of whether they were able to perform the tasks planned on the websites referred, according to the experiences described by the respondents, it can be highlighted that in 19 experiences of use, PwDcarried out their tasks in mind without difficulty; in 39, they achieved the objectives but with great difficulty; in 51, the PwD was unable to perform the desired task. Figure 1 illustrates these results with their percentages. In 65 experiences of use reported by PwD, they asked for assistance, of which in 37 cases they had to let the person who helped them finish the whole task for them and in 28 cases they were guided. In the other 44 commented experiences of use, PwD did not request assistance, because they could not find someone available at the time (14 cases) or because they preferred not to do it (30 cases). In both circumstances, the task remained unfinished. Finally, regarding the accessibility problems encountered during the interaction based on their experiences of use commented, they could answer more than one option: in 17 experiences of use they did not detect any drawbacks; in 53, Fig. 2 Accessibility problems detected during the interaction with the websites Fig. 1 Percentage of task accomplishment 1 3
Universal Access in the Information Society know what the No button was. I had to guess about such an important issue”(Maximiliano, blind person,29 years old). “Now to complete an important transaction on home banking, it sends a validation token to a mobile app. Because of the token I have to install the bank’s mobile app, but I have never been able to log in with facial recognition, I cannot get through the authentication process. It is impossible to read the prompts in small fonts, to see the box where I can focus my face with the right light and accuracy”(Silvia, 33 years old, little visually impaired). With regard to the question on UX, considering the perceived emotional aspects before an interaction with the software product, the following answers were obtained: ●19 personsmentioned the term patience. They argue that prior to initiating a transaction for the first time on a site, having to join forces and courage to face difficulties due to the lack of accessibility, which is already assumed. They assume that it will take time and effort to go through the web page, to understand how it is developed and to analyze what can be done with it. They never expect it to be accessible; ●18 personssaid they felt worried, or afraid, especially when it is an important online transaction and there is no other way to do it. Doubts and thoughts arise such as what happens if I fill in my personal data or account or credit card number and then the accessibility is cut off, what happens to my data and the transaction is interrupted? Questions of insecurity or mistrust multiply in cases of PwD; ●6 personssaid “It depends on my mood that day, sometimes I take it easy and sometimes I get angry as soon as I meet the first barrier or obstacle on the website, feeling that way for the rest of the day”. They indicate that these mood changes can arise even after interaction with the site and can vary according to the negative remembrance of the experience of using the site; ●10 personssaid they were previously encouraged and happy that they can do it online without having to leave the house. Considering the responses on how they feel after using a website or application mainly if it was unsuccessful, the following results can be highlighted: ●14 personshighlighted the term resigned. This state of mind arises from feeling low self-esteem or the feeling that there is no solution to such an adverse situation; ●13 personsreported feeling distressed, mainly when a transaction is interrupted due to lack of accessibility and the transaction is incomplete. “You don’t know how the complained that websites were not designed for PwD, but only for people in optimal conditions. They said: “The target audience is people who see, hear, understand well, and can operate the mouse with dexterity”; “We are not on the agenda”; “We are not a priority”. ●Feeling that they are bothered: by issues of technological ignorance. “It is sad that every time my grandson visits me, I have to ask him to help me with the paperwork online. I’m afraid he won’t want to come anymore” (Nelba, 72 years old). ●Feeling ashamed: because there had to be more people affected to be able to detect some improvements about the lack of accessibility.“It is embarrassing to say this, but the pandemic has benefited us a little because some companies have improved their customer service and assistance to users in case of problems with the website” (Analía, person with dyslexia, 45 years old). ●Feeling stressed or feeling that the software is harmful to them: because the lack of accessibility sometimes makes their disability worse. “I can only use the keyboard. The mouse makes me nervous. It requires a lot of precision and I end up moving everything, making my neurological condition worse. With the discounted transport website for the disabled, it is impossible to buy the ticket without the mouse” (Mabel, person with motor disability, 39 years old). Another account that referred this feeling: “I don’t like movements in web pages, things moving all the time. They upset me and make it difficult for me to keep reading the page. I can’t stand it. You can’t concentrate” (Manuel, person with autism, 21 years old, interacting with a shopping web page with permanently active product carousels). ●Feeling that the right to privacy and intimacy is violated:“You cannot imagine what it feels like when an important result of a private lab test, which you download from the website, is in a non-accessible PDF. It was an HIV antibody test and the report had a crossed stamp with the text Negative. The screen reader could not read it. Without really meaning to, I had to ask my mother to read it to me” (Tomás, blind person, 26 years old). ●Feeling annoyed and overwhelmed: because of the emotional exhaustion caused by non-accessibility sensitive and confidential web services. This emotional aspect was revealed in the following expressions: “In the middle of Covid-19 compulsory precautionary isolation, using the mobile app to be able to ask permission to go out the next day, the screen reader said to me: Do you have a fever? Button Button. Have you lost your sense of smell? Button Button. They did not provide alternative text. I didn’t 1 3
Universal Access in the Information Society We analyzed the color contrast, tab order, hierarchy of headings, use of Accessible Rich Internet Applications (ARIA), alternative texts, form elements, link texts. In the case of PDF documents, we installed the PDF/UA accessibility checker software PAC, version 2024; ●Manual checks: each website was tested with 200% and 400% magnification, and keyboard navigation only. Subtitles and audio description, mouse and keyboard focus, adequacy of content structure, consistent navigation and clear terminology were checked; ●Experimental evaluation: the selected web pages were navigated by screen readers where we could analyze for instance the adequacy of alternative texts, the sequential navigation, the skip to main content, the feedback and notifications access, the visual and hearing reading consistency, the accessible names according to visual names, language specification. For this evaluation process, usability inspection methods such as heuristic evaluation and heuristic walkthrough were applied [30]. The success accessibility criteriaof the WCAG 2.1, level A and AA, were considered as a list of design principles or heuristics. Each website was compared to them in order to identify where the product does not follow those principles. Also, it was necessary to work through a set of prioritized tasks to find additional problems. The main findings of the technical evaluation process based on WCAG 2.1 A, AA on the supermarket website, on the government website for booking tickets, and on the banking website, are resented next. The A and AA success criterion failures forWCAG Perceivable principle detected in the three websites are explained in Table 1. The A and AA success criterion failures forWCAG Operable principle detected in the three websitesare shown in the following Table 2. In Table 3, the A and AA success criterion failures forWCAG Understandable principle detected in the three websites are explained. With respect to the A and AA success criterion failures forWCAG Robust principle detected in the three websites, it was found that progress and feedback messages were not accessible for screen readers so the accessibility success criterion 4.1.3 about Status Messages (Level AA) failed. The screenshots referenced in the technical accessibility assessment as Figs. 3, 4 and 5are shown below. Figure 3 shows the government website with contrast problems. It also includes words in English, the labels are not associated with the respective input text boxes, and the explanation of the acronym CNRT is inserted within the logo image and is not detailed in the alternative text. information was left and there is often no contact to get a person to attend to you”; ●18 personssaid they felt frustrated or annoyed, as they were unable to realize their intentions and wasted a lot of time trying to do so; ●8 personssaid they felt angry, especially when they had to ask for help. They explain that the lack of accessibility undermines people’s autonomy so that their dependence on others generates a feeling of great anger. Finally, when asked whether advances in technology such as AI can help inclusion, the majority responded that “It will certainly help, but if it depends on human intervention, it must have a disability and accessibility perspective in order to be used correctly”. 3.3 Results regarding technical evaluation of accessibility In this section, a technical evaluation of accessibility will be carried out for the three most commented or referenced websites by the PwD interviewed. It is important to know the degree of accessibility from the normative aspect and its comparison with the perceived accessibility. The selection of the Argentine websites to check for conformance with WCAG was according to the perspective of the PwD considering their opinions and their reported experiences of use obtained in the inquiry process. The three most referenced websites were: ●A commercial website of an international chain supermarket, referenced in 45 experiences of use. It offers deals, own-brand products at lower prices and instalments on payment plans. The URL of this website is www.carrefour.com.ar; ●A governmental website that was referenced in 38 experiences of use. It was the National Transport Regulatory Commission’s (CRNT) website for ticket booking. The URL of this website is h t t p s : / / r e s e r v a p a s a j e s . c n r t . g o b . a r / l o g i n; ●A national banking website that was referenced in 32 experiences of use. The URL of this website is h t t p s : / / w w w . b n a . c o m . a r . A WCAG 2.1 AA compliance assessment was carried out on the homepage and on other fiveweb pages of each selected website considering the experience of use reported by PwD. Finally, 18 web pages were analyzed in total. The technical evaluation process consisted of: ●An automatic evaluation: each web page was validated using the web accessibility evaluation tool WAVE. 1 3
Universal Access in the Information Society 2. Diaz, J., Harari, I., Amadeo, P.: Accesibilidad web. Una Mirada integral. La. Plata: Editorial EDULP. (2020). h t t p s : / / d o i . o r g / 1 0 . 3 5 5 3 7 / 1 0 9 1 5 / 1 0 5 7 8 6 3. UN United Nations: Convention on the Rights of Persons with Disabilities. In: New York: United Nations. (2006). h t t p s : / / w w w . o h c h r . o r g / e n / i n s t r u m e n t s - m e c h a n i s m s / i n s t r u m e n t s / c o n v e n t i o n - r i g h t s - p e r s o n s - d i s a b i l i t i e s 4. HCNA Honorable Congreso de la Nación Argentina: Ley 26.378. Aprobación de la Convención sobre los derechos de las personas con discapacidad y su protocolo facultativo. (2008). h t t p s : / / s e r v i c i o s . i n f o l e g . g o b . a r / i n f o l e g I n t e r n e t / v e r N o r m a . d o ? i d = 1 4 1 3 1 7 5. HCNA Honorable Congreso de la Nación Argentina: Ley 26.653. Accesibilidad en los contenidos de las páginas web. (2010). h t t p s : / / s e r v i c i o s . i n f o l e g . g o b . a r / i n f o l e g I n t e r n e t / a n e x o s 6. UN United Nations: Concluding observations on the combined second and third periodic report of Argentina. Committee on the Rights of Persons with Disabilities. In: New York: United Nations. (2023). h t t p s : / / t b i n t e r n e t . o h c h r . o r g / _ l a y o u t s / 1 5 / t r e a t y b o d y e x t e r n a l / D o w n l o a d . a s p x ? s y m b o l n o = C R P D % 2 F C % 2 F A R G % 2 F C O % 2 F 2 - 3 = e n 7. Norman, D.: Emotional Design. Why We Love (or hate) Everyday Things. Basic Books, In: Nueva York (2004) 8. W3C World Wide Web Consortium: Web Content Accessibility Guide 2.0. (2008). https://www.w3.org/TR/WCAG20/ 9. ONTI Oficina Nacional de Tecnologías de Información: Disposición 6/2019. Pautas de accesibilidad de contenido Web 2.0. (2019). h t t p s : / / w w w . a r g e n t i n a . g o b . a r / n o r m a t i v a / n a c i o n a l / d i s p o s i c i % C 3 % B 3 n - 6 - 2 0 1 9 - 3 2 9 2 8 4 10. HCSBA Honorable Cámara de Senadores de la Provincia de Buenos Aires: Ley 15115. Accesibilidad de la Información. (2019). h t t p s : / / n o r m a s . g b a . g o b . a r / a r b / l e y / 2 0 1 9 / 1 5 1 1 5 / 2 3 6 1 11. BCRA Banco Central de la República Argentina: Comunicación A 7517. Protección de los usuarios de servicios financieros. Pautas de accesibilidad para personas con discapacidad. (2022). h t t p s : / / w w w . b c r a . g o b . a r / P d f s / c o m y t e x o r d / A 7 5 1 7 . p d f 12. ISO International Organization for Standardization: ISO 9999:2022. Assistive products. Classification and terminology. Edition 7 (2022) 13. ECLAC Economic Commission for Latin America and the Caribbean: Information and communications technologies for inclusion and empowerment of persons with disabilities in Latin America and the Caribbean. (2018). h t t p s : / / r e p o s i t o r i o . c e p a l . o r g / h a n d l e / 1 1 3 6 2 / 4 3 7 4 4 14. Sauer, J., Sonderegger, A., Schmutz, S.: Usability, user experience and accessibility: towards an integrative model. In: Ergonomics, 63(10), 1207–1220. (2020). h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 0 1 4 0 1 3 9 . 2 0 2 0 . 1 7 7 4 0 8 0 15. ISO International Organization for Standardization: ISO 9241 – 210:2010 Ergonomics of human-system interaction -Part 210: Human-centred design for interactive systems: (2010) 16. Macdonald, S., Deacon, L., Nixon, J., Akintola, A., Gillingham, A., Kent, J., Ellis, G.: The invisible enemy’: Disability, loneliness and isolation. Disabil. Soc. 33(7), 1138–1159 (2018). h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 9 6 8 7 5 9 9 . 2 0 1 8 . 1 4 7 6 2 2 4 17. WHO World Health Organization: International Classification of Impairments, Disabilities and Handicaps (ICIDH). World Health Organization, In: New York (2016). h t t p s : / / i r i s . w h o . i n t / h a n d l e / 1 0 6 6 5 / 2 2 7 7 2 5 18. Jung, J., Katz, R.: Impacto del COVID-19 en la digitalización de América Latina. Documentos de Proyectos. In: Santiago: Editorial Comisión Económica para América Latina y el Caribe (CEPAL). (2022). h t t p s : / / h d l . h a n d l e . n e t / 1 1 3 6 2 / 4 8 4 8 6 19. Muñiz Terra, L.: Desigualdades digitales en tiempos de pandemia en Argentina: un estudio del acceso, conectividad y apropiación de las TICs en el ámbito laboral. In: Centro LATAM Digital. (2021). h t t p s : / / c e n t r o l a t a m . d i g i t a l / p u b l i c a c i o n / d e s i g u a l d a d e s - d i g ........... ●Do you think that IA could resolve problems of web accessibility? □ Yes □ No Why? ........... ●What improvements or suggestions would you like to make? ........... Acknowledgements The authors would like to thank the persons with disabilities who participated in the research with willingness and sincerity. Author contributions This research article was written by Ivana Harari, Sergio Luján-Mora and Javier Diaz who contributed equally to the manuscript. They drafted the main text of the manuscript together and all authors revised the final paper. Funding Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Data availability No datasets were generated or analysed during the current study. Declarations Ethical approval The research conducted in this manuscript is not an interventional study where ethical approval is required by the La Plata National University. It is an observational and quantitative study. It does not include any information that by itself or linked to other data, may reveal the identity of the participants. It ensures that the participants' identities remain anonymous and their personal information is protected. The research conducted adheres to ethical guidelines and privacy regulations of Argentina in observance of requirements imposed by the Data Protection Act 1998. Competing interests The authors declare no competing interests. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit h t t p : / / c r e a t i v e c o m m o n s . o r g / l i c e n s e s / b y / 4 . 0 /. References 1. Kalbag, L.: Accessibility for everyone.In: A Book Apart Edition (2017) 1 3
Universal Access in the Information Society 26. Sauro, J., Lewis, J.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Waltham, Massachusetts (2012). h t t p s : / / d o i . o r g / 1 0 . 1 0 1 6 / C 2 0 1 0 - 0 - 6 5 1 9 2 - 3 27. Díaz-Oreiro, I., López, G., Quesada, L., Guerrero, L.U.X.: Evaluation with Standardized Questionnaires in Ubiquitous Computing and Ambient Intelligence: A Systematic Literature Review. In: Advances in Human-Computer Interaction. (2021). h t t p s : / / d o i . o r g / 1 0 . 1 1 5 5 / 2 0 2 1 / 5 5 1 8 7 2 2 28. Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: HCI and Usability for Education and Work. USAB 2008. Lecture Notes in Computer Science, 5298. Springer, Berlin, Heidelberg (2008). h t t p s : / / d o i . o r g / 1 0 . 1 0 0 7 / 9 7 8 - 3 - 5 4 0 - 8 9 3 5 0 - 9 _ 6 ( 29. Leahy, A.: Disability identity in older Age? - Exploring social processes that influence disability identification with ageing. Disabil. Stud. Q. 42, 3–4 (2023). h t t p s : / / d o i . o r g / 1 0 . 1 8 0 6 1 / d s q . v 4 2 i 3 - 4 . 7 7 8 0 30. Unger, R., Chandler, C.: A project guide to UX design: For user experience designers in the field or in the making. In: New. Riders Publishing h t t p s : / / d o i . o r g / 1 0 . 5 5 5 5 / 2 3 6 1 5 5 5 ( 2 0 1 2) Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. i t a l e s - e n - t i e m p o s - d e - p a n d e m i a - e n - a r g e n t i n a - u n - e s t u d i o - d e l - a c c e s o - c o n e c t i v i d a d - y - a p r o p i a c i o n - d e - l a s - t i c s - e n - e l - a m b i t o - l a b o r a l 20. Martínez Torán, M., Sendra, C.: Brecha Digital y Discapacidad. Una perspectiva centrada en las personas. In: Valencia: Sendemà Editorial. (2022). h t t p s : / / d i c a t i c . c o m / w p - c o n t e n t / u p l o a d s / 2 0 2 2 / 0 6 / E S T U D I O - 2 0 2 1 - B r e c h a - D i g i t a l - y - D i s c a p a c i d a d . p d f 21. Gutiérrez, S., García-González, J.M., Solera, E., Rios Aguilar, S.: Barriers in higher education: perceptions and discourse analysis of students with disabilities in Spain. (2020). h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 9 6 8 7 5 9 9 . 2 0 2 0 . 1 7 4 9 5 6 5 22. Finkelstein, A., Gross, T.: Insights of people with disabilities regarding barriers to equality and inclusion. In: Disability & Society, 1–22. (2024). h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 9 6 8 7 5 9 9 . 2 0 2 4 . 2 3 0 4 2 4 3 23. Borowska-Beszta, A., Śmieszek, M., Borowska-Beszta, B.: Mobile banking apps in Poland and their accessibility for consumers with disabilities: a case study. In: Disability & Society, 1–22. (2023). h t t p s : / / d o i . o r g / 1 0 . 1 0 8 0 / 0 9 6 8 7 5 9 9 . 2 0 2 3 . 2 2 6 3 6 3 1 24. Alajarmeh, N.: Evaluating the accessibility of public health websites: An exploratory cross-country study. Univers. Access. Inf. Soc. 21(3), 771–789 (2022). h t t p s : / / d o i . o r g / 1 0 . 1 0 0 7 / s 1 0 2 0 9 - 0 2 0 - 0 0 7 8 8 - 7 25. Martins, B., Duarte, C.: Large-scale study of web accessibility metrics. Univers. Access. InfSoc. 23, 411–434 (2024). h t t p s : / / d o i . o r g / 1 0 . 1 0 0 7 / s 1 0 2 0 9 - 0 2 2 - 0 0 9 5 6 - x 1 3