UEQ KPI Value Range based on the UEQ Benchmark

UEQ KPI Value Range based on he UEQ Benchma k And eas Hinde ks Uni e si y o Se ille Ma in Sch epp SAP SE F ancisco José Domínguez Mayo Uni e si y o Se ille Ma ía José Escalona Cua esma Uni e si y o Se ille Jö g Thomaschewski Uni e si y o Applied Science Emden/Lee Decembe 2018 Con en s Con en s 1 In oduc ion 2 1.1 UEQKPI........................................... 2 1.2 Resea chMe hodology.................................... 3 2 UEQ KPI Value Range 5 2.1 UEQ KPI Value Range - Benchma k Ca ego y Bad . . . . . . . . . . . . . . . . . . . . 6 2.2 UEQ KPI Value Range - Benchma k Ca ego y Below A e age . . . . . . . . . . . . . . 6 2.3 UEQ KPI Value Range - Benchma k Ca ego y Abo e A e age . . . . . . . . . . . . . . 7 2.4 UEQ KPI Value Range - Benchma k Ca ego y Good . . . . . . . . . . . . . . . . . . . 7 2.5 UEQ KPI Value Range - Benchma k Ca ego y Excellen . . . . . . . . . . . . . . . . . 8 Lis o Figu es 9 Lis o Tables 10 Bibliog aphy 11 1 In oduc ion 1 In oduc ion The o mula desc ibed he e is o combine o e e y pa icipan he alue and assessed impo ance o each UEQ scale. The e o e, we calcula ed o each pa icipan he ela i e impo ance o each scale and mul iplied his wi h he alue o he UEQ scale. This allows o gene a e a meaning ul UX KPI based on he UEQ, ha we ha e named UEQ KPI. The s eps a e desc ibed in de ail below. The me hod p esen ed in his pape is based on he Use Expe ience Ques ionnai e (UEQ) [Laugwi z e al. 2008] and i s benchma k [Sch epp 2017a]. The objec i e o he UEQ is o allow a quick assessmen done by end use s co e ing a p e e ably comp ehensi e imp ession o use expe ience. I should allow he use s o exp ess eelings, imp essions, and a i udes ha a ise when expe iencing he p oduc unde in es iga ion in a e y simple and immedia e way. I consis s o 26 i ems ha a e g ouped in o 6 scales (A ac i eness, Pe spicui y, E iciency, Dependabili y, S imula ion and No el y). Each scale ep esen s a dis inc UX quali y aspec . In his pape , we desc ibe an app oach o calcula e he possible alue ange o he UEQ KPI [Sch epp 2017b]. 1.1 UEQ KPI The cen al idea o ou app oach is o combine o e e y pa icipan he alue and pe cei ed impo - ance o each UEQ scale [Sch epp 2017a]. The e o e, we calcula ed o each pa icipan he ela i e impo ance o each scale and mul iplied his wi h he alue o he UEQ scale. Finally, we ha e gen- e a ed a UX KPI based on he UEQ. We ha e named he esul ing alue UEQ KPI. The s eps a e desc ibed in de ail below. •The esul o he UEQ ep esen s a alue pe pa icipan Paiand o e e y scale: a ac i eness Ai, pe spicui y Pi, e iciency Ei, dependabili y Di, s imula ion Si, and no el y Ni. •The esul o he six addi ional ques ions is a alue o he pe cei ed impo ance o each scale: a ac i eness ai, pe spicui y pi, e iciency ei, dependabili y di, s imula ion si, and no el y ni. •We ha e calcula ed he ela i e impo ance pe pa icipan using he gi en pe cei ed impo ance o each scale. Fo example o a ac i eness Awi=ai/(ai+pi+ei+di+si+ni). •The UEQ KPI pe pa icipan can be calcula ed by mul iplying he mean alue o he UEQ scale wi h i s ela i e impo ance: UEQ KP Ii=Awi∗Ai+Pwi∗Pi+Ewi∗Ei+Dwi∗Di+ 2 In oduc ion Swi∗Si+Nwi∗Ni. The UEQ KPI has been calcula ed using he ollowing o mula: UEQ KPI =1 n n X i=1 (Awi∗Ai+Pwi∗Pi+Ewi∗Ei+Dwi∗Di+Swi∗Si+Nwi∗Ni)(1.1) We ha e used his o mula o calcula e he possible alue ange o he UEQ KPI wi h a combina ion o he UEQ Benchma k and heo e ical alues. 1.2 Resea ch Me hodology The o mula o calcula ing he UEQ KPI consis s o wo pa s o each ac o o he UEQ: The i s is he alue o he UEQ ac o and he second is he pe cei ed impo ance pe UEQ ac o . The UEQ KPI is calcula ed om bo h alues. In o de o de e mine he alue ange o he UEQ KPI, bo h alues should be conside ed. Theo e ically, he wo alues can ha e he ollowing anges: •UEQ ac o : Be ween -3 and +3 •Pe cei ed impo ance: Be ween 1 and 7 I he alues a e calcula ed wi h he UEQ KPI o mula, his esul s is in a alue ange o he UEQ KPI be ween -3 and +3. This is he heo e ically assumed alue ange o he UEQ KPI. Howe e , his alue ange is no e y help ul. Ano he way o calcula e he possible alue ange is o include he UEQ benchma k. A benchma k al eady exis s o he UEQ, which speci ies a p ac ical alue ange o he ac o s o he UEQ [Sch epp 2017a]. The esul s o an e alua ion o a p oduc can hus be be e in e p e ed. The igu e 1.1 shows he benchma k ca ego ies o each ac o . Figu e 1.1: UEQ Benchma k 3 In oduc ion F om he UEQ benchma k, he mean alues pe ac o can be ex ac ed, as a e gi en in able 1.1. ATT PER EFF DEP STI NOV Bad -0.155 -0.185 -0.235 -0.115 -0.255 -0.355 Below A a age 0.930 0.855 0.755 0.955 0.740 0.500 Abo e A a age 1.340 1.315 1.220 1.305 1.145 0.875 Good 1.630 1.725 1.620 1.560 1.425 1.220 Excellen 2.125 2.200 2.140 2.075 2.025 1.950 Table 1.1: UEQ Benchma k - Mean Value o each Fac o (ATT-A ac i eness , PER-Pe spicui y, EFF-E iciency, DEP-Dependabili y, STI-S imunla ion, NOV-No el y) We use hese mean alues o he benchma k o calcula e he possible ange o alues o he UEQ KPI wi h p ac ical da a. In his way, he alue ange o he UEQ KPI can be calcula ed on he basis o he ollowing da a: •UEQ ac o : Mean alues pe UEQ ac o om he benchma k ca ego ies (Bad, Below A a age, Abo e A a age, Good, Excellen ) •Pe cei ed impo ance: Be ween 1 and 7 The UEQ KPI was calcula ed o all benchma k ca ego ies. All possible combina ions o all bench- ma k ca ego ies and o each pe cei ed impo ance ac o (1 o 7 pe UEQ ac o ) we e calcula ed. Chap e 2 p esen s he esul s o he calcula ion. 4 UEQ KPI Value Range 2 UEQ KPI Value Range F om he UEQ KPI o mula (see Sec ion 1.1) and he anges o alues (see Sec ion 1.2), he ollowing mean alues and he minimum and maximum alues o each benchma k ca ego ie esul : UEQ Benchma k UEQ KPI Mean Value UEQ KPI Min Value UEQ KPI Max Value Bad -0.224 -0.286 -0.162 Below A a age 0.768 0.645 0.891 Abo e A a age 1.164 1.038 1.290 Good 1.502 1.375 1.628 Excellen 2.080 2.018 2.143 Table 2.1: UEQ KPI Value Range - O e iew The igu e below shows he able (see able 2.1) g aphically. Figu e 2.1: UEQ KPI Value Range o each Benchma k Range This gi es he possible ange o alues o he UEQ KPI based on he UEQ benchma k o : UEQ KPI Value Range be ween -0.286 and 2.143 The alue ange o he pe cei ed impo ance pe UEQ ac o should be eco ded in an addi ional benchma k, so ha he alue ange o he UEQ KPI can be in e p e ed in an e en be e manne . 5 UEQ KPI Value Range Al hough a heo e ical alue ange om -3 o +3 is possible, i will no occu in a p ac ical applica ion. Ra he , i shows ha he eal alue ange is smalle and mo e posi i e. 2.1 UEQ KPI Value Range - Benchma k Ca ego y Bad Possible ange o alues o he UEQ KPI based on he UEQ benchma k ca ego y bad. The UEQ KPI alue ange o he UEQ benchma k ca ego y bad is be ween -0.286 and -0.126 wi h -0.224 as he mean alue. Figu e 2.2: UEQ KPI Value Range - Benchma k Ca ego y Bad 2.2 UEQ KPI Value Range - Benchma k Ca ego y Below A e age Possible ange o alues o he UEQ KPI based on he UEQ benchma k ca ego y Below A e age. The UEQ KPI alue ange o he UEQ benchma k ca ego y Below A e age is be ween 0.645 and 0.891 wi h 0.768 as he mean alue. 6 UEQ KPI Value Range Figu e 2.3: UEQ KPI Value Range - Benchma k Ca ego y Below A e age 2.3 UEQ KPI Value Range - Benchma k Ca ego y Abo e A e age Possible ange o alues o he UEQ KPI based on he UEQ benchma k ca ego y Abo e A e age. The UEQ KPI alue ange o he UEQ benchma k ca ego y Abo e A e age is be ween 1.038 and 1.290 wi h 1.164 as he mean alue. Figu e 2.4: UEQ KPI Value Range - Benchma k Ca ego y Abo e A e age 2.4 UEQ KPI Value Range - Benchma k Ca ego y Good Possible ange o alues o he UEQ KPI based on he UEQ benchma k ca ego y Good. The UEQ KPI alue ange o he UEQ benchma k ca ego y Good is be ween 1.375 and 1.628 wi h 1.502 as he mean alue. 7 UEQ KPI Value Range Figu e 2.5: UEQ KPI Value Range - Benchma k Ca ego y Good 2.5 UEQ KPI Value Range - Benchma k Ca ego y Excellen Possible ange o alues o he UEQ KPI based on he UEQ benchma k ca ego y Excellen . The UEQ KPI alue ange o he UEQ benchma k ca ego y Excellen is be ween 2.018 and 2.143 wi h 2.080 as he mean alue. Figu e 2.6: UEQ KPI Value Range - Benchma k Ca ego y Excellen 8