The purpose of usability testing is to identify areas of a design that interfere with a user’s ability to use that product effectively, efficiently, and enjoyably. Therefore, we observe while a small group of representative users completes a set of tasks; however, rarely are people with disabilities included in usability tests. That is, unless the purpose is to specifically identify accessibility issues. Why do we keep these studies separate? Are people with disabilities not completing the same tasks as everyone else? Rather than separating usability and accessibility testing, or worse, not including people with disabilities in testing at all, why not simply include them as participants in your usability tests? In this presentation, we’ll show you how easy it can be to do just that and when it is most appropriate. While, yes, there are some extra considerations, usability testing with people with disabilities proves to be worthwhile.
Uxpa 2015 why & how to include people with disabilities (pw ds) in your usability tests_douglas and davis 6-25-2015
1. D a n a D o u g l a s a n d K r i s te n D a v i s
U s e r Wo r k s , I n c .
w w w . u s e r w o r k s . c o m
@ u s e r w o r k s
2. 2
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Gather data that more accurately represents
whole user population
Identify areas that interfere with any user’s
ability to interact with a system
Why include PWDs in testing?
3. 3
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Significant, expensive accessibility issues
can be identified early
It doesn’t require much additional effort,
budget, or time
Only minor adjustments when:
• Recruiting participants
• Collecting data
• Analyzing data
Why include PWDs in testing?
4. 4
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
5. 5
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Consider your target audience
• Including just one or two PWDs will lead
to informative findings
Consider which disabilities could be most
affected when using your product and
make sure to include people who
represent those needs
Who to Recruit
6. 6
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Utilize existing resources
(e.g., recruiting agencies)
Use community resources
• Personal recommendations
(i.e., word of mouth)
• Social media and forums
• Advocacy organizations
• Libraries
• Day centers, churches, schools
• Independent living centers
How to Recruit
7. 7
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Make in-person accommodations
• Consider accessibility of your facility
• Identify transit options
• Cover transportation costs
Offer remote sessions
How to Recruit
8. 8
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Signature guide.
Source: Washington
Secretary of State website
Send a text-based version of consent form
in advance
Provide options for signing
• Response via email
• Verbal agreement
• Online form or digital
signature
• In-person signature guide
How to Obtain Consent
9. 9
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
10. 10
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Consider remote testing
• Avoids transportation issues
• Allows users to participate in a comfortable,
familiar environment
Use tools that the participant is already
familiar with
Loosen requirements for screen sharing or
recording if they cause a barrier
Provide Accommodations
11. 11
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Adjust equipment as needed (if in-person)
• Allow participants to use own devices
• Allow time to set up those devices
• Adjust recording method (microphone or
camera setup) accordingly
Print out or display tasks for easier reading
Consider online chat for participants who
are hearing impaired
Provide Accommodations
12. 12
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Keep same tasks and general
methodology, but:
• Allow more time to complete tasks
• Consider redefining what constitutes a
successful task
• Do not require thinking aloud
• Avoid interrupting to ask probing
questions; wait until later
Be Flexible with Methods
13. 13
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Note any interesting methods used to
overcome accessibility problems or
obstacles
Note any interesting
customization settings
Make Special Observations
14. 14
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Not Using AT
15. 15
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Using Screen Reader
16. 16
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Video Clip: Participant Using Speech Recognition
17. Findings from Sample Sessions
Identified usability issues
Discovered accessibility issues
Revealed a more robust view of how
various users might experience the site
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5 17
18. 18
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
19. 19
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Analyze data in aggregate
Report accessibility issues alongside
broader usability issues
Use video clips to demonstrate issues
How to Analyze the Data
20. Summary
Gather a more accurate representation of
the whole user population
Be flexible with methods
Identify issues that may not have been
identified otherwise
A little bit more effort can have a big
impact on the user experience
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5 20
21. 21
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
22. 22
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Better Accessibility Through Your User Research – Whitney
Quesenbery, UIE Webinar
DigitalGov articles:
Usability Testing with People Who Have Vision Impairment
Looking at User Experience through Two Lenses
User Experience Impossible: The Line Between
Accessibility and Usability
Just Ask: Integrating Accessibility Throughout Design – Shawn
Lawton Henry, Book (Online version; Section on usability)
Usability Testing by People with Disabilities: Some Guerrilla
Tactics – UX Magazine
Resources: Usability Testing with PWDs
23. 23
U X PA I n t e r n a t i o n a l 2 0 1 5 W h y & H o w to I n c l u d e
P e o p l e w i t h D i s a b i l i t i e s i n Yo u r U s a b i l i t y Te s t s
J u n e 2 5 , 2 0 1 5
Kristen Davis
Senior User Experience Specialist
kdavis@userworks.com
Dana Douglas
Senior User Experience Specialist
ddouglas@userworks.com
Questions or comments?