SlideShare ist ein Scribd-Unternehmen logo
1 von 41
Downloaden Sie, um offline zu lesen
Usability Testing for Technical Writers
dimiter simov
agenda
1. about usability and usability testing
2. tips for better testing experience and results
3. examples from testing documentation with
users
usable
that can be used
convenient or easy to use
usability
a quality of a thing that shows how fit, convenient,
or easy to learn and use that thing is
for particular people in a particular context for a
particular task
usability testing
a way to evaluate, with the help of users, how
usable the thing is
types of usability testing
• formative
• exploratory
• A/B
• remote
• 5-seconds
• walkthrough
• card-sorting
essence = users
why
• users will test it anyway; better fix the problems in
advance
• gives you confidence that you are doing the right
thing
• speeds you up
• makes you rich
(check out The $300 Million Button)
TIPS
tip 1:
solve opinion wars with tests
decide based on test data,
not opinions
tip 2:
what they say is not what they do
“I know how to do it, others would not“
tell them, they were chosen for their qualifications, you want
to see them using the product
“I want images in the documentation”
in fact, they need better documentation; more likely a more
usable product
tip 3:
ask someone else to test your baby
you are biased - familiarity breeds content
tip 4:
look for patterns
base conclusions on behavior
observed in several users
not just one user
tip 5:
focus on red-route tasks
basic and critical tasks first
In Outlook: reply to an email or send email
new, fun, vanity stuff – if time and
resources permit
In Outlook: set stationary or signature
tip 6:
give scenarios and goals
we do not want to give tasks to users
Use the tutorial to learn how to make a birthday-wish
video…
we’d rather tell a story
Your niece has a birthday. Her mother told you she
would enjoy a birthday video very much. You want to
give it a try.
tip 7:
select representative participants
no point testing:
 IDE with students of English studies
 online banking with yuppies and skipping house wives
 phones for grandmas with their grandchildren
define user groups/personas/profiles
include experienced and novices
tip 8:
start with proper introduction
do not scare them; avoid words such as "test";
"we are not testing you but the product" is scary
use a script
tell them what will happen;
give them a few minutes to play around;
start with an easy first task
tip 9:
leave them on their own
don’t help
(unless necessary)
watch your tongue and body language
tip 10:
learn what they think
participants often need reassurance and ask questions
if we answer directly: we don’t learn much
we’d rather answer with a question
“What makes you think this is …?”
“How do you think…?”
EXAMPLES
1: Testing a tutorial
2: Testing a product use case
3: Card sorting for new IA
example 1: Testing a tutorial
We explicitly tested a piece of documentation
ex1: Goals
1. Discover how they find info on a scenario
2. Observe users as they use a tutorial Build a
Business Application Using Node.js
3. Check how experience matters for:
Novices - no or little experience with product
Builders - no scenario experience but other experience
with the product
Extenders - masters of the scenario
ex1: Flow
1. Let them explore
We watched where and what they searched and
what they tried
2. Give them the tutorial after that
ex1: Some points of interest
1. Search
2. Terminology
3. Follow the tutorial
4. Enough info
5. Skip steps
6. Navigate
ex1: Findings: search
• 7 sources of info
(no, they do not start at the
documentation)
• 41 different expressions
ex1: Findings: terminology
Our observations are not conclusive
We are kind of OK
A few terms caused trouble
ex1: Findings: follow tutorial
• Much harder for inexperienced users
• Difficult for confident users – often skip steps
• A number of points for improvement
• Success rate
Novices Builders Extenders
0.5 of 3 2.5 of 6 4 of 4
ex1: Findings: enough info
In general, OK. Some requests/issues for details:
• Code samples: descriptions
Participants read the code to understand the step
• Concepts: links to definitions and details
ex1: Findings: skip steps
Going through the tutorial was 'bumpy'; they skipped
texts, phrases, entire sections
Interaction pattern:
 scroll up and down many times
 get to a step, scroll down to scan the whole step
 scroll back up, and start following the instructions
Reasons: formatting and use of screen real estate
ex1: Findings: navigate
All ended with many tabs and windows
Some did not remember or understand how they
got from one page to another
All tried to use multiple tabs consciously: right-click
to open in a new tabs; but it did not always work
ex1: Findings: navigate within tutorial
 Top navigation
Nobody used it
 Right navigation: Nobody used it
 Done buttons: 3 out of 13 used them
example 2: Testing a product use case
We tested a specific scenario with the product and
observed how and whether participants used the
documentation
ex2: clip 1 - Find the help
ex2: clip 1 findings
 The contextual help
 is easy to find
 did not help
 has no link to the documentation
 has no link to dive deeper on accounts
 The user needs to open the documentation
ex2: clip 2 - Create new item
ex2: clip 2 findings
 The concept info is OK (user scanned the topic)
 No adequate link to creating subaccounts (user
scrolled up and down hunting for a link)
 Search does not return an adequate topic on
creating subaccounts (user searched explicitly)
 Speed matters (user did not wait page to load)
example 3: Card sorting for new IA
We restructured the documentation based on how
users order the information
2. give to users to arrange in
groups and add labels
1. collect
objects/concepts/tasks
3. combine into a unified
model and build structure
ex3: About card sorting
plantsred things
 plants
 flowers
 red things
 flowers
 …
ex3: Results
Period Dec-13 Apr-14 Jul-14 Aug-14 Dec-14 Apr-15 Jun-15 Mar-17
Visits 21 100 13 700 26 800 21 500 34 900 52 000 48 900 136 000
Users 11 400 6 700 6 400 10 000 18 600 27 100 25 800 67 300
Pages per visit 19.9 12.4 6.12 5.8 4.6 4.3 4.5 3.42
Bounce rate 2% 19% 33% 30% 39% 40% 39% 48%
Avg visit duration 05:39 06:41 06:18 06:51 05:39 05:33 05:42 04:50
Avg time on page 00:35 01:14 01:34 01:40 01:38
ex3: Results
In summary
1. work with users to solve opinion wars
2. what users say is not what they do, so watch
3. test early and often
4. look for patterns, then draw conclusions
5. red-route tasks first
6. give scenarios and goals; not instructions
7. select representative participants
8. start with proper introduction
9. leave them on their own
10. learn what they think
YOUR TURN NOW

Weitere ähnliche Inhalte

Was ist angesagt?

Getting started with GoSoapBox
Getting started with GoSoapBoxGetting started with GoSoapBox
Getting started with GoSoapBoxJohn Pytel
 
M9L2 EOC Practice Student Handout
M9L2 EOC Practice Student HandoutM9L2 EOC Practice Student Handout
M9L2 EOC Practice Student HandoutKaren Cardenas
 
Testing in the Wild
Testing in the WildTesting in the Wild
Testing in the WildDawn Code
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Fiona Tranquada
 
How to Use Quizizz for Online Learning and Assessment
How to Use Quizizz for Online Learning and AssessmentHow to Use Quizizz for Online Learning and Assessment
How to Use Quizizz for Online Learning and AssessmentParveen Kumar Sharma
 
Best Practices for Testing Open Source Projects
Best Practices for Testing Open Source ProjectsBest Practices for Testing Open Source Projects
Best Practices for Testing Open Source ProjectsAndrew Chalkley
 
Reactome: Usability testing - is it useful?
Reactome: Usability testing - is it useful? Reactome: Usability testing - is it useful?
Reactome: Usability testing - is it useful? Francis Rowland
 
Kahoot.it Game Pin
Kahoot.it Game PinKahoot.it Game Pin
Kahoot.it Game PinMansoor Khan
 
Hot potatoes
Hot potatoesHot potatoes
Hot potatoesrussellst
 
We Know Less Than You Think (But We Do Know Something)
We Know Less Than You Think (But We Do Know Something)We Know Less Than You Think (But We Do Know Something)
We Know Less Than You Think (But We Do Know Something)Greg Wilson
 
Google Forms Quiz Tutorial
Google Forms Quiz Tutorial Google Forms Quiz Tutorial
Google Forms Quiz Tutorial Adhi Wikantyoso
 
TheComputerQuestion
TheComputerQuestionTheComputerQuestion
TheComputerQuestionTed Samuels
 
Quizzes in Google Forms
Quizzes in Google FormsQuizzes in Google Forms
Quizzes in Google Formscolleenmclain
 
Mentimeter Tutorial
Mentimeter TutorialMentimeter Tutorial
Mentimeter TutorialMakneringer
 
The Mindset Change for the Agile Tester
The Mindset Change for the Agile TesterThe Mindset Change for the Agile Tester
The Mindset Change for the Agile TesterTechWell
 

Was ist angesagt? (20)

Getting started with GoSoapBox
Getting started with GoSoapBoxGetting started with GoSoapBox
Getting started with GoSoapBox
 
M9L2 EOC Practice Student Handout
M9L2 EOC Practice Student HandoutM9L2 EOC Practice Student Handout
M9L2 EOC Practice Student Handout
 
Testing in the Wild
Testing in the WildTesting in the Wild
Testing in the Wild
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
 
How to Use Quizizz for Online Learning and Assessment
How to Use Quizizz for Online Learning and AssessmentHow to Use Quizizz for Online Learning and Assessment
How to Use Quizizz for Online Learning and Assessment
 
Kahoot
Kahoot Kahoot
Kahoot
 
Usability Testing Basics
Usability Testing BasicsUsability Testing Basics
Usability Testing Basics
 
Kahoot how to
Kahoot how toKahoot how to
Kahoot how to
 
Best Practices for Testing Open Source Projects
Best Practices for Testing Open Source ProjectsBest Practices for Testing Open Source Projects
Best Practices for Testing Open Source Projects
 
Reactome: Usability testing - is it useful?
Reactome: Usability testing - is it useful? Reactome: Usability testing - is it useful?
Reactome: Usability testing - is it useful?
 
Kahoot.it Game Pin
Kahoot.it Game PinKahoot.it Game Pin
Kahoot.it Game Pin
 
Hot potatoes
Hot potatoesHot potatoes
Hot potatoes
 
We Know Less Than You Think (But We Do Know Something)
We Know Less Than You Think (But We Do Know Something)We Know Less Than You Think (But We Do Know Something)
We Know Less Than You Think (But We Do Know Something)
 
Google Forms Quiz Tutorial
Google Forms Quiz Tutorial Google Forms Quiz Tutorial
Google Forms Quiz Tutorial
 
Hot potatoes
Hot potatoesHot potatoes
Hot potatoes
 
TheComputerQuestion
TheComputerQuestionTheComputerQuestion
TheComputerQuestion
 
Quizzes in Google Forms
Quizzes in Google FormsQuizzes in Google Forms
Quizzes in Google Forms
 
That quiz
That quizThat quiz
That quiz
 
Mentimeter Tutorial
Mentimeter TutorialMentimeter Tutorial
Mentimeter Tutorial
 
The Mindset Change for the Agile Tester
The Mindset Change for the Agile TesterThe Mindset Change for the Agile Tester
The Mindset Change for the Agile Tester
 

Ähnlich wie Usability Testing for Technical Writers

Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital ProductKyle Soucy
 
TWS 2014 – Testing paper prototypes
TWS 2014 – Testing paper prototypesTWS 2014 – Testing paper prototypes
TWS 2014 – Testing paper prototypesValeria Gasik
 
Testing Paper Prototypes (IxDworks.com)
Testing Paper Prototypes (IxDworks.com)Testing Paper Prototypes (IxDworks.com)
Testing Paper Prototypes (IxDworks.com)Valeria Gasik
 
AAM 2014 Tech Tutorial: User Testing on a Shoestring
AAM 2014 Tech Tutorial: User Testing on a ShoestringAAM 2014 Tech Tutorial: User Testing on a Shoestring
AAM 2014 Tech Tutorial: User Testing on a ShoestringDana Mitroff Silvers
 
How To Ask The Right Questions
How To Ask The Right QuestionsHow To Ask The Right Questions
How To Ask The Right QuestionsHannah Fiechtner
 
DrupalCon Austin: UX Bootcamp workshop
DrupalCon Austin: UX Bootcamp workshopDrupalCon Austin: UX Bootcamp workshop
DrupalCon Austin: UX Bootcamp workshopPerfetti Media
 
Never show a design you haven't tested
Never show a design you haven't testedNever show a design you haven't tested
Never show a design you haven't testedIda Aalen
 
Newbie UX: Something I learned about UX (Business vs Design)
Newbie UX: Something I learned about UX (Business vs Design)Newbie UX: Something I learned about UX (Business vs Design)
Newbie UX: Something I learned about UX (Business vs Design)Soon-Aik Chiew
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation Laurian Vega
 
An Introduction to Usability
An Introduction to UsabilityAn Introduction to Usability
An Introduction to Usabilitydirk.swart
 
Effective Digital Diary Studies / UXPA Webinar May 2016
Effective Digital Diary Studies / UXPA Webinar May 2016Effective Digital Diary Studies / UXPA Webinar May 2016
Effective Digital Diary Studies / UXPA Webinar May 2016Sara Cambridge
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
 
Podcamp11: DIY Usability Testing
Podcamp11: DIY Usability TestingPodcamp11: DIY Usability Testing
Podcamp11: DIY Usability Testingmandyhb
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for StartupsPerfetti Media
 
Prototype Version 1 .docx
Prototype Version 1 .docxPrototype Version 1 .docx
Prototype Version 1 .docxwoodruffeloisa
 
Moderated user testing: do's and don'ts
Moderated user testing: do's and don'tsModerated user testing: do's and don'ts
Moderated user testing: do's and don'tsAGConsult
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype TestingDave Hora
 

Ähnlich wie Usability Testing for Technical Writers (20)

Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
TWS 2014 – Testing paper prototypes
TWS 2014 – Testing paper prototypesTWS 2014 – Testing paper prototypes
TWS 2014 – Testing paper prototypes
 
Testing Paper Prototypes (IxDworks.com)
Testing Paper Prototypes (IxDworks.com)Testing Paper Prototypes (IxDworks.com)
Testing Paper Prototypes (IxDworks.com)
 
AAM 2014 Tech Tutorial: User Testing on a Shoestring
AAM 2014 Tech Tutorial: User Testing on a ShoestringAAM 2014 Tech Tutorial: User Testing on a Shoestring
AAM 2014 Tech Tutorial: User Testing on a Shoestring
 
Level up your customer research
Level up your customer researchLevel up your customer research
Level up your customer research
 
Try It! Learn to Improve Guides and Websites Using Design Research Methods
Try It! Learn to Improve Guides and Websites Using Design Research MethodsTry It! Learn to Improve Guides and Websites Using Design Research Methods
Try It! Learn to Improve Guides and Websites Using Design Research Methods
 
How To Ask The Right Questions
How To Ask The Right QuestionsHow To Ask The Right Questions
How To Ask The Right Questions
 
DrupalCon Austin: UX Bootcamp workshop
DrupalCon Austin: UX Bootcamp workshopDrupalCon Austin: UX Bootcamp workshop
DrupalCon Austin: UX Bootcamp workshop
 
Never show a design you haven't tested
Never show a design you haven't testedNever show a design you haven't tested
Never show a design you haven't tested
 
Newbie UX: Something I learned about UX (Business vs Design)
Newbie UX: Something I learned about UX (Business vs Design)Newbie UX: Something I learned about UX (Business vs Design)
Newbie UX: Something I learned about UX (Business vs Design)
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation
 
An Introduction to Usability
An Introduction to UsabilityAn Introduction to Usability
An Introduction to Usability
 
Effective Digital Diary Studies / UXPA Webinar May 2016
Effective Digital Diary Studies / UXPA Webinar May 2016Effective Digital Diary Studies / UXPA Webinar May 2016
Effective Digital Diary Studies / UXPA Webinar May 2016
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
Podcamp11: DIY Usability Testing
Podcamp11: DIY Usability TestingPodcamp11: DIY Usability Testing
Podcamp11: DIY Usability Testing
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Prototype Version 1 .docx
Prototype Version 1 .docxPrototype Version 1 .docx
Prototype Version 1 .docx
 
Moderated user testing: do's and don'ts
Moderated user testing: do's and don'tsModerated user testing: do's and don'ts
Moderated user testing: do's and don'ts
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 

Mehr von Dimiter Simov

OOUXHO 2020 quantum content
OOUXHO 2020   quantum contentOOUXHO 2020   quantum content
OOUXHO 2020 quantum contentDimiter Simov
 
Are you ready for user feedback - tcworld India-2017
Are you ready for user feedback - tcworld India-2017Are you ready for user feedback - tcworld India-2017
Are you ready for user feedback - tcworld India-2017Dimiter Simov
 
Are you ready for user feedback?
Are you ready for user feedback?Are you ready for user feedback?
Are you ready for user feedback?Dimiter Simov
 
Soft Performance - Laws
Soft Performance - LawsSoft Performance - Laws
Soft Performance - LawsDimiter Simov
 
Soft performance - measuring
Soft performance - measuringSoft performance - measuring
Soft performance - measuringDimiter Simov
 
EuroIA 2015 On Messages
EuroIA 2015 On MessagesEuroIA 2015 On Messages
EuroIA 2015 On MessagesDimiter Simov
 
A UX Journey from Documentation to… Documentation
A UX Journey from Documentation to… DocumentationA UX Journey from Documentation to… Documentation
A UX Journey from Documentation to… DocumentationDimiter Simov
 
Soft-performance: Messages - ISTA 2014
Soft-performance: Messages - ISTA 2014Soft-performance: Messages - ISTA 2014
Soft-performance: Messages - ISTA 2014Dimiter Simov
 
EuroIA 2014 highlights
EuroIA 2014 highlightsEuroIA 2014 highlights
EuroIA 2014 highlightsDimiter Simov
 
To message or Not to message
To message or Not to messageTo message or Not to message
To message or Not to messageDimiter Simov
 
EuroIA 2012 highlights
EuroIA 2012 highlightsEuroIA 2012 highlights
EuroIA 2012 highlightsDimiter Simov
 
ползваемост 18 Feb 2010
ползваемост 18 Feb 2010ползваемост 18 Feb 2010
ползваемост 18 Feb 2010Dimiter Simov
 

Mehr von Dimiter Simov (14)

OOUXHO 2020 quantum content
OOUXHO 2020   quantum contentOOUXHO 2020   quantum content
OOUXHO 2020 quantum content
 
Are you ready for user feedback - tcworld India-2017
Are you ready for user feedback - tcworld India-2017Are you ready for user feedback - tcworld India-2017
Are you ready for user feedback - tcworld India-2017
 
Are you ready for user feedback?
Are you ready for user feedback?Are you ready for user feedback?
Are you ready for user feedback?
 
Soft Performance - Laws
Soft Performance - LawsSoft Performance - Laws
Soft Performance - Laws
 
Soft performance - measuring
Soft performance - measuringSoft performance - measuring
Soft performance - measuring
 
EuroIA 2015 On Messages
EuroIA 2015 On MessagesEuroIA 2015 On Messages
EuroIA 2015 On Messages
 
A UX Journey from Documentation to… Documentation
A UX Journey from Documentation to… DocumentationA UX Journey from Documentation to… Documentation
A UX Journey from Documentation to… Documentation
 
Out of Habit
Out of HabitOut of Habit
Out of Habit
 
Soft-performance: Messages - ISTA 2014
Soft-performance: Messages - ISTA 2014Soft-performance: Messages - ISTA 2014
Soft-performance: Messages - ISTA 2014
 
EuroIA 2014 highlights
EuroIA 2014 highlightsEuroIA 2014 highlights
EuroIA 2014 highlights
 
To message or Not to message
To message or Not to messageTo message or Not to message
To message or Not to message
 
Soft performance
Soft performanceSoft performance
Soft performance
 
EuroIA 2012 highlights
EuroIA 2012 highlightsEuroIA 2012 highlights
EuroIA 2012 highlights
 
ползваемост 18 Feb 2010
ползваемост 18 Feb 2010ползваемост 18 Feb 2010
ползваемост 18 Feb 2010
 

Kürzlich hochgeladen

How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTThink 360 Studio
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Ed Orozco
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLkenzukiri
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtTeeFusion
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsBlock Party
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...khushisharma298853
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comjakyjhon00
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfHctorFranciscoSnchez1
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024mikailaoh
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Amil baba
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Ted Drake
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxHasan S
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillCre8iveskill
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxb2kshani34
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024Alan Dix
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfsaidbilgen
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxSamKuruvilla5
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before ConstructionResDraft
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazineRivanEleraki
 

Kürzlich hochgeladen (19)

How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPT
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy Shirt
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teams
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.com
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdf
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkill
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptx
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptx
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before Construction
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazine
 

Usability Testing for Technical Writers

  • 1. Usability Testing for Technical Writers dimiter simov
  • 2. agenda 1. about usability and usability testing 2. tips for better testing experience and results 3. examples from testing documentation with users
  • 3. usable that can be used convenient or easy to use
  • 4. usability a quality of a thing that shows how fit, convenient, or easy to learn and use that thing is for particular people in a particular context for a particular task
  • 5. usability testing a way to evaluate, with the help of users, how usable the thing is
  • 6. types of usability testing • formative • exploratory • A/B • remote • 5-seconds • walkthrough • card-sorting essence = users
  • 7. why • users will test it anyway; better fix the problems in advance • gives you confidence that you are doing the right thing • speeds you up • makes you rich (check out The $300 Million Button)
  • 9. tip 1: solve opinion wars with tests decide based on test data, not opinions
  • 10. tip 2: what they say is not what they do “I know how to do it, others would not“ tell them, they were chosen for their qualifications, you want to see them using the product “I want images in the documentation” in fact, they need better documentation; more likely a more usable product
  • 11. tip 3: ask someone else to test your baby you are biased - familiarity breeds content
  • 12. tip 4: look for patterns base conclusions on behavior observed in several users not just one user
  • 13. tip 5: focus on red-route tasks basic and critical tasks first In Outlook: reply to an email or send email new, fun, vanity stuff – if time and resources permit In Outlook: set stationary or signature
  • 14. tip 6: give scenarios and goals we do not want to give tasks to users Use the tutorial to learn how to make a birthday-wish video… we’d rather tell a story Your niece has a birthday. Her mother told you she would enjoy a birthday video very much. You want to give it a try.
  • 15. tip 7: select representative participants no point testing:  IDE with students of English studies  online banking with yuppies and skipping house wives  phones for grandmas with their grandchildren define user groups/personas/profiles include experienced and novices
  • 16. tip 8: start with proper introduction do not scare them; avoid words such as "test"; "we are not testing you but the product" is scary use a script tell them what will happen; give them a few minutes to play around; start with an easy first task
  • 17. tip 9: leave them on their own don’t help (unless necessary) watch your tongue and body language
  • 18. tip 10: learn what they think participants often need reassurance and ask questions if we answer directly: we don’t learn much we’d rather answer with a question “What makes you think this is …?” “How do you think…?”
  • 19. EXAMPLES 1: Testing a tutorial 2: Testing a product use case 3: Card sorting for new IA
  • 20. example 1: Testing a tutorial We explicitly tested a piece of documentation
  • 21. ex1: Goals 1. Discover how they find info on a scenario 2. Observe users as they use a tutorial Build a Business Application Using Node.js 3. Check how experience matters for: Novices - no or little experience with product Builders - no scenario experience but other experience with the product Extenders - masters of the scenario
  • 22. ex1: Flow 1. Let them explore We watched where and what they searched and what they tried 2. Give them the tutorial after that
  • 23. ex1: Some points of interest 1. Search 2. Terminology 3. Follow the tutorial 4. Enough info 5. Skip steps 6. Navigate
  • 24. ex1: Findings: search • 7 sources of info (no, they do not start at the documentation) • 41 different expressions
  • 25. ex1: Findings: terminology Our observations are not conclusive We are kind of OK A few terms caused trouble
  • 26. ex1: Findings: follow tutorial • Much harder for inexperienced users • Difficult for confident users – often skip steps • A number of points for improvement • Success rate Novices Builders Extenders 0.5 of 3 2.5 of 6 4 of 4
  • 27. ex1: Findings: enough info In general, OK. Some requests/issues for details: • Code samples: descriptions Participants read the code to understand the step • Concepts: links to definitions and details
  • 28. ex1: Findings: skip steps Going through the tutorial was 'bumpy'; they skipped texts, phrases, entire sections Interaction pattern:  scroll up and down many times  get to a step, scroll down to scan the whole step  scroll back up, and start following the instructions Reasons: formatting and use of screen real estate
  • 29. ex1: Findings: navigate All ended with many tabs and windows Some did not remember or understand how they got from one page to another All tried to use multiple tabs consciously: right-click to open in a new tabs; but it did not always work
  • 30. ex1: Findings: navigate within tutorial  Top navigation Nobody used it  Right navigation: Nobody used it  Done buttons: 3 out of 13 used them
  • 31. example 2: Testing a product use case We tested a specific scenario with the product and observed how and whether participants used the documentation
  • 32. ex2: clip 1 - Find the help
  • 33. ex2: clip 1 findings  The contextual help  is easy to find  did not help  has no link to the documentation  has no link to dive deeper on accounts  The user needs to open the documentation
  • 34. ex2: clip 2 - Create new item
  • 35. ex2: clip 2 findings  The concept info is OK (user scanned the topic)  No adequate link to creating subaccounts (user scrolled up and down hunting for a link)  Search does not return an adequate topic on creating subaccounts (user searched explicitly)  Speed matters (user did not wait page to load)
  • 36. example 3: Card sorting for new IA We restructured the documentation based on how users order the information
  • 37. 2. give to users to arrange in groups and add labels 1. collect objects/concepts/tasks 3. combine into a unified model and build structure ex3: About card sorting plantsred things  plants  flowers  red things  flowers  …
  • 38. ex3: Results Period Dec-13 Apr-14 Jul-14 Aug-14 Dec-14 Apr-15 Jun-15 Mar-17 Visits 21 100 13 700 26 800 21 500 34 900 52 000 48 900 136 000 Users 11 400 6 700 6 400 10 000 18 600 27 100 25 800 67 300 Pages per visit 19.9 12.4 6.12 5.8 4.6 4.3 4.5 3.42 Bounce rate 2% 19% 33% 30% 39% 40% 39% 48% Avg visit duration 05:39 06:41 06:18 06:51 05:39 05:33 05:42 04:50 Avg time on page 00:35 01:14 01:34 01:40 01:38
  • 40. In summary 1. work with users to solve opinion wars 2. what users say is not what they do, so watch 3. test early and often 4. look for patterns, then draw conclusions 5. red-route tasks first 6. give scenarios and goals; not instructions 7. select representative participants 8. start with proper introduction 9. leave them on their own 10. learn what they think

Hinweis der Redaktion

  1. What is usability testing? Traditionally – people sit and do things while we watch them Extended – any research involving users interacting or thinking about a product (docu) Various methods: interviews, card sorting, tree testing, … Examples Testing a tutorial – checking whether users can follow the tutorial successfully end to end. Testing a scenario in SCP – testing the product explicitly and observing the documentation as well. Card sorting – re-building the information architecture of SCP docu. Take home Some tips