SlideShare ist ein Scribd-Unternehmen logo
1 von 47
Downloaden Sie, um offline zu lesen
Jessica DuVerneay
Information Architect, The Understanding Group - @undrstndng
LEAN USER
TESTING
AGENDA
‣ 6:30 - Agenda & Intro
‣ 6:40 - User Testing Basics
‣ 6:50 - Benefits & Limitations
‣ 7:00 - The Lean Approach
‣ 7:10 - When to Test
‣ 7:20 - What to Test
‣ 7:30 - Case Study
‣ 7:40 - Resources & Next Steps
‣ 7:50 - Q&A
2
INTRODUCTION
‣ Clients: Herman Miller, Thompson Reuters /
Techstreet, Macy’s, Metro Health System, University
of Michigan, ASAPS, Cooper Tire
‣ Talks: Taxonomy - WIAD 2013, LAUX Meetup
‣ Workshops: IA/UX Topics including Wireframes,
Performance Continuums, User Testing
‣ Articles: Expert Contributor for UserTesting.com’s
blog, TUG’s site
‣ Global Producer - World Information Architecture
Day (2012)
JESSICA DUVERNEAY - INFORMATION ARCHITECT,
THE UNDERSTANDING GROUP (TUG)
3
INTRODUCTION
THE UNDERSTANDING GROUP - @UNDRSTNDNG
4
LEAN USER TESTING
USER TESTING BASICS
5
USER TESTING BASICS
USER TESTING
‣ Wikipedia says:
“Usability testing is a technique used in user-centered interaction design
to evaluate a product by testing it on users. This can be seen as an
irreplaceable usability practice, since it gives direct input on how real
users use the system.[1] This is in contrast with usability inspection
methods where experts use different methods to evaluate a user interface
without involving users. Usability testing focuses on measuring a human-
made product's capacity to meet its intended purpose. Examples of
products that commonly benefit from usability testing are foods, consumer
products, web sites or web applications, computer interfaces, documents,
and devices. Usability testing measures the usability, or ease of use, of a
specific object or set of objects.”
‣ It is NOT:
A complete set of User Research Activities, Market Research, Statistically
Relevant Research, A/B Testing, Qualitative Formal Research
6
PRO TIP:
Remember, User Testing is
not actually testing the
users - it’s testing the
product from the user’s
actual perspective.
USER TESTING BASICS 7
Activities
Deliverables
SME Interviews
Digital Report Card
Experience Map
Score Notes
Owned
Paid
Social
Mobile
Access
Search
B
A
C
B
C
B
ScenarioScenarioScenario
Alignment Session
Heuristic Analysis
Cross Channel Map
Pagename
PHASE 1
PHASE 2
PHASE 3
Channel Channel Channel
Tactics by Channel
Content Audit
Flow Diagrams
User Interviews
Scenario
Collab Design
Competitive
Site Map
You ThemThemFeatures Them
Impressions
1
2.1
2.2
4.1
4.2
4.3
3.1
2 3 4
User Co-Creation
Personas
Wireframes
Persona
Scenarios
2.0 Page Name
Strategic Brief
Content Inventory
Concept Testing
Stakeholder
Needs
Best
Practices
User Needs
b
a
c
d
2.0 Page Name
Functional Spec.
Analytic Report
Workshops
Recommendations
1.0
1.1
1.2
2.0
3.0
User Testing
Roadmap
Analytic Wishlist
1 2 3
Phased Roadmap
2
1
3
4
We wish we knew...
USER TESTING BASICS 8
The Elements of User Experience
A basic duality: The Web was originally conceived as a hypertextual information space;
but the development of increasingly sophisticated front- and back-end technologies has
fostered its use as a remote software interface. This dual nature has led to much confusion,
as user experience practitioners have attempted to adapt their terminology to cases beyond
the scope of its original application. The goal of this document is to define some of these
terms within their appropriate contexts, and to clarify the underlying relationships among
these various elements.
Jesse James Garrett
jjg@jjg.net
Visual Design: graphic treatment of interface
elements (the "look" in "look-and-feel")
Information Architecture: structural design
of the information space to facilitate
intuitive access to content
Interaction Design: development of
application flows to facilitate user tasks,
defining how the user interacts with
site functionality
Navigation Design: design of interface
elements to facilitate the user's movement
through the information architecture
Information Design: in the Tuftean sense:
designing the presentation of information
to facilitate understanding
Functional Specifications: "feature set":
detailed descriptions of functionality the site
must include in order to meet user needs
User Needs: externally derived goals
for the site; identified through user research,
ethno/techno/psychographics, etc.
Site Objectives: business, creative, or other
internally derived goals for the site
Content Requirements: definition of
content elements required in the site
in order to meet user needs
Interface Design: as in traditional HCI:
design of interface elements to facilitate
user interaction with functionality
Information Design: in the Tuftean sense:
designing the presentation of information
to facilitate understanding
Web as software interface Web as hypertext system
Visual Design: visual treatment of text,
graphic page elements and navigational
components
Concrete
Abstract
time
Conception
Completion
Functional
Specifications
Content
Requirements
Interaction
Design
Information
Architecture
Visual Design
Information Design
Interface Design Navigation Design
Site Objectives
User Needs
User Needs: externally derived goals
for the site; identified through user research,
ethno/techno/psychographics, etc.
Site Objectives: business, creative, or other
internally derived goals for the site
This picture is incomplete: The model outlined here does not account for secondary considerations (such as those arising during technical or content development)
that may influence decisions during user experience development. Also, this model does not describe a development process, nor does it define roles within a
user experience development team. Rather, it seeks to define the key considerations that go into the development of user experience on the Web today.
task-oriented information-oriented
30 March 2000
© 2000 Jesse James Garrett http://www.jjg.net/ia/
USER TESTING BASICS
MODERATED / SYNCHRONOUS TESTING (ONSITE & REMOTE)
9
User
Moderator
USER TESTING BASICS
UNMODERATED / ASYNCHRONOUS / AUTOMATED TESTING
10
User
Moderator
LEAN USER TESTING
UNMODERATED
BENEFITS &
LIMITATIONS
11
UNMODERATED BENEFITS & LIMITATIONS
BENEFITS
‣ Inexpensive, Fast
‣ Can learn high level pain points, random fatal
flaws, percentages of task completion, time on
task, qualitative verbal opinions offered, basic
analytics & demographic info.. more on that
later.
‣ Easy to aggregate concrete numbers if
needed in small or very large test populations
‣ “Quick and dirty”
‣ Can design to validate pretty much anything
‣ Existing tools = Easy to share across
stakeholders
‣ Easy to test a pre-determined flow
‣ Great for iterative design, repeatable
‣ Anonymous comparative analysis & A/B
testing
‣ Easy for one person to write, analyze and
extract findings
‣ Do not need to set up testing lab
‣ No moderator bias / influence
‣ User in natural environment using preferred
technologies & workflows
‣ Asynchronous allows for User Testing to be fit
in with other work responsibilities
‣ Non-local / Global Reach much easier than
moderated testing
12
UNMODERATED BENEFITS & LIMITATIONS
LIMITATIONS
‣ Not as empathy driven, less intuitive
‣ Can’t learn deep opinions or user motivations,
non-verbal cues, users values & personality,
organic / natural use case, deep analytics,
detailed statistics, eye mapping
‣ Not able to correct user
‣ Can not restate or correct poorly written test
on the fly
‣ Not able to dig in / probe for subjective issues
or edge cases
‣ Less non-verbal inference (eye tracking, facial
expressions, etc)
‣ Depending on recruits can be biased very
heavily
‣ Easy to misinterpret by external stakeholders
‣ Somewhat complicated to analyze by multiple
team members
‣ Does not build relationship with customer
‣ Does not completely assure confidentiality or
an NDA
13
LEAN USER TESTING
THE LEAN APPROACH
14
THE LEAN APPROACH
THE ‘MVP’ OF USER TESTING: FIT & FINISH TESTING
If you test nothing else, please test key product
segments & flows for fatal flaws & show
stoppers before you launch.
Common UX & IA Performance Metrics to
consider:
‣ Task Success (Binary Approach for Lean Process)
‣ Time On Task
‣ Errors
‣ Efficiency (Effort / Number of Steps)
‣ Learnability
‣ Perceived Severity of Identified Issues
15
OVERHEARD:
“Friends don’t let friends
launch without user
testing.”
True story.
THE LEAN APPROACH
HOW MANY USERS SHOULD WE TEST?
16
Image: Jakob Nielsen Group
Roughly, 5-6 users will
uncover a vast majority of the
issues per scenario, task, or
flow.
The exact number of tests
depends on the number of
scenarios and demographic
segments you need to test.
THE LEAN APPROACH 17
WHAT TOOLS SHOULD WE USE?
THE LEAN APPROACH 18
THE LEAN APPROACH
HOW TO TEST ‘LEAN’: OTHER CONSIDERATIONS
‣ Create a Testing Team (1-4 people)
‣ Create a Testing Plan (Strategy, Budget, Timeline)
‣ Know the Tools Available
‣ Write Effective Tests
‣ Be Cautious About Recruiting & Incentives
‣ Analyze Data Effectively
‣ Present Your Findings (If Needed) Strategically &
Clearly
‣ Iterate, Repeat, and Improve
19
PRO TIP:
A poorly created &
implemented test can be
worse than useless. Take
time to educate yourself &
plan the test.
LEAN USER TESTING
WHEN TO TEST
20
WHEN TO TEST
TYPICAL PROJECT LIFECYCLE
Discovery: Understanding organizational and business goals for the product or service. This is generally when
the “What & Why” of a product is determined.
User Research: Understanding end user needs and expectations for the same product or service. While the
Discovery Phase established the “What & Why”, this phase is to establish the “Who & Why”
Strategy & Structural Design: Creating a solid strategy & structure for the product or product
improvements. This phase is when the “What, Why & Who” are translated into the strategic and researched “How”.
Launch & Assessment: Building and launching the product, measuring and evaluating success. This is the
continuous improvement phase when efficacy of strategic changes or initial product launches can be measured, and
organizations can begin gathering ideas and creating roadmaps for further improvements or product releases.
21
WHEN TO TEST
LAUNCH & ASSESSMENT
‣ Validate visual fit & finish just prior to launch as a lightweight
QA process
‣ Validate improvement over previous product iterations
‣ Augment quantitative A/B testing to investigate user
preference from a qualitative perspective
‣ Identify unnoticed usability issues or awkward product flows
‣ Show instances of a product in multiple environments
(Desktop vs. Mobile)
‣ Provide an area for users to provide opinions, suggestions, and
desired features lists (especially valuable in the startup space)
22
WHEN TO TEST
DISCOVERY
‣ Establish successful existing user flows that should be
protected during upcoming versions
‣ Identify show stopping usability issues that may have been
missed in initial product road mapping activities
‣ Benchmark your existing product so that at the end of your
project lifecycle, you have data against which to compare your
improved product.
‣ Provide insight into the competitive landscape
23
WHEN TO TEST
USER RESEARCH
‣ Provide a quick and easy way to see a product in front of
multiple user types.
‣ Provide qualitative and quantitative data to flesh out user
research deliverables such as personas (scenarios, tasks,
demographic info, opinions & motivators).
‣ NOTE: Contrary to popular perception, this is actually the
least effective phase to do user testing. User Research, when
done correctly, is far more based on getting to know the user
and their needs, and less on how they would use the existing
product or service.
24
WHEN TO TEST
STRATEGY & STRUCTURAL DESIGN
‣ Point out key issues with Strategic or Structural Design
Direction prior to build using prototypes or sandbox
environments
‣ Test and refine complex user flows
‣ Test and refine navigation structures (TreeJack is a great tool
for this)
‣ Identify unanticipated usability issues that may come up after
strategy and structure is approved, during design and dev
phases
25
WHEN TO TEST
MAIN POINT
26
No matter where you are in your
product cycle, it is advantageous to
consider lean unmoderated testing.
Unmoderated testing is not just for
usability only - testing can add a
different value and data set at each
stage of the project lifecycle.
PRO TIP:
Test early, test often.
LEAN USER TESTING
WHAT TO TEST
27
WHAT TO TEST
1. UX / IA / USABILITY ISSUES
What constitutes success for one product may not necessarily
be indicative of optimal state for another product.
Qualitative data is valuable, but do not ignore the insights
extracted from qualitative information (opinions, ratings,
exclamations, and comments) - they can guide some of the
most effective product changes. 
28
There are some basic measurable indicators to consider while usability
testing. (Note: The indicators listed below heavily reference Measuring the
User Experience by Tullis and Alberts)
‣ Task Completion: Can a user complete the task? To what percentage can
they move in the correct way in the task completion funnel? What issues
are impeding the completion of the task? Do users want to complete the
task in the first place?
‣ Time On Task: How long does it take the user to complete the task? Does
the time it takes to complete the task allow the user to lose interest or
focus? Does the task take too little time to complete?
‣ Errors: Did users make avoidable errors? Did users make unavoidable
errors? Were they able to recover from the errors? What would make the
errors less likely to occur or easier to recover from?
‣ Efficiency: Was the system efficient in effort and number of steps it took for
users to complete a task? Which steps were superfluous or confusing?
Which steps can be streamlined or eliminated? Which steps need to be
added?
‣ Learnability: For repeat visitors, is the system learnable? Does task
success and perceived efficiency increase? Does time on task and  number
of errors decrease? Do certain key actions and flows become tacit?
‣ Perceived Severity of Identified Issues: Are any of the issues noticed by the
testing team not actually registered as issues to the users? Which issues
are most important to achievement of key business flows? Are any of the
issues deal breakers?
WHAT TO TEST
2. COMPETITIVE TESTING
A lesser known benefits of lean unmoderated testing
is the ability to show a test subject a competitor’s
product without the risk of moderator bias.
Learning from a competitor – which flows, content,
and design patterns are successful and which
should be avoided – can be particularly useful in the
startup space where lean UX teams may have to
make s product decisions on limited research. 
QUESTIONS TO CONSIDER:
‣ Which product do users prefer? Why?
‣ Which product was easier to use? Why?
‣ What are some errors my competitor made that I
can avoid during product development?
‣ What are some successful features that my
competitor has that I might want to consider for
product roadmapping?
‣ How do users of different demographics (Age,
Gender, OS, income, etc) respond to each product?
Is one better for my target market? 
29
WHAT TO TEST
3. PREFERENCE
Preference testing may provide direct user insights around:
‣ Visual design & Branding
‣ Interaction design
‣ Copy
‣ Navigation approaches
‣ Use of imagery
‣ Page layout and information hierarchy
‣ Any other contentious issues at your organization that are delaying launch.  
30
PRO TIP:
Don’t mistake this for A/B
testing. While lean user
preference testing can give
insight, it’s not statistically
significant.
WHAT TO TEST
4. VALIDATION OF FIT & FINISH
‣ One to four main user flows
(keep this as simple as
possible)
‣ The main conversion point of
the system
‣ Overall opinions of the visual
design and interaction design
‣ Any crucial UX / IA issues as
previously described
31
WHAT TO TEST
5. OTHER USES: COPYWRITING VALIDATION,
LIGHTWEIGHT MULTI PLATFORM QA, PERSONA INFO
‣ Personas: I’ve augmented other user research activities with data I’ve collected
from unmoderated testing to flesh out personas as needed.
‣ QA Testing: I’ve seen unmoderated user testing implemented as a lightweight QA
process – running the same test on a product in multiple desktop and mobile
environments can provide invaluable insights for a small team with limited QA/
UAT capabilities.
‣ Copywriting & Language: Testing copywriting or taxonomies to some extent can
be done in unmoderated testing. Again, the success of these inquiries will depend
largely on the tools used & the manner in which the tests and scenarios are
crafted. 
32
WHAT TO TEST
MAIN POINT: THE RIGHT TEST AT THE RIGHT TIME
33
LEAN USER TESTING
A CASE STUDY
34
SUMMARY OF ISSUES KEY QUESTIONS
CASE STUDY
How can we optimize our
eCommerce flow to mitigate
these issues?
What can we learn from Lean
User Testing and how can we
add it into our design cycle?
Well known e-commerce client facing:
• Navigation Issues
• Cart Abandonment
• Small Average Order Size (# of Products per
Conversion)
• Cross Channel Confusion of Digital Properties
(Information Site vs. Store)
• Browse Customers = Lower Conversion On Site
• Brand Perception Suboptimal Online vs. Physical
World Product Interaction
WELL KNOWN FURNITURE COMPANY
35
CASE STUDY
SUMMARY: UNMODERATED USABILITY RESEARCH APPROACH
36
PRO TIP:
In hindsight, I should have
tested the proposed
navigation with Treejack
during the Structural Design
Phase.
CASE STUDY
DISCOVERY: HIGH LEVEL USABILITY RESEARCH &
COMPETITIVE INSIGHT
‣ Why (Goal) 1: Identify “low hanging fruit” issues and areas for deeper
research
‣ Why (Goal) 2: Competitive Analysis
‣ Who: 18 Users, 3 Tests, 1 focused on competitor
‣ When: 3 weeks quick testing
‣ How: Unmoderated User Testing, UserTesting.com Recruits
‣ Resulted in 20 Quick Fixes and ~5 areas for significant focused future
research, structural design ideas from competitive research
37
CASE STUDY
USER RESEARCH: SPECIFIC FEATURE & PAGE
USABILITY RESEARCH
Lightweight Approach:
• 12 users, 2 Tests, Captured through Ethn.io Screener
• Incentive = $75 AMEX Gift Card
• Done in conjunction with Moderated Tests, Existing Personas, and Analytics Work
Multiple Hypotheses Tested Flows & Features:
• Cart Abandonment Motivation
• Wishlist Use
• Listing Page Efficacy
• Feature Value to User
• Check Out Flow
• Also Gathered Qualitative User Opinions
Time = ~1 month
• 1 week to plan
• 1 week to implement
• 1 week to Analyze
38
CASE STUDY
RECOMMENDATIONS & OUTCOMES
‣ Multiple UX “Quick Fixes” were launched during the longer project life
cycle
‣ Improved Navigation, Checkout Flow, Product Detail Page, Strategic
Use of Visual Assets
‣ Road map of features & functionality (Faceted Search Results,
Improved Integration of Multiple Sites)
‣ The Preliminary Numbers:
- 16% Increase in order volume
- Organic Traffic increased by 53% (due to improved SEO performance due to navigation changes)
- 84% increase in page views, 28% decline in bounce rate from landing pages
39
CASE STUDY
UNMODERATED USABILITY RESEARCH HELPED
‣ Provide Insight into User Behaviors & Expectations
‣ Ensure a Pervasive Customer Focus through Design Cycles
‣ Identify Initial Problem Set
‣ Point out easily implemented immediate “Quick Fixes”
‣ Narrow & Focus Future Research and Development Efforts
‣ Craft a Strategic User Research Phase
‣ Guide Successful Site Changes
‣ Establish IA / UX Road Mapping & Priority for Next Project Iterations
‣ ... All on relatively lean time & money budgets
40
LEAN USER TESTING
RESOURCES
& NEXT STEPS
41
RESOURCES 42
RESOURCES 43
‣ When to Test: Incorporating User
Testing Into Product Design
‣ Lessons From an Expert: What to
Test
‣ How to Test: 9 Steps for Creating
the Perfect User Test
USERTESTING.COM BLOG
RESOURCES 44
HTTP://REMOTERESEAR.CH/TOOLS/
NEXT STEPS 45
PRO TIP:
5 Free Test Credits for
participants in this class -
use the code
NO CODE AVAILABLE
at usertesting.com
for 5 free tests
TRY IT OUT
NEXT STEPS 46
• can do it for you
• can train you to do it yourselves
• can do it with you
SHAMELESS SELF PROMOTION
Q&A
LEAN USER TESTING 47
Jessica DuVerneay - Information Architect
The Understanding Group (TUG)
http://www.understandinggroup.com
Twitter: @undrstndng
THANK
YOU!

Weitere ähnliche Inhalte

Was ist angesagt?

User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17Morag McLaren
 
Why User Research is must in Product Development
Why User Research is must in Product DevelopmentWhy User Research is must in Product Development
Why User Research is must in Product DevelopmentPuneet Arora
 
Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...UserZoom
 
Understand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user researchUnderstand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user researchMing Lee
 
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...UserZoom
 
UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University Dr.Mohammed Alhusban
 
How to Correctly Use Experimentation in PM by Google PM
How to Correctly Use Experimentation in PM by Google PMHow to Correctly Use Experimentation in PM by Google PM
How to Correctly Use Experimentation in PM by Google PMProduct School
 
Successfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX TestingSuccessfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX TestingUserZoom
 
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ..."Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...Symetria
 
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...UserZoom
 
We’re All UX: Designing a Whole Company Design Team - Giant Conf 2014
We’re All UX:  Designing a Whole Company Design Team - Giant Conf 2014We’re All UX:  Designing a Whole Company Design Team - Giant Conf 2014
We’re All UX: Designing a Whole Company Design Team - Giant Conf 2014Phillip Hunter
 
Making Research a UX Team Sport
Making Research a UX Team SportMaking Research a UX Team Sport
Making Research a UX Team SportUserZoom
 
UserTesting Webinar - Mapping experiences: from insight to Action
UserTesting Webinar - Mapping experiences: from insight to ActionUserTesting Webinar - Mapping experiences: from insight to Action
UserTesting Webinar - Mapping experiences: from insight to ActionUserTesting
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...UserZoom
 
Dev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentDev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentMarty Haught
 
Drupal Usability Report
Drupal Usability ReportDrupal Usability Report
Drupal Usability Reportbrighteyes
 
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...UserZoom
 
Remote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinarRemote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinarUserZoom
 
Reduce Product Failures While Boosting Conversion Rates
Reduce Product Failures While Boosting Conversion RatesReduce Product Failures While Boosting Conversion Rates
Reduce Product Failures While Boosting Conversion RatesUserZoom
 

Was ist angesagt? (20)

User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17
 
Why User Research is must in Product Development
Why User Research is must in Product DevelopmentWhy User Research is must in Product Development
Why User Research is must in Product Development
 
Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...
 
Understand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user researchUnderstand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user research
 
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...
Empowering Data-Driven Marketers: How UX Research & Usability Testing Can Pos...
 
UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University UX and Usability Workshop Southampton Solent University
UX and Usability Workshop Southampton Solent University
 
How to Correctly Use Experimentation in PM by Google PM
How to Correctly Use Experimentation in PM by Google PMHow to Correctly Use Experimentation in PM by Google PM
How to Correctly Use Experimentation in PM by Google PM
 
Successfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX TestingSuccessfully Managing Customer Experience Combining VoC and UX Testing
Successfully Managing Customer Experience Combining VoC and UX Testing
 
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ..."Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...
"Keeping it real” while thinking aloud. Ensuring credibility of eye-tracking ...
 
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
 
We’re All UX: Designing a Whole Company Design Team - Giant Conf 2014
We’re All UX:  Designing a Whole Company Design Team - Giant Conf 2014We’re All UX:  Designing a Whole Company Design Team - Giant Conf 2014
We’re All UX: Designing a Whole Company Design Team - Giant Conf 2014
 
Making Research a UX Team Sport
Making Research a UX Team SportMaking Research a UX Team Sport
Making Research a UX Team Sport
 
UserTesting Webinar - Mapping experiences: from insight to Action
UserTesting Webinar - Mapping experiences: from insight to ActionUserTesting Webinar - Mapping experiences: from insight to Action
UserTesting Webinar - Mapping experiences: from insight to Action
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
 
Dev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentDev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven Development
 
Drupal Usability Report
Drupal Usability ReportDrupal Usability Report
Drupal Usability Report
 
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
 
Mechanical Turk Under the Hood
Mechanical Turk Under the HoodMechanical Turk Under the Hood
Mechanical Turk Under the Hood
 
Remote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinarRemote usability testing & the UCD Process webinar
Remote usability testing & the UCD Process webinar
 
Reduce Product Failures While Boosting Conversion Rates
Reduce Product Failures While Boosting Conversion RatesReduce Product Failures While Boosting Conversion Rates
Reduce Product Failures While Boosting Conversion Rates
 

Andere mochten auch

Users Don't Have Goals
Users Don't Have GoalsUsers Don't Have Goals
Users Don't Have GoalsAndrew Hinton
 
Web Usability Study - Why you need it
Web Usability Study - Why you need itWeb Usability Study - Why you need it
Web Usability Study - Why you need itViviana Talledo, OMCP
 
CBS Sports Analytics, Usability, and Research Roadmap
CBS Sports Analytics, Usability, and Research RoadmapCBS Sports Analytics, Usability, and Research Roadmap
CBS Sports Analytics, Usability, and Research RoadmapRobert Sherron
 
Testing Roadmaps and Experiment Design
Testing Roadmaps and Experiment DesignTesting Roadmaps and Experiment Design
Testing Roadmaps and Experiment DesignTim Stewart
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC
 
Introduction to Usability Testing
Introduction to Usability TestingIntroduction to Usability Testing
Introduction to Usability Testingcallmec
 
An Introduction to the World of User Research
An Introduction to the World of User ResearchAn Introduction to the World of User Research
An Introduction to the World of User ResearchMethods
 
Chris Dayley Searchlove Boston - Powerful A/B Testing User Insights
Chris Dayley Searchlove Boston - Powerful A/B Testing User InsightsChris Dayley Searchlove Boston - Powerful A/B Testing User Insights
Chris Dayley Searchlove Boston - Powerful A/B Testing User InsightsChris Dayley
 
UX and the Product Manager (ProductCamp Boston 2016)
UX and the Product Manager (ProductCamp Boston 2016)UX and the Product Manager (ProductCamp Boston 2016)
UX and the Product Manager (ProductCamp Boston 2016)ProductCamp Boston
 
Airbnb business model analysis
Airbnb business model analysisAirbnb business model analysis
Airbnb business model analysisGua Tabidze
 
Rapid prototyping seminar
Rapid prototyping seminarRapid prototyping seminar
Rapid prototyping seminaravwhysoserious
 
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT
 
Design a Better Business
Design a Better BusinessDesign a Better Business
Design a Better BusinessEmad Saif
 

Andere mochten auch (16)

Users Don't Have Goals
Users Don't Have GoalsUsers Don't Have Goals
Users Don't Have Goals
 
Web Usability Study - Why you need it
Web Usability Study - Why you need itWeb Usability Study - Why you need it
Web Usability Study - Why you need it
 
CBS Sports Analytics, Usability, and Research Roadmap
CBS Sports Analytics, Usability, and Research RoadmapCBS Sports Analytics, Usability, and Research Roadmap
CBS Sports Analytics, Usability, and Research Roadmap
 
Testing Roadmaps and Experiment Design
Testing Roadmaps and Experiment DesignTesting Roadmaps and Experiment Design
Testing Roadmaps and Experiment Design
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research
 
Introduction to Usability Testing
Introduction to Usability TestingIntroduction to Usability Testing
Introduction to Usability Testing
 
An Introduction to the World of User Research
An Introduction to the World of User ResearchAn Introduction to the World of User Research
An Introduction to the World of User Research
 
Chris Dayley Searchlove Boston - Powerful A/B Testing User Insights
Chris Dayley Searchlove Boston - Powerful A/B Testing User InsightsChris Dayley Searchlove Boston - Powerful A/B Testing User Insights
Chris Dayley Searchlove Boston - Powerful A/B Testing User Insights
 
Rapid Prototyping
Rapid PrototypingRapid Prototyping
Rapid Prototyping
 
UX Maturity Models
UX Maturity ModelsUX Maturity Models
UX Maturity Models
 
UX and the Product Manager (ProductCamp Boston 2016)
UX and the Product Manager (ProductCamp Boston 2016)UX and the Product Manager (ProductCamp Boston 2016)
UX and the Product Manager (ProductCamp Boston 2016)
 
Airbnb business model analysis
Airbnb business model analysisAirbnb business model analysis
Airbnb business model analysis
 
Rapid prototyping seminar
Rapid prototyping seminarRapid prototyping seminar
Rapid prototyping seminar
 
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
 
Design a Better Business
Design a Better BusinessDesign a Better Business
Design a Better Business
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 

Ähnlich wie Lean User Testing Intro

"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their inputRandy Earl
 
UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017Gary Coker
 
Basics of-usability-testing
Basics of-usability-testingBasics of-usability-testing
Basics of-usability-testingWBC Software Lab
 
Usability methods to improve EMRs
Usability methods to improve EMRsUsability methods to improve EMRs
Usability methods to improve EMRsJeffery Belden
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupNormanMendoza
 
Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Shilpa Thanawala
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinMad*Pow
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best PracticesDan Berlin
 
User Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUser Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUserZoom
 
Analytics and user experience. Alessandro TREZZI
Analytics and user experience. Alessandro TREZZIAnalytics and user experience. Alessandro TREZZI
Analytics and user experience. Alessandro TREZZILouise Chaussade
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingUserZoom
 
Uz big design talk may10
Uz big design talk may10Uz big design talk may10
Uz big design talk may10UserZoom
 
UserZoom Webinar: How to Conduct Web Customer Experience Benchmarking
UserZoom Webinar: How to Conduct Web Customer Experience BenchmarkingUserZoom Webinar: How to Conduct Web Customer Experience Benchmarking
UserZoom Webinar: How to Conduct Web Customer Experience BenchmarkingUserZoom
 
Usability in product development
Usability in product developmentUsability in product development
Usability in product developmentRavi Shyam
 
UCD & Usability testing at the St. Augustine Campus
UCD & Usability testing at the St. Augustine CampusUCD & Usability testing at the St. Augustine Campus
UCD & Usability testing at the St. Augustine CampusKezia Payne
 
UCD and Usability Testing (2007)
UCD and Usability Testing (2007)UCD and Usability Testing (2007)
UCD and Usability Testing (2007)peziak
 

Ähnlich wie Lean User Testing Intro (20)

"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their input
 
UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017
 
Basics of-usability-testing
Basics of-usability-testingBasics of-usability-testing
Basics of-usability-testing
 
Usability methods to improve EMRs
Usability methods to improve EMRsUsability methods to improve EMRs
Usability methods to improve EMRs
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 
Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14
 
UCD overview
UCD overviewUCD overview
UCD overview
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best Practices
 
User Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUser Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 Vf
 
Usability_Evaluation
Usability_EvaluationUsability_Evaluation
Usability_Evaluation
 
Analytics and user experience. Alessandro TREZZI
Analytics and user experience. Alessandro TREZZIAnalytics and user experience. Alessandro TREZZI
Analytics and user experience. Alessandro TREZZI
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability Testing
 
Uz big design talk may10
Uz big design talk may10Uz big design talk may10
Uz big design talk may10
 
UserZoom Webinar: How to Conduct Web Customer Experience Benchmarking
UserZoom Webinar: How to Conduct Web Customer Experience BenchmarkingUserZoom Webinar: How to Conduct Web Customer Experience Benchmarking
UserZoom Webinar: How to Conduct Web Customer Experience Benchmarking
 
The UX Analyst
The UX AnalystThe UX Analyst
The UX Analyst
 
Usability in product development
Usability in product developmentUsability in product development
Usability in product development
 
UCD & Usability testing at the St. Augustine Campus
UCD & Usability testing at the St. Augustine CampusUCD & Usability testing at the St. Augustine Campus
UCD & Usability testing at the St. Augustine Campus
 
UCD and Usability Testing (2007)
UCD and Usability Testing (2007)UCD and Usability Testing (2007)
UCD and Usability Testing (2007)
 
Beginners QA Testing
Beginners QA TestingBeginners QA Testing
Beginners QA Testing
 

Mehr von Jessica DuVerneay

Happy, Healthy, High-performing Teams
Happy, Healthy, High-performing TeamsHappy, Healthy, High-performing Teams
Happy, Healthy, High-performing TeamsJessica DuVerneay
 
UX101: Strategy, Structure, & Experience
UX101: Strategy, Structure, & Experience UX101: Strategy, Structure, & Experience
UX101: Strategy, Structure, & Experience Jessica DuVerneay
 
Taming Your Services Taxonomy: Strategic IA for Great UX
Taming Your Services Taxonomy: Strategic IA for Great UXTaming Your Services Taxonomy: Strategic IA for Great UX
Taming Your Services Taxonomy: Strategic IA for Great UXJessica DuVerneay
 
Information Architecture: The Strategic Structure of Great UX - WIAD 2017
Information Architecture: The Strategic Structure of Great UX - WIAD 2017Information Architecture: The Strategic Structure of Great UX - WIAD 2017
Information Architecture: The Strategic Structure of Great UX - WIAD 2017Jessica DuVerneay
 
Architecture & IA: Expanding the Metaphor - IA Summit 2016
Architecture & IA: Expanding the Metaphor - IA Summit 2016Architecture & IA: Expanding the Metaphor - IA Summit 2016
Architecture & IA: Expanding the Metaphor - IA Summit 2016Jessica DuVerneay
 
Architecture & IA: Expanding the Metaphor - WIAD 2016 - Milwaukee
Architecture & IA: Expanding the Metaphor - WIAD 2016 - MilwaukeeArchitecture & IA: Expanding the Metaphor - WIAD 2016 - Milwaukee
Architecture & IA: Expanding the Metaphor - WIAD 2016 - MilwaukeeJessica DuVerneay
 
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)Jessica DuVerneay
 
Taming Taxonomy: A Practical Intro
Taming Taxonomy: A Practical IntroTaming Taxonomy: A Practical Intro
Taming Taxonomy: A Practical IntroJessica DuVerneay
 

Mehr von Jessica DuVerneay (9)

Happy, Healthy, High-performing Teams
Happy, Healthy, High-performing TeamsHappy, Healthy, High-performing Teams
Happy, Healthy, High-performing Teams
 
UX101: Strategy, Structure, & Experience
UX101: Strategy, Structure, & Experience UX101: Strategy, Structure, & Experience
UX101: Strategy, Structure, & Experience
 
Taming Your Services Taxonomy: Strategic IA for Great UX
Taming Your Services Taxonomy: Strategic IA for Great UXTaming Your Services Taxonomy: Strategic IA for Great UX
Taming Your Services Taxonomy: Strategic IA for Great UX
 
Information Architecture: The Strategic Structure of Great UX - WIAD 2017
Information Architecture: The Strategic Structure of Great UX - WIAD 2017Information Architecture: The Strategic Structure of Great UX - WIAD 2017
Information Architecture: The Strategic Structure of Great UX - WIAD 2017
 
Architecture & IA: Expanding the Metaphor - IA Summit 2016
Architecture & IA: Expanding the Metaphor - IA Summit 2016Architecture & IA: Expanding the Metaphor - IA Summit 2016
Architecture & IA: Expanding the Metaphor - IA Summit 2016
 
Architecture & IA: Expanding the Metaphor - WIAD 2016 - Milwaukee
Architecture & IA: Expanding the Metaphor - WIAD 2016 - MilwaukeeArchitecture & IA: Expanding the Metaphor - WIAD 2016 - Milwaukee
Architecture & IA: Expanding the Metaphor - WIAD 2016 - Milwaukee
 
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)
Giant Low-Fidelity Analog Wireframes (IxDA GR - June 2015)
 
IA Lessons Learned - 2013
IA Lessons Learned - 2013IA Lessons Learned - 2013
IA Lessons Learned - 2013
 
Taming Taxonomy: A Practical Intro
Taming Taxonomy: A Practical IntroTaming Taxonomy: A Practical Intro
Taming Taxonomy: A Practical Intro
 

Kürzlich hochgeladen

KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 

Kürzlich hochgeladen (20)

KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 

Lean User Testing Intro

  • 1. Jessica DuVerneay Information Architect, The Understanding Group - @undrstndng LEAN USER TESTING
  • 2. AGENDA ‣ 6:30 - Agenda & Intro ‣ 6:40 - User Testing Basics ‣ 6:50 - Benefits & Limitations ‣ 7:00 - The Lean Approach ‣ 7:10 - When to Test ‣ 7:20 - What to Test ‣ 7:30 - Case Study ‣ 7:40 - Resources & Next Steps ‣ 7:50 - Q&A 2
  • 3. INTRODUCTION ‣ Clients: Herman Miller, Thompson Reuters / Techstreet, Macy’s, Metro Health System, University of Michigan, ASAPS, Cooper Tire ‣ Talks: Taxonomy - WIAD 2013, LAUX Meetup ‣ Workshops: IA/UX Topics including Wireframes, Performance Continuums, User Testing ‣ Articles: Expert Contributor for UserTesting.com’s blog, TUG’s site ‣ Global Producer - World Information Architecture Day (2012) JESSICA DUVERNEAY - INFORMATION ARCHITECT, THE UNDERSTANDING GROUP (TUG) 3
  • 5. LEAN USER TESTING USER TESTING BASICS 5
  • 6. USER TESTING BASICS USER TESTING ‣ Wikipedia says: “Usability testing is a technique used in user-centered interaction design to evaluate a product by testing it on users. This can be seen as an irreplaceable usability practice, since it gives direct input on how real users use the system.[1] This is in contrast with usability inspection methods where experts use different methods to evaluate a user interface without involving users. Usability testing focuses on measuring a human- made product's capacity to meet its intended purpose. Examples of products that commonly benefit from usability testing are foods, consumer products, web sites or web applications, computer interfaces, documents, and devices. Usability testing measures the usability, or ease of use, of a specific object or set of objects.” ‣ It is NOT: A complete set of User Research Activities, Market Research, Statistically Relevant Research, A/B Testing, Qualitative Formal Research 6 PRO TIP: Remember, User Testing is not actually testing the users - it’s testing the product from the user’s actual perspective.
  • 7. USER TESTING BASICS 7 Activities Deliverables SME Interviews Digital Report Card Experience Map Score Notes Owned Paid Social Mobile Access Search B A C B C B ScenarioScenarioScenario Alignment Session Heuristic Analysis Cross Channel Map Pagename PHASE 1 PHASE 2 PHASE 3 Channel Channel Channel Tactics by Channel Content Audit Flow Diagrams User Interviews Scenario Collab Design Competitive Site Map You ThemThemFeatures Them Impressions 1 2.1 2.2 4.1 4.2 4.3 3.1 2 3 4 User Co-Creation Personas Wireframes Persona Scenarios 2.0 Page Name Strategic Brief Content Inventory Concept Testing Stakeholder Needs Best Practices User Needs b a c d 2.0 Page Name Functional Spec. Analytic Report Workshops Recommendations 1.0 1.1 1.2 2.0 3.0 User Testing Roadmap Analytic Wishlist 1 2 3 Phased Roadmap 2 1 3 4 We wish we knew...
  • 8. USER TESTING BASICS 8 The Elements of User Experience A basic duality: The Web was originally conceived as a hypertextual information space; but the development of increasingly sophisticated front- and back-end technologies has fostered its use as a remote software interface. This dual nature has led to much confusion, as user experience practitioners have attempted to adapt their terminology to cases beyond the scope of its original application. The goal of this document is to define some of these terms within their appropriate contexts, and to clarify the underlying relationships among these various elements. Jesse James Garrett jjg@jjg.net Visual Design: graphic treatment of interface elements (the "look" in "look-and-feel") Information Architecture: structural design of the information space to facilitate intuitive access to content Interaction Design: development of application flows to facilitate user tasks, defining how the user interacts with site functionality Navigation Design: design of interface elements to facilitate the user's movement through the information architecture Information Design: in the Tuftean sense: designing the presentation of information to facilitate understanding Functional Specifications: "feature set": detailed descriptions of functionality the site must include in order to meet user needs User Needs: externally derived goals for the site; identified through user research, ethno/techno/psychographics, etc. Site Objectives: business, creative, or other internally derived goals for the site Content Requirements: definition of content elements required in the site in order to meet user needs Interface Design: as in traditional HCI: design of interface elements to facilitate user interaction with functionality Information Design: in the Tuftean sense: designing the presentation of information to facilitate understanding Web as software interface Web as hypertext system Visual Design: visual treatment of text, graphic page elements and navigational components Concrete Abstract time Conception Completion Functional Specifications Content Requirements Interaction Design Information Architecture Visual Design Information Design Interface Design Navigation Design Site Objectives User Needs User Needs: externally derived goals for the site; identified through user research, ethno/techno/psychographics, etc. Site Objectives: business, creative, or other internally derived goals for the site This picture is incomplete: The model outlined here does not account for secondary considerations (such as those arising during technical or content development) that may influence decisions during user experience development. Also, this model does not describe a development process, nor does it define roles within a user experience development team. Rather, it seeks to define the key considerations that go into the development of user experience on the Web today. task-oriented information-oriented 30 March 2000 © 2000 Jesse James Garrett http://www.jjg.net/ia/
  • 9. USER TESTING BASICS MODERATED / SYNCHRONOUS TESTING (ONSITE & REMOTE) 9 User Moderator
  • 10. USER TESTING BASICS UNMODERATED / ASYNCHRONOUS / AUTOMATED TESTING 10 User Moderator
  • 12. UNMODERATED BENEFITS & LIMITATIONS BENEFITS ‣ Inexpensive, Fast ‣ Can learn high level pain points, random fatal flaws, percentages of task completion, time on task, qualitative verbal opinions offered, basic analytics & demographic info.. more on that later. ‣ Easy to aggregate concrete numbers if needed in small or very large test populations ‣ “Quick and dirty” ‣ Can design to validate pretty much anything ‣ Existing tools = Easy to share across stakeholders ‣ Easy to test a pre-determined flow ‣ Great for iterative design, repeatable ‣ Anonymous comparative analysis & A/B testing ‣ Easy for one person to write, analyze and extract findings ‣ Do not need to set up testing lab ‣ No moderator bias / influence ‣ User in natural environment using preferred technologies & workflows ‣ Asynchronous allows for User Testing to be fit in with other work responsibilities ‣ Non-local / Global Reach much easier than moderated testing 12
  • 13. UNMODERATED BENEFITS & LIMITATIONS LIMITATIONS ‣ Not as empathy driven, less intuitive ‣ Can’t learn deep opinions or user motivations, non-verbal cues, users values & personality, organic / natural use case, deep analytics, detailed statistics, eye mapping ‣ Not able to correct user ‣ Can not restate or correct poorly written test on the fly ‣ Not able to dig in / probe for subjective issues or edge cases ‣ Less non-verbal inference (eye tracking, facial expressions, etc) ‣ Depending on recruits can be biased very heavily ‣ Easy to misinterpret by external stakeholders ‣ Somewhat complicated to analyze by multiple team members ‣ Does not build relationship with customer ‣ Does not completely assure confidentiality or an NDA 13
  • 14. LEAN USER TESTING THE LEAN APPROACH 14
  • 15. THE LEAN APPROACH THE ‘MVP’ OF USER TESTING: FIT & FINISH TESTING If you test nothing else, please test key product segments & flows for fatal flaws & show stoppers before you launch. Common UX & IA Performance Metrics to consider: ‣ Task Success (Binary Approach for Lean Process) ‣ Time On Task ‣ Errors ‣ Efficiency (Effort / Number of Steps) ‣ Learnability ‣ Perceived Severity of Identified Issues 15 OVERHEARD: “Friends don’t let friends launch without user testing.” True story.
  • 16. THE LEAN APPROACH HOW MANY USERS SHOULD WE TEST? 16 Image: Jakob Nielsen Group Roughly, 5-6 users will uncover a vast majority of the issues per scenario, task, or flow. The exact number of tests depends on the number of scenarios and demographic segments you need to test.
  • 17. THE LEAN APPROACH 17 WHAT TOOLS SHOULD WE USE?
  • 19. THE LEAN APPROACH HOW TO TEST ‘LEAN’: OTHER CONSIDERATIONS ‣ Create a Testing Team (1-4 people) ‣ Create a Testing Plan (Strategy, Budget, Timeline) ‣ Know the Tools Available ‣ Write Effective Tests ‣ Be Cautious About Recruiting & Incentives ‣ Analyze Data Effectively ‣ Present Your Findings (If Needed) Strategically & Clearly ‣ Iterate, Repeat, and Improve 19 PRO TIP: A poorly created & implemented test can be worse than useless. Take time to educate yourself & plan the test.
  • 21. WHEN TO TEST TYPICAL PROJECT LIFECYCLE Discovery: Understanding organizational and business goals for the product or service. This is generally when the “What & Why” of a product is determined. User Research: Understanding end user needs and expectations for the same product or service. While the Discovery Phase established the “What & Why”, this phase is to establish the “Who & Why” Strategy & Structural Design: Creating a solid strategy & structure for the product or product improvements. This phase is when the “What, Why & Who” are translated into the strategic and researched “How”. Launch & Assessment: Building and launching the product, measuring and evaluating success. This is the continuous improvement phase when efficacy of strategic changes or initial product launches can be measured, and organizations can begin gathering ideas and creating roadmaps for further improvements or product releases. 21
  • 22. WHEN TO TEST LAUNCH & ASSESSMENT ‣ Validate visual fit & finish just prior to launch as a lightweight QA process ‣ Validate improvement over previous product iterations ‣ Augment quantitative A/B testing to investigate user preference from a qualitative perspective ‣ Identify unnoticed usability issues or awkward product flows ‣ Show instances of a product in multiple environments (Desktop vs. Mobile) ‣ Provide an area for users to provide opinions, suggestions, and desired features lists (especially valuable in the startup space) 22
  • 23. WHEN TO TEST DISCOVERY ‣ Establish successful existing user flows that should be protected during upcoming versions ‣ Identify show stopping usability issues that may have been missed in initial product road mapping activities ‣ Benchmark your existing product so that at the end of your project lifecycle, you have data against which to compare your improved product. ‣ Provide insight into the competitive landscape 23
  • 24. WHEN TO TEST USER RESEARCH ‣ Provide a quick and easy way to see a product in front of multiple user types. ‣ Provide qualitative and quantitative data to flesh out user research deliverables such as personas (scenarios, tasks, demographic info, opinions & motivators). ‣ NOTE: Contrary to popular perception, this is actually the least effective phase to do user testing. User Research, when done correctly, is far more based on getting to know the user and their needs, and less on how they would use the existing product or service. 24
  • 25. WHEN TO TEST STRATEGY & STRUCTURAL DESIGN ‣ Point out key issues with Strategic or Structural Design Direction prior to build using prototypes or sandbox environments ‣ Test and refine complex user flows ‣ Test and refine navigation structures (TreeJack is a great tool for this) ‣ Identify unanticipated usability issues that may come up after strategy and structure is approved, during design and dev phases 25
  • 26. WHEN TO TEST MAIN POINT 26 No matter where you are in your product cycle, it is advantageous to consider lean unmoderated testing. Unmoderated testing is not just for usability only - testing can add a different value and data set at each stage of the project lifecycle. PRO TIP: Test early, test often.
  • 28. WHAT TO TEST 1. UX / IA / USABILITY ISSUES What constitutes success for one product may not necessarily be indicative of optimal state for another product. Qualitative data is valuable, but do not ignore the insights extracted from qualitative information (opinions, ratings, exclamations, and comments) - they can guide some of the most effective product changes.  28 There are some basic measurable indicators to consider while usability testing. (Note: The indicators listed below heavily reference Measuring the User Experience by Tullis and Alberts) ‣ Task Completion: Can a user complete the task? To what percentage can they move in the correct way in the task completion funnel? What issues are impeding the completion of the task? Do users want to complete the task in the first place? ‣ Time On Task: How long does it take the user to complete the task? Does the time it takes to complete the task allow the user to lose interest or focus? Does the task take too little time to complete? ‣ Errors: Did users make avoidable errors? Did users make unavoidable errors? Were they able to recover from the errors? What would make the errors less likely to occur or easier to recover from? ‣ Efficiency: Was the system efficient in effort and number of steps it took for users to complete a task? Which steps were superfluous or confusing? Which steps can be streamlined or eliminated? Which steps need to be added? ‣ Learnability: For repeat visitors, is the system learnable? Does task success and perceived efficiency increase? Does time on task and  number of errors decrease? Do certain key actions and flows become tacit? ‣ Perceived Severity of Identified Issues: Are any of the issues noticed by the testing team not actually registered as issues to the users? Which issues are most important to achievement of key business flows? Are any of the issues deal breakers?
  • 29. WHAT TO TEST 2. COMPETITIVE TESTING A lesser known benefits of lean unmoderated testing is the ability to show a test subject a competitor’s product without the risk of moderator bias. Learning from a competitor – which flows, content, and design patterns are successful and which should be avoided – can be particularly useful in the startup space where lean UX teams may have to make s product decisions on limited research.  QUESTIONS TO CONSIDER: ‣ Which product do users prefer? Why? ‣ Which product was easier to use? Why? ‣ What are some errors my competitor made that I can avoid during product development? ‣ What are some successful features that my competitor has that I might want to consider for product roadmapping? ‣ How do users of different demographics (Age, Gender, OS, income, etc) respond to each product? Is one better for my target market?  29
  • 30. WHAT TO TEST 3. PREFERENCE Preference testing may provide direct user insights around: ‣ Visual design & Branding ‣ Interaction design ‣ Copy ‣ Navigation approaches ‣ Use of imagery ‣ Page layout and information hierarchy ‣ Any other contentious issues at your organization that are delaying launch.   30 PRO TIP: Don’t mistake this for A/B testing. While lean user preference testing can give insight, it’s not statistically significant.
  • 31. WHAT TO TEST 4. VALIDATION OF FIT & FINISH ‣ One to four main user flows (keep this as simple as possible) ‣ The main conversion point of the system ‣ Overall opinions of the visual design and interaction design ‣ Any crucial UX / IA issues as previously described 31
  • 32. WHAT TO TEST 5. OTHER USES: COPYWRITING VALIDATION, LIGHTWEIGHT MULTI PLATFORM QA, PERSONA INFO ‣ Personas: I’ve augmented other user research activities with data I’ve collected from unmoderated testing to flesh out personas as needed. ‣ QA Testing: I’ve seen unmoderated user testing implemented as a lightweight QA process – running the same test on a product in multiple desktop and mobile environments can provide invaluable insights for a small team with limited QA/ UAT capabilities. ‣ Copywriting & Language: Testing copywriting or taxonomies to some extent can be done in unmoderated testing. Again, the success of these inquiries will depend largely on the tools used & the manner in which the tests and scenarios are crafted.  32
  • 33. WHAT TO TEST MAIN POINT: THE RIGHT TEST AT THE RIGHT TIME 33
  • 34. LEAN USER TESTING A CASE STUDY 34
  • 35. SUMMARY OF ISSUES KEY QUESTIONS CASE STUDY How can we optimize our eCommerce flow to mitigate these issues? What can we learn from Lean User Testing and how can we add it into our design cycle? Well known e-commerce client facing: • Navigation Issues • Cart Abandonment • Small Average Order Size (# of Products per Conversion) • Cross Channel Confusion of Digital Properties (Information Site vs. Store) • Browse Customers = Lower Conversion On Site • Brand Perception Suboptimal Online vs. Physical World Product Interaction WELL KNOWN FURNITURE COMPANY 35
  • 36. CASE STUDY SUMMARY: UNMODERATED USABILITY RESEARCH APPROACH 36 PRO TIP: In hindsight, I should have tested the proposed navigation with Treejack during the Structural Design Phase.
  • 37. CASE STUDY DISCOVERY: HIGH LEVEL USABILITY RESEARCH & COMPETITIVE INSIGHT ‣ Why (Goal) 1: Identify “low hanging fruit” issues and areas for deeper research ‣ Why (Goal) 2: Competitive Analysis ‣ Who: 18 Users, 3 Tests, 1 focused on competitor ‣ When: 3 weeks quick testing ‣ How: Unmoderated User Testing, UserTesting.com Recruits ‣ Resulted in 20 Quick Fixes and ~5 areas for significant focused future research, structural design ideas from competitive research 37
  • 38. CASE STUDY USER RESEARCH: SPECIFIC FEATURE & PAGE USABILITY RESEARCH Lightweight Approach: • 12 users, 2 Tests, Captured through Ethn.io Screener • Incentive = $75 AMEX Gift Card • Done in conjunction with Moderated Tests, Existing Personas, and Analytics Work Multiple Hypotheses Tested Flows & Features: • Cart Abandonment Motivation • Wishlist Use • Listing Page Efficacy • Feature Value to User • Check Out Flow • Also Gathered Qualitative User Opinions Time = ~1 month • 1 week to plan • 1 week to implement • 1 week to Analyze 38
  • 39. CASE STUDY RECOMMENDATIONS & OUTCOMES ‣ Multiple UX “Quick Fixes” were launched during the longer project life cycle ‣ Improved Navigation, Checkout Flow, Product Detail Page, Strategic Use of Visual Assets ‣ Road map of features & functionality (Faceted Search Results, Improved Integration of Multiple Sites) ‣ The Preliminary Numbers: - 16% Increase in order volume - Organic Traffic increased by 53% (due to improved SEO performance due to navigation changes) - 84% increase in page views, 28% decline in bounce rate from landing pages 39
  • 40. CASE STUDY UNMODERATED USABILITY RESEARCH HELPED ‣ Provide Insight into User Behaviors & Expectations ‣ Ensure a Pervasive Customer Focus through Design Cycles ‣ Identify Initial Problem Set ‣ Point out easily implemented immediate “Quick Fixes” ‣ Narrow & Focus Future Research and Development Efforts ‣ Craft a Strategic User Research Phase ‣ Guide Successful Site Changes ‣ Establish IA / UX Road Mapping & Priority for Next Project Iterations ‣ ... All on relatively lean time & money budgets 40
  • 43. RESOURCES 43 ‣ When to Test: Incorporating User Testing Into Product Design ‣ Lessons From an Expert: What to Test ‣ How to Test: 9 Steps for Creating the Perfect User Test USERTESTING.COM BLOG
  • 45. NEXT STEPS 45 PRO TIP: 5 Free Test Credits for participants in this class - use the code NO CODE AVAILABLE at usertesting.com for 5 free tests TRY IT OUT
  • 46. NEXT STEPS 46 • can do it for you • can train you to do it yourselves • can do it with you SHAMELESS SELF PROMOTION
  • 47. Q&A LEAN USER TESTING 47 Jessica DuVerneay - Information Architect The Understanding Group (TUG) http://www.understandinggroup.com Twitter: @undrstndng THANK YOU!