SlideShare a Scribd company logo
1 of 39
Will Evans
 @semanticwill

 Yana Kuchirko
@mslogophiliac
“When usability is inherent in the
 products we use, it’s invisible.
                    We don’t think about it. But we
                    know it’s there.”




                         Will Evans | Manager, User Experience Design   2
Defining Usability:




                      - International Organization of Standardization




                             Will Evans | Manager, User Experience Design   3
Critical Elements
Specific Context:



 Specific Users:

 Specific Goals:




                    Will Evans | Manager, User Experience Design   4
The 5 E’s of Usability
     Effective:



      Efficient:

    Engaging:



Error Tolerant:


Easy to Learn:



                   Will Evans | Manager, User Experience Design   5
Will Evans | Manager, User Experience Design   6
Evaluation of Product




                 Will Evans | Manager, User Experience Design   7
Will Evans | Manager, User Experience Design   8
Types of Usability Testing
    Formative




   Summative




                  Will Evans | Manager, User Experience Design   9
#AgileUX Process at TheLadders




                Will Evans | Manager, User Experience Design   10
Will Evans | Manager, User Experience Design   11
Establish Test Goals




                  Will Evans | Manager, User Experience Design   12
Determine The Process of Testing
  What to test:

 Where to test:

  How to test:




                  Will Evans | Manager, User Experience Design   13
Define the “Core” Audience




                 Will Evans | Manager, User Experience Design   14
Developing “Personas”




                 Will Evans | Manager, User Experience Design   15
Sample Persona: ‘Todd’




                 Will Evans | Manager, User Experience Design   16
Recruit Participants




                  Will Evans | Manager, User Experience Design   17
Create “real” testing scenarios




                   Will Evans | Manager, User Experience Design   18
Determine type of feedback




                 Will Evans | Manager, User Experience Design   19
Creating Questionnaires




   • Allows people to rate overall experience




                         Will Evans | Manager, User Experience Design   20
Creating Questionnaires




                 Will Evans | Manager, User Experience Design   21
Prepare a test schedule




                  Will Evans | Manager, User Experience Design   22
Write a Test Plan




                    Will Evans | Manager, User Experience Design   23
“We are testing the product, not you.”




                         Will Evans | Manager, User Experience Design   24
Moderator’s Script




                 Will Evans | Manager, User Experience Design   25
Being an Effective Moderator




   • Open-ended, non-leading questions
     beginning with “what” or “how”
     (never “why”!)




                       Will Evans | Manager, User Experience Design   26
Think-aloud Process



   • Why the participant is taking an action
   • What they think about the process
   • What they expect to happen (matching
     user mental model to system model)




                        Will Evans | Manager, User Experience Design   27
Understanding Your User
   • Users are people with a goal which
     the product needs to support




   • People are in a hurry to reach their goal and they
     rarely read text until they come across content
     that matches their goal
                        Will Evans | Manager, User Experience Design   28
“We finished testing.
 Now what does it all mean?”




                       Will Evans | Manager, User Experience Design   29
What Did We See?




               Will Evans | Manager, User Experience Design   30
What Does It Mean?




                Will Evans | Manager, User Experience Design   31
Triangulation Analysis




                 Will Evans | Manager, User Experience Design   32
What Should We Do About It?




                Will Evans | Manager, User Experience Design   33
Types of Severity Scales




                  Will Evans | Manager, User Experience Design   34
Making Recommendations




               Will Evans | Manager, User Experience Design   35
Framing Findings: Key Considerations




   • Will audience already believe changes
     are needed or must you convince them?




                       Will Evans | Manager, User Experience Design   36
Writing a Report




03/18/12           Will Evans | Manager, User Experience Design   37
Sample Report
Thanks!




Will Evans is Manager, Experience Design for TheLadders in New York City
with 15 years industry experience in interaction design, information
architecture, and user experience strategy. His experiences include
directing UX for social network analytics and terrorism risk modeling at
AIR Worldwide, UX Architect for Gather.com, and UX Architect for travel
search engine Kayak.com. He worked at Lotus/IBM where he was the
senior information architect, and for Curl – a DARPA-funded MIT project
when he was at the MIT Laboratory for Computer Science.

His passions include design and critical theory, postmodernism,
information visualization, psychology, neuroscience, and wine. He lives in
New York, NY, drinks far too much coffee, wears only black, and was
Design Co-Chair for the IxDA Interaction10 conference in Savannah,
Georgia in February, 2010. He also served on the board of directors of the
Information Architecture Institute leading marketing and events.

More Related Content

What's hot

UI/UX Workshop - Hackvision
UI/UX Workshop - HackvisionUI/UX Workshop - Hackvision
UI/UX Workshop - HackvisionProttay Karim
 
Ux design process in product development
Ux design process in product developmentUx design process in product development
Ux design process in product developmentT-Design Center
 
UX STRAT Online 2020: Victoria Sosik, Verizon
UX STRAT Online 2020: Victoria Sosik, VerizonUX STRAT Online 2020: Victoria Sosik, Verizon
UX STRAT Online 2020: Victoria Sosik, VerizonUX STRAT
 
UI vs UX workshop
UI vs UX workshopUI vs UX workshop
UI vs UX workshopInova LLC
 
UX Research within an Agile Design and Development Sprint Cycle
UX Research within an Agile Design and Development Sprint CycleUX Research within an Agile Design and Development Sprint Cycle
UX Research within an Agile Design and Development Sprint CycleUXPA International
 
UX lesson 3: Usability First
UX lesson 3: Usability FirstUX lesson 3: Usability First
UX lesson 3: Usability FirstJoan Lumanauw
 
Mini UX Workshop: Creating Persona & Scenario
Mini UX Workshop: Creating Persona & ScenarioMini UX Workshop: Creating Persona & Scenario
Mini UX Workshop: Creating Persona & ScenarioNatt Phenjati
 
Introduction to Information Architecture & Design - 2/14/15
Introduction to Information Architecture & Design - 2/14/15Introduction to Information Architecture & Design - 2/14/15
Introduction to Information Architecture & Design - 2/14/15Robert Stribley
 
Portfolios Matter: Building the Portfolio to Win the Job
Portfolios Matter: Building the Portfolio to Win the JobPortfolios Matter: Building the Portfolio to Win the Job
Portfolios Matter: Building the Portfolio to Win the JobLynn Teo
 
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...UXPA International
 
Career Paths of User Experience
Career Paths of User ExperienceCareer Paths of User Experience
Career Paths of User ExperiencePatrick Neeman
 
Introduction to User Experience Design
Introduction to User Experience DesignIntroduction to User Experience Design
Introduction to User Experience DesignKiera McMaster
 
Guerilla Usability Testing
Guerilla Usability TestingGuerilla Usability Testing
Guerilla Usability TestingAndy Budd
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User ResearchJeremy Horn
 
UX Design + UI Design: Injecting a brand persona!
UX Design + UI Design: Injecting a brand persona!UX Design + UI Design: Injecting a brand persona!
UX Design + UI Design: Injecting a brand persona!Jayan Narayanan
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Domain7
 
UX Design process, #UX, #Design Process, #Agile UX
UX Design process, #UX, #Design Process, #Agile UX UX Design process, #UX, #Design Process, #Agile UX
UX Design process, #UX, #Design Process, #Agile UX Murali Krishna
 
UX Porfolio | Mircea Anton
UX Porfolio | Mircea AntonUX Porfolio | Mircea Anton
UX Porfolio | Mircea AntonMircea Anton
 

What's hot (20)

UX Roles and Job Titles
UX Roles and Job TitlesUX Roles and Job Titles
UX Roles and Job Titles
 
UI/UX Workshop - Hackvision
UI/UX Workshop - HackvisionUI/UX Workshop - Hackvision
UI/UX Workshop - Hackvision
 
Ux design process in product development
Ux design process in product developmentUx design process in product development
Ux design process in product development
 
UX STRAT Online 2020: Victoria Sosik, Verizon
UX STRAT Online 2020: Victoria Sosik, VerizonUX STRAT Online 2020: Victoria Sosik, Verizon
UX STRAT Online 2020: Victoria Sosik, Verizon
 
UI vs UX workshop
UI vs UX workshopUI vs UX workshop
UI vs UX workshop
 
UX Research within an Agile Design and Development Sprint Cycle
UX Research within an Agile Design and Development Sprint CycleUX Research within an Agile Design and Development Sprint Cycle
UX Research within an Agile Design and Development Sprint Cycle
 
UX lesson 3: Usability First
UX lesson 3: Usability FirstUX lesson 3: Usability First
UX lesson 3: Usability First
 
Mini UX Workshop: Creating Persona & Scenario
Mini UX Workshop: Creating Persona & ScenarioMini UX Workshop: Creating Persona & Scenario
Mini UX Workshop: Creating Persona & Scenario
 
Introduction to Information Architecture & Design - 2/14/15
Introduction to Information Architecture & Design - 2/14/15Introduction to Information Architecture & Design - 2/14/15
Introduction to Information Architecture & Design - 2/14/15
 
Portfolios Matter: Building the Portfolio to Win the Job
Portfolios Matter: Building the Portfolio to Win the JobPortfolios Matter: Building the Portfolio to Win the Job
Portfolios Matter: Building the Portfolio to Win the Job
 
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
The Note-Taker’s Perspective During Usability Testing: Recognizing What’s Imp...
 
Career Paths of User Experience
Career Paths of User ExperienceCareer Paths of User Experience
Career Paths of User Experience
 
Introduction to User Experience Design
Introduction to User Experience DesignIntroduction to User Experience Design
Introduction to User Experience Design
 
Guerilla Usability Testing
Guerilla Usability TestingGuerilla Usability Testing
Guerilla Usability Testing
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User Research
 
UX Design + UI Design: Injecting a brand persona!
UX Design + UI Design: Injecting a brand persona!UX Design + UI Design: Injecting a brand persona!
UX Design + UI Design: Injecting a brand persona!
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?
 
Ux is not UI
Ux is not UIUx is not UI
Ux is not UI
 
UX Design process, #UX, #Design Process, #Agile UX
UX Design process, #UX, #Design Process, #Agile UX UX Design process, #UX, #Design Process, #Agile UX
UX Design process, #UX, #Design Process, #Agile UX
 
UX Porfolio | Mircea Anton
UX Porfolio | Mircea AntonUX Porfolio | Mircea Anton
UX Porfolio | Mircea Anton
 

Viewers also liked

LeanUX is a Useful F*&king Lie
LeanUX is a Useful F*&king LieLeanUX is a Useful F*&king Lie
LeanUX is a Useful F*&king LieWilliam Evans
 
Intro to guerilla usability testing
Intro to guerilla usability testingIntro to guerilla usability testing
Intro to guerilla usability testingRebecca Destello
 
Como fazer testes de usabilidade
Como fazer testes de usabilidadeComo fazer testes de usabilidade
Como fazer testes de usabilidadeUTFPR
 
Introducción a la comunicación proyecto final
Introducción a la comunicación   proyecto finalIntroducción a la comunicación   proyecto final
Introducción a la comunicación proyecto finalyadyzu30
 
이산치보고서
이산치보고서이산치보고서
이산치보고서mil23
 
Leveraging Social Media - CVCC 03-09-2012
Leveraging Social Media - CVCC 03-09-2012Leveraging Social Media - CVCC 03-09-2012
Leveraging Social Media - CVCC 03-09-2012Lee Yount
 
The story will always be the only constant!
The story will always be the only constant!The story will always be the only constant!
The story will always be the only constant!archana jhangiani
 
CustomerSpeak-Template(EAM-Event-15JAN2014)
CustomerSpeak-Template(EAM-Event-15JAN2014)CustomerSpeak-Template(EAM-Event-15JAN2014)
CustomerSpeak-Template(EAM-Event-15JAN2014)Ashraful Islam
 
Czy warto inwestować w obsługę klienta
Czy warto inwestować w obsługę klientaCzy warto inwestować w obsługę klienta
Czy warto inwestować w obsługę klientaPiotr Merkel
 
Приглашаем для участия в проекте!
Приглашаем для участия в проекте!Приглашаем для участия в проекте!
Приглашаем для участия в проекте!Pasha Andronatiy
 
Winners of Weather Photographer of the Year 2016 Competition
 Winners of Weather Photographer of the Year 2016 Competition Winners of Weather Photographer of the Year 2016 Competition
Winners of Weather Photographer of the Year 2016 Competitionmaditabalnco
 
정통2 테블릿pc
정통2 테블릿pc정통2 테블릿pc
정통2 테블릿pc인수 김
 
Using social media for business development
Using social media for business developmentUsing social media for business development
Using social media for business developmentPaul Furiga
 

Viewers also liked (19)

LeanUX is a Useful F*&king Lie
LeanUX is a Useful F*&king LieLeanUX is a Useful F*&king Lie
LeanUX is a Useful F*&king Lie
 
Intro to guerilla usability testing
Intro to guerilla usability testingIntro to guerilla usability testing
Intro to guerilla usability testing
 
Como fazer testes de usabilidade
Como fazer testes de usabilidadeComo fazer testes de usabilidade
Como fazer testes de usabilidade
 
Introducción a la comunicación proyecto final
Introducción a la comunicación   proyecto finalIntroducción a la comunicación   proyecto final
Introducción a la comunicación proyecto final
 
이산치보고서
이산치보고서이산치보고서
이산치보고서
 
White foods
White foodsWhite foods
White foods
 
Leveraging Social Media - CVCC 03-09-2012
Leveraging Social Media - CVCC 03-09-2012Leveraging Social Media - CVCC 03-09-2012
Leveraging Social Media - CVCC 03-09-2012
 
The story will always be the only constant!
The story will always be the only constant!The story will always be the only constant!
The story will always be the only constant!
 
krapeejan
krapeejankrapeejan
krapeejan
 
Blue foods
Blue foodsBlue foods
Blue foods
 
CustomerSpeak-Template(EAM-Event-15JAN2014)
CustomerSpeak-Template(EAM-Event-15JAN2014)CustomerSpeak-Template(EAM-Event-15JAN2014)
CustomerSpeak-Template(EAM-Event-15JAN2014)
 
1 - Copy
1 - Copy1 - Copy
1 - Copy
 
Sinonimos
SinonimosSinonimos
Sinonimos
 
Czy warto inwestować w obsługę klienta
Czy warto inwestować w obsługę klientaCzy warto inwestować w obsługę klienta
Czy warto inwestować w obsługę klienta
 
Приглашаем для участия в проекте!
Приглашаем для участия в проекте!Приглашаем для участия в проекте!
Приглашаем для участия в проекте!
 
Country Club Indore – Fitness Centre
Country Club Indore – Fitness CentreCountry Club Indore – Fitness Centre
Country Club Indore – Fitness Centre
 
Winners of Weather Photographer of the Year 2016 Competition
 Winners of Weather Photographer of the Year 2016 Competition Winners of Weather Photographer of the Year 2016 Competition
Winners of Weather Photographer of the Year 2016 Competition
 
정통2 테블릿pc
정통2 테블릿pc정통2 테블릿pc
정통2 테블릿pc
 
Using social media for business development
Using social media for business developmentUsing social media for business development
Using social media for business development
 

Similar to Everybody Lies: Rapid Cadence Research & Usability Testing

Usability Testing
Usability TestingUsability Testing
Usability TestingJan Moons
 
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...ux singapore
 
User Experience Design - Why & How to
User Experience Design - Why & How toUser Experience Design - Why & How to
User Experience Design - Why & How tominhdo
 
Designer vs Developer
Designer vs DeveloperDesigner vs Developer
Designer vs DeveloperBryan Gulley
 
UX & Design Thinking for BI Applications
UX & Design Thinking for BI ApplicationsUX & Design Thinking for BI Applications
UX & Design Thinking for BI Applicationsibi
 
Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
Designing Intuitive SharePoint Sites: The Science of "Easy to Use" Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
Designing Intuitive SharePoint Sites: The Science of "Easy to Use" Marcy Kellar
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an OverviewJulie Grundy
 
"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked
"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked
"So UX Designers Just Make Things Pretty, Right?" and Other Myths DebunkedKaitlan Chu
 
UXD @ Univision Digital
UXD @ Univision DigitalUXD @ Univision Digital
UXD @ Univision DigitalUnivision UXD
 
Scaling UX in a maturing organisation
Scaling UX in a maturing organisationScaling UX in a maturing organisation
Scaling UX in a maturing organisationLinus Lennstrand
 
User Experience Design Fundamentals - Part 1: Users & Goals
User Experience Design Fundamentals - Part 1: Users & GoalsUser Experience Design Fundamentals - Part 1: Users & Goals
User Experience Design Fundamentals - Part 1: Users & GoalsLaura B
 
The marriage of people and technology - Jon Winter, Worthers Media Solutions
The marriage of people and technology - Jon Winter, Worthers Media Solutions The marriage of people and technology - Jon Winter, Worthers Media Solutions
The marriage of people and technology - Jon Winter, Worthers Media Solutions Internet World
 
Lessons from Material Design on cross-channel digital experiences - DroidCon ...
Lessons from Material Design on cross-channel digital experiences - DroidCon ...Lessons from Material Design on cross-channel digital experiences - DroidCon ...
Lessons from Material Design on cross-channel digital experiences - DroidCon ...Julie Blitzer
 
Informed & Agile: Test Driven Design w/ Jon Innes
Informed & Agile: Test Driven Design w/ Jon InnesInformed & Agile: Test Driven Design w/ Jon Innes
Informed & Agile: Test Driven Design w/ Jon InnesUserZoom
 
Usability & Agile Development
Usability & Agile DevelopmentUsability & Agile Development
Usability & Agile Developmentbinuvt
 
Product design - a designer's perspective
Product design - a designer's perspectiveProduct design - a designer's perspective
Product design - a designer's perspectivetianfei00
 
Usability Testing Fundamentals
Usability Testing FundamentalsUsability Testing Fundamentals
Usability Testing Fundamentalsdebcook
 
Usability Testing Fundamentals
Usability Testing FundamentalsUsability Testing Fundamentals
Usability Testing Fundamentalsdebcook
 

Similar to Everybody Lies: Rapid Cadence Research & Usability Testing (20)

Usability Testing
Usability TestingUsability Testing
Usability Testing
 
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
 
User Experience Design - Why & How to
User Experience Design - Why & How toUser Experience Design - Why & How to
User Experience Design - Why & How to
 
Designer vs Developer
Designer vs DeveloperDesigner vs Developer
Designer vs Developer
 
UX & Design Thinking for BI Applications
UX & Design Thinking for BI ApplicationsUX & Design Thinking for BI Applications
UX & Design Thinking for BI Applications
 
Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
Designing Intuitive SharePoint Sites: The Science of "Easy to Use" Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
 
Fundamentals of UX Design
Fundamentals of UX DesignFundamentals of UX Design
Fundamentals of UX Design
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
 
What ux is
What ux isWhat ux is
What ux is
 
"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked
"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked
"So UX Designers Just Make Things Pretty, Right?" and Other Myths Debunked
 
UXD @ Univision Digital
UXD @ Univision DigitalUXD @ Univision Digital
UXD @ Univision Digital
 
Scaling UX in a maturing organisation
Scaling UX in a maturing organisationScaling UX in a maturing organisation
Scaling UX in a maturing organisation
 
User Experience Design Fundamentals - Part 1: Users & Goals
User Experience Design Fundamentals - Part 1: Users & GoalsUser Experience Design Fundamentals - Part 1: Users & Goals
User Experience Design Fundamentals - Part 1: Users & Goals
 
The marriage of people and technology - Jon Winter, Worthers Media Solutions
The marriage of people and technology - Jon Winter, Worthers Media Solutions The marriage of people and technology - Jon Winter, Worthers Media Solutions
The marriage of people and technology - Jon Winter, Worthers Media Solutions
 
Lessons from Material Design on cross-channel digital experiences - DroidCon ...
Lessons from Material Design on cross-channel digital experiences - DroidCon ...Lessons from Material Design on cross-channel digital experiences - DroidCon ...
Lessons from Material Design on cross-channel digital experiences - DroidCon ...
 
Informed & Agile: Test Driven Design w/ Jon Innes
Informed & Agile: Test Driven Design w/ Jon InnesInformed & Agile: Test Driven Design w/ Jon Innes
Informed & Agile: Test Driven Design w/ Jon Innes
 
Usability & Agile Development
Usability & Agile DevelopmentUsability & Agile Development
Usability & Agile Development
 
Product design - a designer's perspective
Product design - a designer's perspectiveProduct design - a designer's perspective
Product design - a designer's perspective
 
Usability Testing Fundamentals
Usability Testing FundamentalsUsability Testing Fundamentals
Usability Testing Fundamentals
 
Usability Testing Fundamentals
Usability Testing FundamentalsUsability Testing Fundamentals
Usability Testing Fundamentals
 

More from William Evans

Empowering Agile Self-Organized Teams With Design Thinking
Empowering Agile Self-Organized Teams With Design ThinkingEmpowering Agile Self-Organized Teams With Design Thinking
Empowering Agile Self-Organized Teams With Design ThinkingWilliam Evans
 
Facilitating Complexity: Methods & Mindsets for Exploration
Facilitating Complexity: Methods & Mindsets for Exploration Facilitating Complexity: Methods & Mindsets for Exploration
Facilitating Complexity: Methods & Mindsets for Exploration William Evans
 
Leading Organizational Design and Transformation
Leading Organizational Design and TransformationLeading Organizational Design and Transformation
Leading Organizational Design and TransformationWilliam Evans
 
On Context: Methods and Mindsets for Situational Awareness
On Context: Methods and Mindsets for Situational AwarenessOn Context: Methods and Mindsets for Situational Awareness
On Context: Methods and Mindsets for Situational AwarenessWilliam Evans
 
On Branding: Turning Emotion into Connection
On Branding: Turning Emotion into ConnectionOn Branding: Turning Emotion into Connection
On Branding: Turning Emotion into ConnectionWilliam Evans
 
Dispositioning Advantage: A Pervert's Guide to Strategy Design
Dispositioning Advantage: A Pervert's Guide to Strategy DesignDispositioning Advantage: A Pervert's Guide to Strategy Design
Dispositioning Advantage: A Pervert's Guide to Strategy DesignWilliam Evans
 
New Models of Purpose-Driven Exploration in Knowledge Work
New Models of Purpose-Driven Exploration in Knowledge WorkNew Models of Purpose-Driven Exploration in Knowledge Work
New Models of Purpose-Driven Exploration in Knowledge WorkWilliam Evans
 
Facilitating Complexity: A Pervert's Guide to Exploration
Facilitating Complexity: A Pervert's Guide to ExplorationFacilitating Complexity: A Pervert's Guide to Exploration
Facilitating Complexity: A Pervert's Guide to ExplorationWilliam Evans
 
LeanUX: Problem Framing Using the 4 Ws
LeanUX: Problem Framing Using the 4 WsLeanUX: Problem Framing Using the 4 Ws
LeanUX: Problem Framing Using the 4 WsWilliam Evans
 
Good Design is Honest: Cognitive Science to UX Design Principles
Good Design is Honest: Cognitive Science to UX Design PrinciplesGood Design is Honest: Cognitive Science to UX Design Principles
Good Design is Honest: Cognitive Science to UX Design PrinciplesWilliam Evans
 
ReDesigned to Disrupt
ReDesigned to DisruptReDesigned to Disrupt
ReDesigned to DisruptWilliam Evans
 
Introduction to Lean Startup & Lean User Experience Design
Introduction to Lean Startup & Lean User Experience Design Introduction to Lean Startup & Lean User Experience Design
Introduction to Lean Startup & Lean User Experience Design William Evans
 
Introduction to Kanban for Creative Agencies
Introduction to Kanban for Creative AgenciesIntroduction to Kanban for Creative Agencies
Introduction to Kanban for Creative AgenciesWilliam Evans
 
Design Ethnography for Lean Teams
Design Ethnography for Lean TeamsDesign Ethnography for Lean Teams
Design Ethnography for Lean TeamsWilliam Evans
 
Modeling Leadership for #LeanUXNYC
Modeling Leadership for #LeanUXNYCModeling Leadership for #LeanUXNYC
Modeling Leadership for #LeanUXNYCWilliam Evans
 
Introduction to UX Research: Conducting Focus Groups
Introduction to UX Research: Conducting Focus GroupsIntroduction to UX Research: Conducting Focus Groups
Introduction to UX Research: Conducting Focus GroupsWilliam Evans
 
Customer Research & Persona Development
Customer Research & Persona DevelopmentCustomer Research & Persona Development
Customer Research & Persona DevelopmentWilliam Evans
 
Concierge & Pitch MVP
Concierge & Pitch MVPConcierge & Pitch MVP
Concierge & Pitch MVPWilliam Evans
 

More from William Evans (20)

Empowering Agile Self-Organized Teams With Design Thinking
Empowering Agile Self-Organized Teams With Design ThinkingEmpowering Agile Self-Organized Teams With Design Thinking
Empowering Agile Self-Organized Teams With Design Thinking
 
Facilitating Complexity: Methods & Mindsets for Exploration
Facilitating Complexity: Methods & Mindsets for Exploration Facilitating Complexity: Methods & Mindsets for Exploration
Facilitating Complexity: Methods & Mindsets for Exploration
 
Leading Organizational Design and Transformation
Leading Organizational Design and TransformationLeading Organizational Design and Transformation
Leading Organizational Design and Transformation
 
On Context: Methods and Mindsets for Situational Awareness
On Context: Methods and Mindsets for Situational AwarenessOn Context: Methods and Mindsets for Situational Awareness
On Context: Methods and Mindsets for Situational Awareness
 
On Branding: Turning Emotion into Connection
On Branding: Turning Emotion into ConnectionOn Branding: Turning Emotion into Connection
On Branding: Turning Emotion into Connection
 
Dispositioning Advantage: A Pervert's Guide to Strategy Design
Dispositioning Advantage: A Pervert's Guide to Strategy DesignDispositioning Advantage: A Pervert's Guide to Strategy Design
Dispositioning Advantage: A Pervert's Guide to Strategy Design
 
New Models of Purpose-Driven Exploration in Knowledge Work
New Models of Purpose-Driven Exploration in Knowledge WorkNew Models of Purpose-Driven Exploration in Knowledge Work
New Models of Purpose-Driven Exploration in Knowledge Work
 
Facilitating Complexity: A Pervert's Guide to Exploration
Facilitating Complexity: A Pervert's Guide to ExplorationFacilitating Complexity: A Pervert's Guide to Exploration
Facilitating Complexity: A Pervert's Guide to Exploration
 
LeanUX: Problem Framing Using the 4 Ws
LeanUX: Problem Framing Using the 4 WsLeanUX: Problem Framing Using the 4 Ws
LeanUX: Problem Framing Using the 4 Ws
 
Good Design is Honest: Cognitive Science to UX Design Principles
Good Design is Honest: Cognitive Science to UX Design PrinciplesGood Design is Honest: Cognitive Science to UX Design Principles
Good Design is Honest: Cognitive Science to UX Design Principles
 
LeanUX14
LeanUX14LeanUX14
LeanUX14
 
ReDesigned to Disrupt
ReDesigned to DisruptReDesigned to Disrupt
ReDesigned to Disrupt
 
Introduction to Lean Startup & Lean User Experience Design
Introduction to Lean Startup & Lean User Experience Design Introduction to Lean Startup & Lean User Experience Design
Introduction to Lean Startup & Lean User Experience Design
 
Introduction to Kanban for Creative Agencies
Introduction to Kanban for Creative AgenciesIntroduction to Kanban for Creative Agencies
Introduction to Kanban for Creative Agencies
 
Design Ethnography for Lean Teams
Design Ethnography for Lean TeamsDesign Ethnography for Lean Teams
Design Ethnography for Lean Teams
 
Promiscuous pairing
Promiscuous pairingPromiscuous pairing
Promiscuous pairing
 
Modeling Leadership for #LeanUXNYC
Modeling Leadership for #LeanUXNYCModeling Leadership for #LeanUXNYC
Modeling Leadership for #LeanUXNYC
 
Introduction to UX Research: Conducting Focus Groups
Introduction to UX Research: Conducting Focus GroupsIntroduction to UX Research: Conducting Focus Groups
Introduction to UX Research: Conducting Focus Groups
 
Customer Research & Persona Development
Customer Research & Persona DevelopmentCustomer Research & Persona Development
Customer Research & Persona Development
 
Concierge & Pitch MVP
Concierge & Pitch MVPConcierge & Pitch MVP
Concierge & Pitch MVP
 

Recently uploaded

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate Agents
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate AgentsRyan Mahoney - Will Artificial Intelligence Replace Real Estate Agents
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate AgentsRyan Mahoney
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using DashVisualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dashnarutouzumaki53779
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 

Recently uploaded (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate Agents
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate AgentsRyan Mahoney - Will Artificial Intelligence Replace Real Estate Agents
Ryan Mahoney - Will Artificial Intelligence Replace Real Estate Agents
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using DashVisualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dash
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 

Everybody Lies: Rapid Cadence Research & Usability Testing

  • 1. Will Evans @semanticwill Yana Kuchirko @mslogophiliac
  • 2. “When usability is inherent in the products we use, it’s invisible. We don’t think about it. But we know it’s there.” Will Evans | Manager, User Experience Design 2
  • 3. Defining Usability: - International Organization of Standardization Will Evans | Manager, User Experience Design 3
  • 4. Critical Elements Specific Context: Specific Users: Specific Goals: Will Evans | Manager, User Experience Design 4
  • 5. The 5 E’s of Usability Effective: Efficient: Engaging: Error Tolerant: Easy to Learn: Will Evans | Manager, User Experience Design 5
  • 6. Will Evans | Manager, User Experience Design 6
  • 7. Evaluation of Product Will Evans | Manager, User Experience Design 7
  • 8. Will Evans | Manager, User Experience Design 8
  • 9. Types of Usability Testing Formative Summative Will Evans | Manager, User Experience Design 9
  • 10. #AgileUX Process at TheLadders Will Evans | Manager, User Experience Design 10
  • 11. Will Evans | Manager, User Experience Design 11
  • 12. Establish Test Goals Will Evans | Manager, User Experience Design 12
  • 13. Determine The Process of Testing What to test: Where to test: How to test: Will Evans | Manager, User Experience Design 13
  • 14. Define the “Core” Audience Will Evans | Manager, User Experience Design 14
  • 15. Developing “Personas” Will Evans | Manager, User Experience Design 15
  • 16. Sample Persona: ‘Todd’ Will Evans | Manager, User Experience Design 16
  • 17. Recruit Participants Will Evans | Manager, User Experience Design 17
  • 18. Create “real” testing scenarios Will Evans | Manager, User Experience Design 18
  • 19. Determine type of feedback Will Evans | Manager, User Experience Design 19
  • 20. Creating Questionnaires • Allows people to rate overall experience Will Evans | Manager, User Experience Design 20
  • 21. Creating Questionnaires Will Evans | Manager, User Experience Design 21
  • 22. Prepare a test schedule Will Evans | Manager, User Experience Design 22
  • 23. Write a Test Plan Will Evans | Manager, User Experience Design 23
  • 24. “We are testing the product, not you.” Will Evans | Manager, User Experience Design 24
  • 25. Moderator’s Script Will Evans | Manager, User Experience Design 25
  • 26. Being an Effective Moderator • Open-ended, non-leading questions beginning with “what” or “how” (never “why”!) Will Evans | Manager, User Experience Design 26
  • 27. Think-aloud Process • Why the participant is taking an action • What they think about the process • What they expect to happen (matching user mental model to system model) Will Evans | Manager, User Experience Design 27
  • 28. Understanding Your User • Users are people with a goal which the product needs to support • People are in a hurry to reach their goal and they rarely read text until they come across content that matches their goal Will Evans | Manager, User Experience Design 28
  • 29. “We finished testing. Now what does it all mean?” Will Evans | Manager, User Experience Design 29
  • 30. What Did We See? Will Evans | Manager, User Experience Design 30
  • 31. What Does It Mean? Will Evans | Manager, User Experience Design 31
  • 32. Triangulation Analysis Will Evans | Manager, User Experience Design 32
  • 33. What Should We Do About It? Will Evans | Manager, User Experience Design 33
  • 34. Types of Severity Scales Will Evans | Manager, User Experience Design 34
  • 35. Making Recommendations Will Evans | Manager, User Experience Design 35
  • 36. Framing Findings: Key Considerations • Will audience already believe changes are needed or must you convince them? Will Evans | Manager, User Experience Design 36
  • 37. Writing a Report 03/18/12 Will Evans | Manager, User Experience Design 37
  • 39. Thanks! Will Evans is Manager, Experience Design for TheLadders in New York City with 15 years industry experience in interaction design, information architecture, and user experience strategy. His experiences include directing UX for social network analytics and terrorism risk modeling at AIR Worldwide, UX Architect for Gather.com, and UX Architect for travel search engine Kayak.com. He worked at Lotus/IBM where he was the senior information architect, and for Curl – a DARPA-funded MIT project when he was at the MIT Laboratory for Computer Science. His passions include design and critical theory, postmodernism, information visualization, psychology, neuroscience, and wine. He lives in New York, NY, drinks far too much coffee, wears only black, and was Design Co-Chair for the IxDA Interaction10 conference in Savannah, Georgia in February, 2010. He also served on the board of directors of the Information Architecture Institute leading marketing and events.