This paper discusses the use of instant messaging (IM) as a communication tool during usability studies � primarily between the interview and observation rooms. The benefits and challenges associated with providing an IM link are discussed, based on feedback from a survey of study moderators and observers. Observers were much more positive about the use of IM than the moderators. A key concern to moderators was the potential distraction to themselves, participants and observers. In contrast, observers greatly welcomed the opportunity to ask questions and help deal with buggy prototypes. Guidelines are outlined for the effective use of IM within a usability context, and contexts outlined when an IM link is most appropriate.
8. The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their computer. I hope they still pay me sorry, I just rebooted the server
9. Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring, I want my $$$ Moderator User
10. Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
11. The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM: Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
15. “ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
16. “ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
17. Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love the tool
19. Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
21. “ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
22. “ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we wrap up? Aggh, when is this going to finish??
23. Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this … << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
24. Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is really cold
27. Guideline: One to one IM UI Eng PM Moderator User pls ask about feature foo ask others for extra questions
28. Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
29. End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we wrap up?
30. Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
31.
32. CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!