Testing

Wizard of Oz Testing

Simulate a functional system by having a hidden person (the "wizard") control the responses. The user interacts with the interface, believing it's real. This validates concepts quickly, before investing in development.

Duration
50 mins
Group Size
3-5
Category
Testing
Difficulty
Easy
This exercise helps you test concept viability, validate complex system ideas, observe user behavior, and identify unexpected use patterns.
You'll complete Wizard of Oz testing, test simulated functionality, and validate concepts.
Keep the wizard completely hidden; otherwise, the test is invalid. The wizard must respond at a realistic speed. This is excellent for testing AI, chatbots, or complex algorithms early. It reveals real user expectations. The wizard needs quick access to responses but should also improvise. Expect users to push boundaries. Ethically, decide beforehand if you'll reveal the wizard. This is best for concept validation, not detailed design. It can be tiring for the wizard, so rotate roles if running multiple sessions. I've found it tricky sometimes to get the 'wizard' to respond naturally - practicing beforehand helps!

  1. Setup & Preparation (15 minutes): Create an interface mockup. Set up a hidden workspace for the wizard. Prepare response templates. Brief the wizard on system capabilities. Test the wizard's response speed. Prepare test scenarios.

  2. User Testing Session (30 minutes): The user interacts with the interface. The wizard monitors user actions and manually generates responses. An observer takes detailed notes. Record the screen and user reactions.

  3. Debrief & Analysis (5 minutes): Thank the user. Analyze user behaviors and expectations. Review cases where the wizard struggled. Identify patterns in user language. Assess concept viability.

Unlock Step-by-Step Instructions

Create a free account to access step-by-step instructions, agendas, and resources for all activities.

For Facilitators

  • Review participant profiles and expectations
  • Prepare all materials and supplies
  • Test technology and room setup

For Participants

  • Complete pre-session survey
  • Review background materials
  • Prepare examples or case studies

Unlock Pre-Work Requirements

Create a free account to access step-by-step instructions, agendas, and resources for all activities.


  • Interface mockup (paper, digital, clickable)

  • Hidden workstation for the "wizard"

  • Communication system between wizard and interface

  • User task scenarios

  • Observation note templates

  • Response templates (for AI/Chatbot testing)

  • Quick typing setup (for AI/Chatbot testing)

  • Physical mockup or prop (for physical products)

  • Hidden controls for wizard (for physical products)

  • Remote operation capability (for physical products)

Unlock Materials Required

Create a free account to access step-by-step instructions, agendas, and resources for all activities.

  • Facilitator Guide (PDF)
  • Participant Workbook Template
  • Presentation Slides
  • Printable Materials

Unlock Resources & Templates

Create a free account to access step-by-step instructions, agendas, and resources for all activities.

Discussion

0/2000
Loading comments...

Related Exercises

See all exercises

I Like, I Wish, What If

18 mins

This exercise uses three feedback categories to provide balanced and actionable critique. "I Like," "I Wish," and "What If" prompts generate construct...

Testing

Assumption Testing

1.5 hours

Before you spend big, check your assumptions. This exercise helps you design quick, low-cost experiments. Test what you believe about your users, the ...

Testing

System Usability Scale (SUS) Administration & Scoring

1 hour

The System Usability Scale (SUS) is a quick way to measure perceived usability. First, participants complete the SUS questionnaire after using a produ...

Testing