Day 5 - Test Activities

Day 5 Activities:

By Day 5, you’ve created promising solutions, chosen the best to test with, and built a realistic prototype. The last step is to interview customers and learn by watching them react to your prototype. At the end of the day, you’ll capture your key learnings and have a shared sense of the direction you’ll need to go after the sprint.

  • Interviews (x4+) – interviewers share your prototype with target customers and the team learns from their actions/reactions
    • Why do this? This is what it’s all about. Learning in days, not months. Getting realistic reactions, and not being committed to the end solution. It puts the team in a position to invest (or stop investing) in the solution.
    • Advance Concepts® - Key tips/learnings:
      • Have someone responsible for “tech”. Be sure everything is working the day before and before the interview itself.
      • Having two interviewers helps. We like assigning one as “primary” and the other as “support”. Support can communicate with the team of observers live.
      • In the observing room, have one facilitator/guide lead the debrief after each interview. They’ll also need to prepare the team on how to capture notes (color-coded stickies, observations not interpretations, verbatim quotes everywhere possible).
      • Have the Day 4 prototypers ready to make tweaks on the fly
    • Sprint Book - pages 201-215
      • Key tips:
        • 5-Act Interview – these are the typical stages for each interview.
          • Friendly Welcome – the interviewee in friendly way so they are comfortable and open. There are no “wrong answers” and their input is helpful.
          • Context – before introducing the solution (prototype) you’ll want to understand their context on the overall topic.
          • Prototype – introduce the solution (prototype) and ask them to think out loud as they interact with it
          • Tasks and Nudges – since the prototype may have dead ends and loose edges, interviewers can nudge customers to check out or do tasks
          • Debrief (team) – after the interview, each observer can place their color-coded notes on the collective board, identify any key points

NOTE: Advance Concepts® aims for the experiment to be as realistic as possible, so we don’t refer to solutions as “prototypes” or interviews as “tests”. Which is different from these videos below:

  • Learn / Wrap-Up (aka Debrief)– you’ve collected data during each interview, now you look across the interviews and summarize learnings and potential next steps
    • Why do this? Get greater insight by looking across interviews. Review the sprint questions and answer them if possible (most, if not all). Use these learnings to determine action steps and share effectively.
    • Advance Concepts® - Key tips/learnings:
      • Be sure to hold enough time to do this effectively. It’s the end of a long week – but it’s very important! 1-2 hours is typical.
      • Have individuals reflect on the sprint questions – ask them to identify the data points the reinforce that.
      • One of the best things about the data-board is the visual analysis that can be done. You can literally see what parts of the experience were positive or poor.
      • We always like to end the Wrap-Up with Action steps. After reviewing the Sprint Questions, ask the team – “What are the implications?” – “What should be done next” – “Who on this team could be responsible”
      • We pre-schedule “Momentum meetings” to take place a couple days, a couple weeks, and a couple months after sprint week. Without this, there can be significant drop-off.
    • Sprint Book - pages 216-225
      • Key tips:
        • Watch Together, Learn Together – It’s important for the team to do this together, as its like the difference between talking about a movie you saw and watching it together
        • Take interview notes as a group – all observers should be prepared with positive, negative, (and neutral) stickies. Keep to themselves until the interview is complete.
        • Look for patterns – after all interviews, have the team silently do a gallery walk, writing down patterns/themes. Share back as a group and capture on a whiteboard.
        • Back to the future – go back to the sprint questions. Answer them as a group (Yes, No, or maybe Maybe). Highlight learnings that support the answers.
    • User Testing (13:18) AJ&Smart – (most comprehensive video, listed above)


Now rest for a couple days 😊