Assignment 3: Getting the Design Right

Overview

Now that you have chosen a design, it is time to iteratively refine that design. This group assignment, spanning multiple weeks of the course, tackles the problem of getting the design right through paper prototyping, inspection, and user testing. Design refinement culminates in a digital mockup.

This assignment is worth 15 out of 100 points of your overall course grade:

The presentation is worth 5 points of your overall course grade.

Milestones

This is a group assignment, consisting of five milestones.

Project Description

In this assignment, you will iteratively improve your design. You will construct a paper prototype informed by your earlier work. You will then use inspection to identify and correct issues in the paper prototype. You will next conduct a series of three usability tests, further identifying and correcting issues in your paper prototype. You will create a digital mockup that captures the result of your design process. Finally, you will present your design process in a report and presentation.

  1. Develop a paper prototype for your design. It should convey all critical aspects of your design, including support for testing your two primary tasks.

    This prototype has been informed by your prior sketching and storyboarding. But it also contains more details than your prior exploratory designs. If necessary or appropriate, revise your tasks or scenarios based on what your learn in prototyping.

    (Assignment 3a)

  2. Conduct a heuristic evaluation of your paper prototype. You will perform an evaluation in class, and will supplement this with another evaluation.

    Revise your paper prototype based on what you learn in heuristic evaluation. Your tasks and scenarios are likely stable, but revise them if your evaluation reveals a need.

    (Assignment 3b)

  3. Conduct usability tests with three participants, each completing your two primary tasks.

    Make a log of critical incidents during the test, including both positive and negative events. For example, a person might make a mistake or might comment on something they like. Write it down along with a description of the context of the incident. Later you will discuss and prioritize these events, assigning a severity rating to problems (ranging from 0 for no problem to 4 for usability catastrophe).

    You should not use friends, members of the class, or people you know to have engineering backgrounds. You also should not use people who have been previously exposed to your project. Target an appropriate set of participants based on your design research and resulting design.

    Be sure to divide your team into roles when conducting the usability test. There is simply too much for a single person to conduct a test. As discussed in class, these roles include the facilitator, the computer, and one or more observers.

    As part of your introduction, have your facilitator show the participant how to interact with your design. Do not show participants how to perform your tasks that you will later test. Instead show them how paper prototyping works, how your system generally works, and give an example of something specific that is sufficiently different from your tasks.

    Consider recording your tests to allow you to see exactly what happened. If you do this, ensure your recording preserves the anonymity of the participant. Frame your shot such that you capture interaction with the prototype without unnecessarily capturing the participant.

    Each participant should perform both tasks. Keep the data separate for each participant and each task. Keep participant names confidential, and preserve anonymity in your reporting. Remember participation must be voluntary, participants should be free to stop at any time, and you should emphasize that your focus is on identifying usability issues in the design.

    Revise your paper prototype based on what you learn in usability testing. This can and should include fixing major issues as soon as they are detected, before additional tests. Your tasks and scenarios are likely stable, but revise them if your evaluation reveals a need.

    (Assignment 3c), (Assignment 3d)

  4. After refining your paper prototype based on your usability testing, construct a digital mockup of your design.

    Do not begin working in digital prototyping until you finish revising your paper prototype. It is much easier to iterate on your design in the paper prototyping phase. As you transition into digital prototyping, you will consider other aspects of the design. These details you may not have considered (e.g., visual design, layout, color, typography), but can also include constraints or mismatches introduced by the technology itself.

    We have no strong preference to what digital tools you utilize to create your mockup. But it must be digital (e.g., you may not use pictures of a hand-drawn sketch).

    Some recommendations from the course staff include:

    You will use this digital mockup to effectively communicate your design in your final report, website, and poster. Some tools support creation of interactive mockups (e.g., allow clicking active regions to move between screens). This would add additional capabilities to your website, and you are welcome to use such a tool. But interactive mockups are neither expected nor required.

    Implement your digital mockup to include key frames that illustrate your design. It should convey all critical aspects of your design, including walkthroughs for your two primary tasks.

    (Assignment 3e)

  5. Summarize your design process in a report.

    (Assignment 3f)

Deliverables

3a: Paper Prototype

Due: Uploaded Monday - May 13, 2019.

Develop a paper prototype for your design. It should convey all critical aspects of your design, including support for testing your two primary tasks.

Submission

No more than one page of text in PDF format.

Capture and submit detailed images of your paper prototype. Include:

Images do not count against your page limit, and are therefore effectively free. You should embed images throughout your PDF, keeping them near the text that references them. The limit applies to the approximate amount of text you would have if all images were removed.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770567

Bring your prototype to class. You will need it to conduct Heuristic Evaluation.

Grading

This milestone will be graded on a scale of 2 points:

  1. Overall Completeness and Appropriateness of Paper Prototype: (0.66 points)
  2. Completeness, Appropriateness, and Documentation of Each Task: (0.67 points per task)

3b: Heuristic Evaluations

Due: Uploaded Wednesday - May 15, 2019.

Conduct a heuristic evaluation of your paper prototype. You will be delayed in completing this if you do not bring your prototype to class.

Each team will split in half to conduct heuristic evaluations, pairing with another half-team from a different project. One half-team will conduct a heuristic evaluation of the other’s paper prototype. The two half-teams will then reverse roles. Each half-team will therefore conduct and receive one heuristic evaluation, and each team will therefore receive two evaluations of their prototype.

We will provide a worksheet with Nielsen’s heuristics:

3b-nielsen-heuristics.pdf

Evaluators will use index cards to record issues identified in evaluation. Include what heuristic is violated, and a severity rating (ranging from 0 for no problem to 4 for usability catastrophe).

Revise your paper prototype based on what you learn in heuristic evaluation. Your tasks and scenarios are likely stable, but revise them if your evaluation reveals a need.

Submission

No more than one page of text in PDF format.

Capture and submit detailed images of your heuristic evaluation work. Include:

The evaluated project will keep the created index cards, so they can use them to improve their design. The evaluated project should be careful not to lose these, as their contents will be submitted in the next assignment. Similarly, be careful to keep a detailed record of any changes that are made, as these will be submitted in the next assignment.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770568

Grading

This milestone will be graded on a scale of 2 points:

  1. Participation of Each Half-Team: (1 point per half-team)

3c: Usability Testing Check-In

Due: Uploaded Friday - May 17, 2019).

You received two heuristic evaluations of your paper prototype. If desired, you may also conduct a heuristic evaluation or cognitive walkthrough for your own paper prototype. Also complete one usability test with your paper prototype.

Present your iterative revisions and your plan going forward:

Submission

No more than three pages of text in PDF format.

Images do not count against your page limit, and are therefore effectively free. You should embed images throughout your PDF, keeping them near the text that references them. The limit applies to the approximate amount of text you would have if all images were removed.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770569

In section, be prepared to discuss your iterative revision of your paper prototype. Also bring your prototype to section. You will need it to demonstrate for critique.

Grading

This milestone will be graded on a scale of 2 points:

  1. Issues Identified from Inspection, Revisions Made in Response: (0.5 points)
  2. Discussion of Usability Test and Plan: (0.5 points)
  3. Issues Identified in Usability Test, Revisions Made in Response: (0.5 points)
  4. Updated Images of Paper Prototype: (0.5 points)

3d: Usability Testing Review

Due: Uploaded Monday - May 20, 2019.

Complete your three usability tests and finalize your paper prototype according to what you learn.

Present the results of your usability testing and your final paper prototype:

Submission

No more than three pages of text in PDF format.

Images do not count against your page limit, and are therefore effectively free. You should embed images throughout your PDF, keeping them near the text that references them. The limit applies to the approximate amount of text you would have if all images were removed.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770570

Grading

This milestone will be graded on a scale of 2 points:

  1. Discussion of Usability Tests and Plan: (0.5 points)
  2. Issues Identified in Usability Tests, Revisions Made in Response: (0.5 points)
  3. Updated Images of Paper Prototype: (0.5 points)
  4. Discussion of Key Revisions in Design Process: (0.5 points)

3e: Digital Mockup

Due: Uploaded Friday - May 27, 2019.

Create your digital mockup based on your final paper prototype. The mockup should effectively communicate your design in a manner appropriate for your final report, website, and poster. Implement your digital mockup to include key frames that illustrate your design. It should convey all critical aspects of your design, including walkthroughs for your two primary tasks.

Note decisions or changes you need to make as you transition from paper to a digital representation.

Present your digital mockup together with discussion of the decisions and changes you made:

Submission

No more than one page of text in PDF format.

Images do not count against your page limit, and are therefore effectively free. You should embed images throughout your PDF, keeping them near the text that references them. The limit applies to the approximate amount of text you would have if all images were removed.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770571

Grading

This milestone will be graded on a scale of 2 points:

  1. Overall Completeness and Appropriateness of Digital Mockup: (0.5 points)
  2. Completeness, Appropriateness, and Documentation of Each Task: (0.5 points each)
  3. Discussion of Decisions and Changes in Implementation: (0.5 points)

3f: Final Report

Due: Uploaded Friday - May 31, 2019.

For the final submission, you’re required to present your project as a case study. Case studies are used by designers to showcase their work and sets up the context about the problem, research and the solution to an uninitiated reader. This case study will be published on CSE440’s Medium.com page.

Here it is a good structure for such a post:

  1. Title
    • A short, creative, and marketable title capturing the key idea.
  2. Introduction
    • Introduce your project in one statement followed by a brief introduction of the problem you solved and the target user
    • Introduce your team briefly and the roles
  3. Background
    • Define the problem area in detail and your motivations behind selecting this problem
  4. User Research
    • Define your user(s) (primary, secondary, and tertiary if applicable)
    • Describe the research methods used
    • Results or distillation of research into tasks or scenarios
  5. Prototypes and User Testing
    • Paper prototype: Feedback from heuristic evaluation, revisions overview
    • User testing: How did you recruit the user? Describe user testing methods and testing tasks
    • Describe revisions done after user testing
    • Final product/prototype
  6. Project Retrospect
    • What did you learn about the primary user and the problem area you chose through user research and user testing
    • What were the limitations and constraints you identified? (Optional: Describe how will you take care of them in future projects)
    • Roadmap and Impact: Provide a brief perspective of how your project can evolve in the future and the impact it had/can have on your target user(s)

A few examples of good cases are:

Submission

Create a Google Doc and share it with anyone who has the link. Use it since the first step so everybody on your team and on staff can jump in and leave comments.

You should embed images throughout the document, keeping them near the text that references them.

Submit the link via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770572

Grading

This report will be graded on a scale of 5 points:

  1. Title: (0.3 points)
  2. Introduction: (0.5 points)
  3. Background: (0.5 points)
  4. User Research: (1 point)
  5. Prototypes and User Testing: (1 point)
  6. Project Retrospect: (1 point)
  7. Clarity and Presentation: (0.7 points)

Presentation

Due: Uploaded Monday - Jun 3, 2019.

Prepare a presentation of your process in getting the design right. It should encompass all of your work in Assignment 3.

A suggested organization of this presentation is:

  1. Title:

    A short, creative, and marketable title capturing the key idea. Include team member names and roles.

  2. Overall Problem:

    Tell this as a story, instead of simply reading the slide. Motivate your audience to be interested in your problem.

  3. Initial Paper Prototype:

    Present your initial paper prototype. Convey the critical aspects of your design, including your two primary tasks.

  4. Testing Process and Results:

    Describe your testing process, what you learned from it, and how you refined your prototype as a result.

  5. Final Paper Prototype:

    Present your final paper prototype. Convey the critical aspects of your design, including your two primary tasks. This might be shorter than your presentation of the initial paper prototype, because you already presented changes and are about to present the digital mockup. Keep your presentation appropriately paced instead of getting bogged down here.

  6. Digital Mockup:

    Present your digital mockup. Convey the critical aspects of your design, including your two primary tasks.

  7. Summary:

    Summarize the lessons learned in your design process.

We strongly recommend rehearsing your presentation beforehand. For example, arrange to practice together with another group or two, giving each other feedback on your presentations.

Note that we have not provided recommendations for the number of slides in each section of this presentation. You can deliver your presentation using as many or as few slides as you want, as long as you successfully address the above points and the presentation falls within the time restriction.

Submission

Your presentation may be in PPT, PPTX, PDF or Keynote format.

To minimize switching time, we will have all presentations on a single laptop running Mac OS. You should optimize your presentation for portability (e.g., ensure any necessary fonts are embedded). If we detect any obvious formatting issues on the presentation machine, we may fix them or contact you to fix them. But you are ultimately responsible for your presentation.

Submit via Canvas here:

https://canvas.uw.edu/courses/1271349/assignments/4770573

Grading

The content of this presentation will be graded on a scale of 5 points: