Heuristic Evaluation of Grading Software

 

 

We are conducting a heuristic evaluation of a prototype currently under development to support the grading of homework for CS 142 and CS 143. Your responses will be kept anonymous and handled only by the three researchers on this project. Individual responses will be aggregated with other participating evaluators before being reported. We very much appreciate your time and assistance.

Tasks:

  1. Skim the Homework Assignment
  2. Skim Grading Guideline
  3. Grade the Homework noting any usability issues that you feel need to be addressed in the software. While any comments are helpful, we are particularly interested in having you evaluate the following functions:
    1. Highlight & annotate a line of code
    2. Highlight/annotate a region of code (e.g. a loop)
    3. Edit an existing annotation
    4. Highlight and annotate 2 disjoint statements
    5. Create a general annotation (e.g. by clicking on the annotation)
    6. Locate the code associated with annotation (e.g. by clicking on the annotation)
    7. Search the code for a particular keyword