Usability Evaluation

Novice

Tree testing has been attempted, but it is not clear how the results from tree testing informed the organization of the navigation.

Competent

Tree testing revealed insights about users' ability to find information within a structure tested, and showed what changes were made in order to address any problems identified.

Proficient

Tree testing proceeded in multiple rounds, with adaptations made as necessary. Clear connections were made between the results of evaluation rounds and the design of navigation.

Expert

Tree testing was approached in targeted ways based on the project, with the method refined to match the needs and context of the work. No doubt is left about why this work was done or what value it provided in informing the quality of the design.

Novice

Only 1 round of testing was done

Competent

At least 2 rounds of iterations were made

Proficient

3 or more rounds of iterations were made

Expert

4+ rounds of iterations.

Novice

Heuristics are used superficially to evaluate either the existing design, competitors, or the presented design. The inclusion of heuristics does not add much value to the quality of design decisions.

Competent

Heuristics have been used to evaluate and identify clear usability issues, at least some of which are then addressed in the final design presented.

Proficient

Heuristics have been used to identify opportunities in the existing product (if available) as well as opportunities based on competitive and comparable products. The final product has taken all of these findings into account, and has also been through a final evaluation to maximize quality of output.

Expert

Multiple evaluators have participated in a review, with clear actions taken to address issues surfaced. Findings and actions have also been prioritized and developed into a rollout plan.

Novice

Iterations seem to be made more on taste and assumption.

Competent

Clear examples were given of changes made based on testing.

Proficient

Insightful and clear iterations, leaving no doubts on conventions and user-centered iterations.

Expert

Iterations show that many different directions for the design were explored and exhausted, resulting in an extremely confident final design.

Novice

Usability testing is mentioned as having taken place, but it’s not clear what the findings were, or how those findings translated into improvements to the design.

Competent

Usability testing has resulted in some clear findings, which are addressed in iterations to the design.

Proficient

Usability testing has been done on the product itself, as well as with potential competitors or comparable products, to paint a more complete picture of how users would use the product. The connection between testing findings and design decisions have been made obvious.

Expert

Usability testing has been thorough and yielded deep insights into user behavior with the system, resulting in clear improvements throughout the product. The product itself leaves no doubts about its usability, as even minor issues and edge cases have been considered.