Evaluation and evidence · Source reviewed; not hands-on tested
Competitive usability evaluation
Compare how users attempt equivalent tasks across products.
When this is useful
You need a structured decision rather than a universal marketing formula.
Required inputs
Define the same job, recruit the relevant users and use a consistent task and observation procedure.
Worked example — fictional
Fictional: compare how participants locate a pricing estimate for the same workload. Record completion and confusion, rather than ranking the prettiest page.
Original worksheet
Download our evidence worksheet; upstream diagrams and proprietary templates are not redistributed.
Put it to work
- Define the decision and gather the stated inputs.
- Apply the method while retaining uncertainty and contrary evidence.
- Choose a next observation and write the conditions for revisiting the decision.
Limits and tradeoffs
A product feature checklist is not a usability study. Brand familiarity, order and task equivalence can distort comparisons.
Worksheet preview
# Competitive usability evaluation: original decision worksheet Attribution: Jon Bishop. CC BY 4.0. Framework source: https://www.nngroup.com/articles/competitive-usability-evaluations/ This is an original worksheet, not a copy of the source artifact. ## Decision What decision must this exercise inform? Who owns it? What evidence would change it? ## Inputs Define the same job, recruit the relevant users and use a consistent task and observation procedure. For each input, record: observation | source | date | affected population | confidence | unresolved question. ## Application 1. Define one concrete decision and comparison period. 2. Record evidence separately from estimates. 3. Apply the method and inspect the assumptions that drive the result. 4. State the next observation or test and its decision rule. ## Worked example — fictional Fictional: compare how participants locate a pricing estimate for the same workload. Record completion and confusion, rather than ranking the prettiest page. ## Limits A product feature checklist is not a usability study. Brand familiarity, order and task equivalence can distort comparisons. ## Output Decision: ___ Evidence supporting it: ___ Contradictory or missing evidence: ___ Next action and owner: ___ Revisit when: ___