Measure usability and the overall user experience.
Run a task-level satisfaction survey immediately after users complete a task to determine how difficult or easy it was to complete the task.
- ASQ uses three questions about the ease, time, and support received.
- NASA-TLX assesses the workload involved, including weightings for each of six elements.
- SMEQ uses one scale to determine how much mental effort a task requires, and correlates highly with SUS scores, completion time, completion rates, and errors.
- UME allows users to assign a number to a task to estimate its difficulty in proportion to the perceived difficulty. For example, a task perceived as 100% difficult is twice as difficult as a task perceived as 50% difficult.
- SEQ asks users to rate the task on a scale from very difficult to very easy.
Assign a number to the task experience, such as number of problems encountered or number of steps to complete a task, to see where you can improve.
Improving this number over time allows you to measure how designs have improved the UX, and then fix the bottlenecks and improve conversions, thus improving revenue.
Run a test-level satisfaction survey at the end of the session to measure the user’s overall impression of the usability and experience.
SUS consists of 10 statements to rate on a scale of 1–5:
- I think that I would like to use this system frequently.
- I found the system unnecessarily complex.
- I thought the system was easy to use.
- I think that I would need the support of a technical person to be able to use this system.
- I found the various functions in this system were well integrated.
- I thought there was too much inconsistency in this system.
- I would imagine that most people would learn to use this system very quickly.
- I found the system very cumbersome to use.
- I felt very confident using the system.
- I needed to learn a lot of things before I could get going with this system.
SUPR-Q has 8 questions (including 1 NPS question) to determine if a website is usable, credible, and visually appealing. The trust questions vary based on whether the site is commerce-oriented.
- The website is easy to use. (usability)
- It is easy to navigate within the website. (usability)
- I feel comfortable purchasing from the website. (trust for commerce sites)
- I feel confident conducting business on the website. (trust for commerce sites)
- The information on the website is credible. (trust for non-commerce)
- The information on the website is trustworthy. (trust for non-commerce)
- How likely are you to recommend this website to a friend or colleague? (loyalty)
- I will likely return to the website in the future. (loyalty)
- I find the website to be attractive. (appearance)
- The website has a clean and simple presentation. (appearance)
Score the SUS to use as a comparison to other products.
- For odd items, subtract one from the user response.
- For even-numbered items, subtract the user responses from five. This scales all values from 0 to 4, with 4 the most positive response.
- Add up the converted responses for each user and multiply that total by 2.5. This converts the range of possible values from 0 to 100 instead of from 0 to 40.
Score the SUPR-Q to use it as a comparison to industry benchmarks.
Add up the responses for the first 12 questions. To that total, add one half the score of the NPS question. The lowest possible score is a 12, and the maximum score is a 65.
Ask users, How likely are you to recommend the product or service to a friend?
This is known as Net Promoter Score (NPS) and is a popular and effective method of measuring user experience and satisfaction. Break up NPS responses into three user segments:
- Promoters (9–10). The happiest and most loyal customers, most likely to refer you to others. Use them for testimonials, affiliates, etc.
- Passives (7–8). These customers are happy but unlikely to refer you to friends. They may be swayed by a competitor fairly easily.
- Detractors (0–6). These are unhappy customers and can be dangerous for your brand, spreading negative messages and reviews. Identify their problems and fix them.
Subtract the percentage of detractors from the percentage of promoters to get the NPS score. Use the NPS score as a benchmark for how well you are doing. A good NPS is better than the one you had last month.
Compare your numbers to competitors to get a realistic idea of your customers’ satisfaction level, and then you can work on improving your score.
Investigate trends that are improving or worsening.
Plan targeted promotions and campaigns by knowing more about your promoters.
Your promoters will help tell the world about you.
Use the detractors to determine what you can improve about your user experience.
- Which issues keep appearing?
- Are there any trends?