Product Design Reference
Design Manager Hub
  • 🖖Hello!
  • Methods
    • 🔍Discovery
      • Affinity Diagramming
      • Analytics Review
      • Behavioural Analytics
      • Benchmark Analysis
      • Card Sorting
      • Clickstream Analysis
      • Competitor Analysis
      • Concept Testing
      • Content Inventory
      • Contextual Inquiry
      • Context Mapping
      • Contextual User Interviews
      • Customer Journey Mapping
      • Design Brief
      • Diary Studies
      • Empathy Mapping
      • Expert Review
      • Feasibility Study
      • Field Studies
      • First Principles Thinking
      • The 5 Whys
      • Focus Groups
      • IA Research Study
      • Jobs-to-be-Done (JTBD)
      • Kick-Off Meeting
      • User Mental Models
      • Observation
      • Personas
      • Problem Statements
      • Project Brief
      • Requirements Engineering
      • Requirements Workshops
      • Stakeholder Interviews
      • Surveys
      • User Experience Mapping
      • User Flows
      • User Interviews
      • User Scenarios
    • 💡Ideation
      • Analogous Inspiration
      • Attribute Listing
      • Brainstorming
      • Co-Creation Workshops
      • Crazy Eights
      • Design Excursions
      • Design Specifications
      • Design Sprint
      • Gallery Walk
      • How Might We
      • Idea Box
      • Ideation Cards
      • Interaction Modelling
      • Mind Mapping
      • Mood Boards
      • Prototyping
      • Paper Prototyping
      • Proof-of-Concept (PoC)
      • Prioritisation Matrix
      • Question Storming
      • Random Word Association
      • Role Playing
      • Reverse Ideation
      • SCAMPER
      • SCAMPER+
      • Scenario Mapping
      • Sitemaps
      • Sketching
      • Speed Dating
      • Storyboards
      • Tree Testing
      • Use Cases
      • User Flow Diagrams
      • User Stories
      • User Story Mapping
      • Wireframing
      • What-If Scenarios
      • Worst Possible Idea
      • Vision Workshops
    • 🎯Testing
      • 5 Second Test
      • 10 Second Test
      • A/B Testing
      • Acceptance Testing
      • Beta Testing
      • Design Failure Mode & Effects Analysis (DFMEA)
      • Eye Tracking
      • Expert Review
      • First Click Testing
      • Guerrilla Testing
      • Hallway Testing
      • Heart Framework
      • Heatmaps
      • Lab Usability Testing
      • Measuring Design Success
      • Prototype Testing
      • Retrospective Testing
      • Screen Recording Analysis
      • Surveys
      • Usability Testing
      • Usability Testing Partners
      • Usability Testing Platforms
  • Laws & Principles
    • ⚖️Laws & Principles
      • Accot-Zhai Steering Law
      • Aesthetic-Usability Effect
      • Anchoring Principle
      • Authority Principle
      • Availability Heuristic
      • Campbell's Law
      • Doherty Threshold
      • Fitts's Law
      • Fresh Start Effect
      • Gestalt Principles
        • Closure
        • Common Fate (Synchrony)
        • Common Region
        • Connectedness
        • Continuation
        • Figure/Ground
        • Focal Points
        • Parallelism
        • Past Experiences
        • Proximity
        • Prägnanz
        • Similarity
        • Symmetry (And Order)
        • Uniform Connectedness
      • Goal-Gradient Effect
      • Halo Effect
      • Hick's Law
      • Hook Model
      • Jakob's Law
      • Miller's Law
      • Occam's Razor
      • Pareto Principle
      • Parkinson's Law
      • Peak-End Rule
      • Poka-Yoke Principle
      • Postel's Law
      • Principle of Commitment and Consistency
      • Principle of Contrast
      • Principle of Least Astonishment
      • Principle of Readability
      • Principle of Repetition
      • Principle of Scale
      • Rule of Thirds
      • Rule of Three
      • Scarcity Principle
      • Serial Position Effect
      • Tesler's Law
      • Three Pillars of User Delight
      • Von Restorff Effect
      • Zeigarnik Effect
  • Resources
    • 🧰Resources
      • General
      • Books
      • Glossary
      • Education
Powered by GitBook
  1. Methods

Testing

"Testing is an opportunity to learn, improve, and refine. It's not about finding faults, but about uncovering insights that lead to innovation and progress." - Steve Jobs

PreviousVision WorkshopsNext5 Second Test

Last updated 7 months ago

Test

Testing is a critical phase in UX design. It involves gathering feedback from real users to evaluate the effectiveness and usability of your design. Conduct usability testing, user interviews, and surveys to identify any issues or improvements. The insights gained during this phase help refine and enhance your design.

  1. Conduct usability testing: Gather feedback on functionality, ease of use, and overall experience.

  2. Identify pain points: Document user difficulties and areas of friction in the prototype.

  3. Iterate based on feedback: Update the prototype to address issues discovered in testing.

  4. Validate design choices: Confirm design solutions meet user needs and align with project goals.

  5. Prepare insights for development: Finalise documentation for the build phase.

Build

Once you have refined your designs through testing, it's time to "Build." This phase involves creating the final product, whether it's a website, app, or another digital solution. Collaborate closely with developers to ensure the design vision is translated into a functional product.

  1. Collaborate with engineering: Work closely with developers to ensure designs are accurately implemented.

  2. Conduct regular reviews: Monitor progress and make adjustments based on technical constraints or feedback.

  3. Provide detailed handover documentation: Ensure design handover includes all necessary information.

  4. Address edge cases: Clarify how the design should handle unusual scenarios or unexpected inputs.

  5. Plan quality assurance: Set up a testing plan to verify design integrity during development.

Measure

The final phase, 'Measure', is all about assessing the impact of your design. Use metrics and Key Performance Indicators (KPIs) to evaluate whether the project met its objectives. Analyse the feedback and data gathered during testing to make informed decisions for future iterations or improvements.

  1. Monitor performance metrics: Use analytics to track key metrics and user behaviours post-launch.

  2. Collect user feedback: Engage with users to gather qualitative insights on their experience.

  3. Evaluate success against KPIs: Assess the impact of the design against the established KPIs.

  4. Identify areas for improvement: Spot any recurring issues or enhancements needed for future iterations.

  5. Document learnings: Capture insights and recommendations for improvement.


Various types of testing offer their own advantages and serve specific purposes. The choice of testing depends on the desired information, project budget, and available time. Understanding testing helps determine the most suitable approach for measuring product usability, ensuring comprehensive assessment.

User Testing vs Usability Testing

User testing and usability testing have slight distinctions depending on individual definitions. Usability testing is a component of user testing or UX testing. However, user testing goes beyond usability to assess how customers perceive their overall experience with a product, including their emotions and impression of the brand. While usability testing focuses on functionality and ease of use, user testing encompasses a broader understanding of the customer's feelings and impressions throughout their interaction with the product.

Remote vs In-Person

Remote usability testing refers to testing conducted when the participant and researcher are in separate locations, facilitated by online tools. It can be moderated, with a researcher guiding the participant, or unmoderated, allowing participants to complete tasks independently. In contrast, in-person usability testing occurs face-to-face, where users perform tasks while being observed by a researcher. In-person testing enables real-time observation of users' body language and facial expressions. Remote testing offers convenience and scalability, while in-person testing provides direct interaction and nuanced insights. Both approaches have their advantages and are suitable for different research needs.

Moderated vs Unmoderated

Moderated usability testing involves a coordinator who stays in touch with the participant, either in-person or remotely. The coordinator closely supports the participant, assisting them throughout the research and addressing any queries or difficulties they encounter. This type of testing is well-suited for gathering qualitative data as the coordinator can observe the participant's facial expressions and body language, and ask additional questions when needed. On the other hand, unmoderated usability testing doesn't involve a moderator. Participants independently complete pre-designed tests at their own chosen time and location. It offers flexibility and convenience, typically requiring less time and people involved. Online usability testing tools facilitate unmoderated testing.

Qualitative vs Quantitative

Qualitative research in user testing and usability testing involves gathering non-numerical insights about user experiences, behaviors, and attitudes, focusing on the "why" behind their actions. It provides descriptive findings that uncover user needs and motivations. In contrast, quantitative research gathers numerical data and measurable metrics to derive statistical insights, focusing on the "what" and "how many" aspects of user behavior. It allows for analysis at scale and provides statistical trends. Both approaches complement each other, with qualitative research providing in-depth understanding and quantitative research offering statistical generalization, forming a comprehensive picture in user research and testing.

Explorative vs Comparative

Explorative usability testing is focused on discovery and gathering open feedback from participants. It is an unstructured approach used in the early stages of product development to understand what works well, what needs improvement, and identify potential market niches and new features. This type of testing involves a smaller number of participants and aids in idea iteration. Comparative usability testing, on the other hand, involves comparing multiple versions of a product or interface to determine which offers a better user experience. It gathers data on user preferences and guides design decisions. Conducted with a larger number of users, it often involves structured tasks, and A/B testing is an example of this approach.

Formative vs Summative

Formative and summative testing are two broad categories of usability testing which are important to understand. Formative testing is qualitative and takes place earlier in the design or development process. Its purpose is to identify areas for improvement in the product. The findings from formative testing help in shaping prototypes and wireframes. On the other hand, summative testing is more quantitative and occurs later in the process. It aims to assess the effectiveness of the implemented solutions. The results of summative testing provide quantitative data that can guide broader improvements or specific fine-tuning, often in conjunction with competitive analysis.

Behavioural vs Attitudinal

Research can be broadly categorised into behavioural and attitudinal. Attitudinal research examines what people say and think about your product, while behavioural research focuses on their actual interactions and the emotions that arise. It's important to recognise that what people say and what they do can often diverge. Understanding these categories helps us select appropriate testing methods and better organise our findings.

article by Nielsen Norman

article by Nielsen Norman Group

article by Nielsen Norman Group

article by Nielsen Norman Group

article by Nielsen Norman Group

video by Nielsen Norman Group

by Nick Dauchot on Medium

🎯
"Usability Testing 101"
"Remote Usability-Testing Costs: Moderated vs. Unmoderated"
"Unmoderated User Tests: How and Why to Do Them"
"Quantitative vs. Qualitative Usability Testing"
"Formative vs. Summative Evaluations"
"Formative vs. Summative Usability Evaluation"
"Formative vs. summative research"