Today, we’re thrilled to announce the arrival of the latest member of the Optimal family:  Prototype Testing! This exciting and much-requested new tool allows you to test designs early and often with users to gather fast insights, and make confident design decisions to create more intuitive and user-friendly digital experiences. 

‍

Optimal gives you tools you need to easily build a prototype to test using images and screens and creating clickable areas, or you can import a prototype from Figma and get testing. The first iteration of prototype testing is an open beta, and we’ll be working closely with our customers and community to gather feedback and ideas for further improvements in the months to come.

‍

‍

When to use prototype testing 

‍

Prototype testing is a great way to validate design ideas, identify usability issues, and gather feedback from users before investing too heavily in the development of products, websites, and apps. To further inform your insights, it’s a good idea to include sentiment questions or rating scales alongside your tasks.

‍

Early in the design process: Test initial ideas and concepts to gauge user reactions and feelings about your conceptual solutions. 

‍

Iterative design phases: Continuously test and refine prototypes as you make changes and improvements to the designs. 

‍

Before major milestones: Validate designs before key project stages, such as stakeholder reviews or final approvals.

‍

Usability Testing: Conduct summative research to assess a design's overall performance and gauge real user feedback to guide future design decisions and enhancements.

‍

‍

How it works 🧑🏽‍💻

‍

No existing prototype? No problem. We've made it easy to create one right within Optimal. Here's how:

‍

1. Import your visuals

Start by uploading a series of screenshots or images that represent your design flow. These will form the backbone of your prototype.

‍

2. Create interactive elements

Once your visuals are in place, it's time to bring them to life. Use our intuitive interface to designate clickable areas on each screen. These will act as navigation points for your test participants.

‍

3. Set up the flow

Connect your screens in a logical sequence, mirroring the user journey you want to test. This creates a seamless, interactive experience for your participants.

‍

4. Preview and refine

Before launching your study, take a moment to walk through your prototype. Ensure all clickable areas work as intended and the flow feels natural.

‍

The result? A fully functional prototype that looks and feels like a real digital product. Your test participants will be able to navigate through it just as they would a live website or app, providing you with authentic, actionable insights.

‍

By empowering you to build prototypes from scratch, we're removing barriers to early-stage testing. This means you can validate ideas faster, iterate with confidence, and ultimately deliver better digital experiences.

‍

‍

Or…import your prototypes directly from Figma 

‍

There’s a bit of housekeeping you’ll need to do in Figma in order to provide your participants with the best testing experience and not impact loading times of the prototype. You can import a link to your Figma prototype into your study,  and it will carry across all the interactions you have set up. You’ll need to make sure your Figma presentation mode is made public in order to share the file with participants. If you make any updates to your Figma file, you can sync the changes in just one click. 

‍

Help Article: Find out more about how to set up your Figma file for testing

‍

‍

How to create tasks 🧰

‍

When you set up your study, you’ll create tasks for participants to complete. 

‍

There are two different ways to build tasks in your prototype tests. You can set a correct destination by adding a start screen and a correct destination screen. That way, you can watch how participants navigate your design to find their way to the correct destination. Another option is to set a correct pathway and evaluate how participants navigate a product, app, or website based on the pathway sequence you set. You can add as many pathways or destinations as you like. 

‍

Adding post-task questions is a great way to help gather qualitative feedback on the user's experience, capturing their thoughts, feelings, and perceptions.

‍

Help Article: Find out how to analyze your results

‍

‍

Prototype testing analysis and metrics 📊

‍

Prototype testing offers a variety of analysis options and metrics to evaluate the effectiveness and usability of your design.  By using these analysis options and metrics, you can get comprehensive insights into your prototype's performance, identify areas for improvement, and make informed design decisions:

‍

Task results 

The task results provide a deep analysis at a task level, including the success score, directness score, time taken, misclicks, and the breakdown of the task's success and failure. They provide great insight into the usability of your design to achieve a task. 

‍

• Success score tells you the total percentage of participants who reached the correct destination or pathway that you defined for this task. It’s a good indicator of a prototype's usability. 
• Directness score is the total completed results minus the ‘indirect’ results.
• A path is ‘indirect’ when a participant backtracks, viewing the same page multiple times, or if they nominate the correct destination but don’t follow the correct pathway
• Time taken is how long it took a participant to complete your task and can be a good indicator of how easy or difficult it was to complete. 
• ‍Misclicks measure the total number of clicks made on areas of your prototype that weren’t clickable, clicks that didn’t result in a page change.

‍

‍

Clickmaps

‍

Clickmaps provide an aggregate view of user interactions with prototypes, visualizing click patterns to reveal how users navigate and locate information. They display hits and misses on designated clickable areas, average task completion times, and heatmaps showing where users believed the next steps to be. Filters for first, second, and third page visits allow analysis of user behavior over time, including how they adapt when backtracking. This comprehensive data helps designers understand user navigation patterns and improve prototype usability.

‍

‍

‍

Participant paths 

‍

The Paths tab in Optimal provides a powerful visualization to understand and identify common navigation patterns and potential obstacles participants encounter while completing tasks. You can include thumbnails of your screens to enhance your analysis, making it easier to pinpoint where users may face difficulties or where common paths occured.

‍

‍

‍

Coming soon to prototyping 🔮

‍

Later this year, we’re running a closed beta for video recording with prototype testing. This feature captures behaviors and insights not evident in click data alone. The browser-based recording requires no plugins, simplifying setup. Consent for recording is obtained at the start of the testing process and can be customized to align with your organization's policies. This new feature will provide deeper insights into user experience and prototype usability.

‍

These enhancements to prototype testing offer a comprehensive toolkit for user experience analysis. By combining quantitative click data with qualitative video insights, designers and researchers can gain a more nuanced understanding of user behavior, leading to more informed decisions and improved product designs.

‍

Start prototype testing today

The accuracy of your data collection is crucial in qualitative research. It is vital that nothing is lost in translation or simply missed from the point of collection to analysis, and our latest release makes this even easier to achieve. You can now directly import interview transcripts into Qualitative Insights (previously known as Reframer), allowing you and your team to capture and tag observations effortlessly while maintaining the integrity of the information. Get ready to experience a new level of efficiency in your qualitative research!

‍

The importance of transcription ✍🏽

‍

Whether you are conducting interviews alone or with the support of your team, it’s important to prioritize building connections with participants rather than struggling to take notes and ask the right questions. Transcripts ensure you avoid losing crucial insights and context as you move from data collection to analysis and reduce the likelihood of human errors and missed observations that sometimes occur during live note-taking sessions. 

‍

It also enables smooth collaboration among team members by allowing them to review interviews and contribute to the analysis, even if they weren't present.

‍

How to import a transcript to Qualitative Insights

‍

Watch the video 📽️ 👀

‍

You can add a transcript to a new or existing study in Qualitative Insights with just a few clicks. After recording an interview or user testing session, open your Qualitative Insights study and click ‘Sessions’ then ‘+ Transcript.’

‍

‍

Add a session title, any session information or a link to the video for future reference in the session information box. If you have created segments, choose which ones apply to this participant; you can update these later at any time. Then click ‘import transcript.’

‍

‍

Click ‘Select transcript’ and ensure you made any edits before importing it. This feature supports .vtt, .srt, or .txt files. Now, click Capture observations’ to complete the import and create and tag your observations.

‍

‍

You will see your transcript displayed. If you use a .vtt or .srt file, you will see the speaker names have been identified. You can update the speaker names by clicking on configure speakers.

‍

‍

How to create observations

‍

To create observations from your transcript, simply highlight text, enter a new tag or select an existing one, then click create an observation.

‍

‍

There is no limit to how many transcripts you can import. This means you can import all your past and future interviews, ensuring all your research data is in one place for easy access and analysis.

‍

Take the Qualitative Insights Academy Course 📚

‍

Qualitative Insights supports your entire qualitative research workflow, from conducting interviews and capturing observations to tagging and visualizing your data.   It keeps all your valuable user interviews and usability testing metadata in one place.

‍
To learn more about how to get the most out of Qualitative Insights, take the Qualitative Insights course at the Optimal Academy. In this short course, you'll learn how to set yourself and your team up to capture, tag, and group your observations to get to the insights faster.

What is session replay?

‍

Session replay allows you to record participants completing a card sort without the need for plug-ins or integrations. This great new feature captures the participant's interactions and creates a recording for each participant completing the card sort that you can view in your own time. It’s a great way to identify where users may have struggled to categorize information to correlate with the insights you find in your data.  

‍

Watch the video 📹 👀

‍

How does session replay work?

‍

• Session replay interacts with a study and nothing else. It does not include audio or face recording in the first release, but we’re working on it for the future.
  
• There is no set-up or plug-in required; you control the use of screen replay in the card sort settings.  
  
• For enterprise customers, the account admin will be required to turn this feature on for teams to access.
  
• Session replay is currently only available on card sort, but it’s coming soon to other study types.

‍

Help article 🩼

‍
Guide to using session replay

‍

How do you activate session replay?

‍

To activate session replay, create a card sort or open an existing card sort that has not yet been launched. Click on ‘set up,’ then ‘settings’; here, you will see the option to turn on session replay for your card sort. This feature will be off by default, and you must turn it on for each card study.

‍

‍

How do I view a session replay?

‍

To view a session replay of a card sort, go to Results > Participants > Select a participant > Session replay. 

‍

I can't see session replay in the card sort settings 👀

‍

If this is the case, you will need to reach out to your organization's account admin to ask for this to be activated at an organizational level. It’s really easy for session replay to be enabled or disabled by the organization admin just by navigating to Settings > Features > Session Replay, where it can be toggled on/off.