Tree Testing Updates: Improved Setup and Results

We’re excited to introduce the latest Tree Testing updates that give you more control over your studies by introducing new setup options for ease of use and new results views that enable you to make an in-depth analysis of your product.

Setup Improvements

Tree Test Creation

Set the correct answer/s: Define one or more correct answers for the tree test task.

• To set a correct answer, mark the checkbox next to the tree node that you want to set as the correct answer.

Add Tree in bulk: Import a tree test structure to Useberry

• To import a tree in your Useberry structure click the “Upload CSV file”, download the example file we provide, fill it up with your tree structure, save it as CSV, and then upload it.

Expand all / Collapse all: Expand or collapse the Tree structure with just one click.

Delete Tree: Delete a Tree quickly with just a click.

Shortcut tip: Use keyboard shortcuts to create a tree via the Useberry tree creator.

Tree Test Options

Show pages without root: This option enables you to either show or not show the tree root/home node to the participants.

• If this option is enabled the participant will not see the root/home element of your tree when they are taking the test.
• If this option is disabled the participant will see the root/home element of your tree when they are taking the test.

Tree Testing Results

Our updated Tree Testing results make it easier to draw meaningful conclusions and present findings to stakeholders.

Task Completion

You can now quickly see how many participants succeeded and how many did not succeed in selecting the correct answer.

• Succeeded: This stat shows the percentage of participants who clicked a correct answer for a tree test task.
  • Direct: Participants navigated directly down to the correct answer
  • Indirect: Participants who realized they were on the wrong path and later found their way to the right item. In other words, the participant took a different path before selecting the correct answer
• Non-Succeeded: This stat shows the percentage of participants who selected an incorrect item as the answer for the task, users that skipped the task, and users that dropped off during this task.
  • Fail: See the percentage of participants who selected an incorrect item as the answer for the task.
    • Direct: Participants navigated down to an incorrect item directly
    • Indirect: After going back up the tree and correcting their initial selection, participants still ended up selecting the wrong item
  • Skip: This stat indicates the percentage of participants who did not choose any destination but clicked “skip” instead.
    • Direct: Participants skipped the task by clicking the “skip” button without attempting to click through the tree
    • Indirect: Participants started to click through the tree before they clicked the “skip” button
  • Dropoff: This stat displays the percentage of participants who did not choose any destination but “dropped off” the test.
    • Direct: Participants dropped off by exiting the test without attempting to click through the tree
    • Indirect: Participants started to click through the tree before they dropped off the test

Views

First Click: The first click is an important indicator of whether a user can complete the task successfully or not. See which branches were clicked first and what % of participants did so. In addition, this view shows the % of participants that visited a branch at any point during the tree test.

• First Click: This column shows branches that participants clicked fist
• Visited First: Indicates the number of participants who clicked a branch first
• Visited During: Shows the number of participants who clicked a branch at any point during the tree test task
• % Switcher: Enable it to see % instead of the number of participants

Paths: Explore the paths participants took while taking this tree test task and better understand where they followed the correct or wrong path, skipped the tree test, or dropped off the test.

• Path: This column shows the path participants followed
• Type of Completion: Based on the path users took, the ‘Completion’ column shows if participants directly or indirectly succeeded, failed, skipped, or dropped off this tree test task.
• Participants: How many participants followed this path
• % Switcher: Enable it to see % instead of the number of participants

Destinations: This view indicates a breakdown of the nodes participants selected as the correct answer for this tree test task.

• Tree Structure: A presentation of the tree structure
• Destinations: This column shows how many participants selected a specific end node as their answer for the given tree test task
  • The blue cells indicate the correct answers you had set while creating the tree
• % Switcher: Enable it to see % instead of the number of participants

🤩 Updates and new features are available on all Useberry Plans.