Unmoderated Prototype Tests

Using Unmoderated Prototype Tests

Need to conduct some unmoderated research?

Let's get you started!

Study Creation

First things first, you have to draft a study and get it ready to publish.

Create the Study

1. Click New study + at the top of the left sidebar menu. OR click New study in the top right corner, if in the Studies page.
2. Select Unmoderated prototype test.

Set the Plan

1. Name your study via the Study title.
   1. By default, you will see the title as "Untitled study type (current date)"
2. Optional: Change the study owner if you are creating this study on behalf of another team member by clicking on the Add Collaborator icon to the right of the study title.
3. Optional: Add a description for the Research goal.
4. Set your Participant limit.
5. Toggle on the Recruit external candidates BETA feature if you want to recruit participants outside your panel. If not, leave the toggle off.
   1. Toggling this feature on or off does add or remove a tab called Recruiting, at the top, and automatically enables the Incentives and Screener toggles.
   2. When Incentives are enabled, the minimum inventive amount is set to $5, which is required by Respondent.
   3. Check out our External Participant Recruitment guide for more information on this feature and how to set it up.
6. Leave the incentive toggled on if you want to offer an incentive. If not, flip the toggle off.
   1. Choose your incentive method.
      1. By default, you will see that Money or gift card is selected.
   2. Update the value that you want EACH participant to receive, if using Money or gift card.
      1. Your total funds required will be shown on the Review page.
      2. More on that step below.
   3. Choose whether you want to fund the study Through Great Question or Outside of Great Question.
      1. We partner with Tremendous to send incentives. To see what options are available for your participants, you can review Tremendous' catalog, searching by gift type, country, or currency.
   4. If choosing something other than Money or gift card, follow the prompts that are now shown.

1. Leave the Screener toggle off if no screener is necessary. If you do want a screener, flip the toggle on.
   1. Toggling the screener on or off does add or remove a tab called Screener, at the top. More on screeners below.
2. Select your preferred Consent form option.
   1. User the Preview button to see what your participants will see, based on the selected consent form option.

1. Optional: Click on Show additional setup to see more settings, such as:
   1. Custom study attributes: More on study attributes here.
   2. Automatically release participant slots: Determine when slots should be reopened after someone has started their participation.
      1. If a participant starts your study but does not finish within the specified time, their slot will be released. If they eventually attempt to complete the study they will still be able to do so. This can result in more participants being able to complete than your participant limit is set for.
      2. 1 hour is the default setting for all studies.

         

   3. Participant experience language to change the preferred language.
2. Click Next.

Create the Screener questions

1. Start by deciding the type of question/answers, and typing up your first question.
   1. Example: “Do you like donuts?” would most likely be a Yes/No question. “What type of donuts do you like?” could be Multi Select, where answers would need to be typed out, or could be Short Text, which allows the participant to type their answer.
   2. Changing the question type will not affect your typed out question, but can affect your typed out answer choices.
2. Then create the answers, if needed.
3. If you want the question to be required, to prevent the participant from skipping the question, toggle on the Required option at the top right of the question.
4. Click Attribute and select/create an attribute if you want their reply to be created as an attribute value that will get added to their profile.
   1. More on candidate attributes here.

1. To duplicate the question, click on the Duplicate icon next to Required.
2. To add more questions, click on the + under the first/previous question.
3. To rearrange questions, click on the ⁝⁝ button in the top left of any question and drag and drop in the desired order.
4. Click Skip logic to apply skip logic to each question, as needed.
   1. See Skip Logic and how to use it, for more details and steps.

1. Question templates, or previously used questions, can also be viewed and used by clicking on Library in the top right corner, just under the Review tab (depending on screen size), and selecting the respective tab in the Library slideout.

1. Optional: Preview your screener by clicking on Preview in the top-right corner next to Library.
   1. Testing your screener from the preview will not submit anything to your study.

Set up your Test - Welcome and Permissions

Update the Title and Description for your Welcome and Permissions blocks.

• The title can be an introduction, question, or anything else that you think would be fitting for the first item they see for the test.
• The description should provide brief information highlighting what they will be doing during the test.

1. Select the Welcome block, if not already there.
   1. Optional: Update the Title.
      1. "Welcome" is the default title.
   2. Recommended: Update the Description.
      1. The description is not required, but is recommended to provide as much helpful information and direction as possible.
   3. Optional: Use the Preview button in the top right corner to see what the participant will see.

1. Select the Permissions block.
   1. Optional: Update the Title.
      1. "Permissions" is the default title.
   2. Recommended: Update the Description.
      1. The description is not required, but is recommended to provide as much helpful information and direction as possible.
   3. Select which type of device your test will need to be conducted on.
      1. Desktop (default)
         1. Can be conducted on a dekstop or laptop.

            

      2. Mobile
         1. Can be conducted on smartphones and tablets.
         2. Due to screen recording limits on mobile devices, the screen sharing will not be available. The recording will only include microphone and camera.

            

   4. Optional: Use the Preview button in the top right corner to see what the participant will see.
      1. You will need to click past the welcome step.
      2. The Enable buttons in the preview are not functional and are there to give you an idea of what the participant will see.
2. Move on to...
   1. Set up your Test - Prototype test if you want to use the prototype test block as the next step in your test.
   2. Set up your Test - Website test (codeless) if you want to use website testing as the next step in your test.
   3. Set up your Test - Other if you want to use other question types before the Prototype test.

Set up your Test - Prototype test

The Prototype test block is where you are going to import your Figma prototype and set up the flow that you want your participants to follow.

1. Select the Prototype test block, if not already there.
2. Update the Title.
   1. The title should be your question or task that you want the participant to complete during this step.
3. Recommended: Update the Description.
   1. The description is used to provide as much helpful information and direction as possible that will be useful in completing the task.

1. Click + Add prototype to insert your prototype link.
   1. If this is the first time, you will be prompted to connect your Figma account.
   2. Review the modal that shows in the middle of the screen and click Connect.
   3. Review the popup that shows in a new window, confirm the email address shown is correct to ensure the right account is connected, and click Allow access.
      1. If the email is not correct, click Switch accounts.
   4. A new Add prototype modal will show, allowing you to paste in the link to your prototype.

1. Paste in the link to your prototype and click Import.
   1. Once imported, your prototype will be shown in a new Success section.
2. Click on the START box in the Success section.
3. Find the starting point of your prototype in the Select start screen modal and click Set as start screen.

1. Click on the END box in the Success section.
2. Find the end point for this step/task of your prototype in the Select goal screen modal and click Set as goal screen.
   1. This end point does not need to be the end of your prototype. It can be the first step that needs to be completed, such as searching for a flight. Additional prototype test blocks can be added to continue to the next step of your prototype.

1. Add another Prototype test block as needed for additional steps and tasks.
2. Once added, repeat the steps above.

1. Alternativley, you can use the ⋯ menu to duplicate your prototype test and update the details as needed.

1. Optional: Click on the ⁝⁝ drag and drop icon to rearragne your blocks.

1. Update your Thank you block.
   1. Optional: Update the Title.
      1. "Thank you" is the default title.
   2. Optional: Update the Description.
      1. The description can be used to provide a more detailed thank you message.

1. Move on to...
   1. Set up your Test - Website test (codeless) if you want to use website testing as the next step in your test.
   2. Set up your Test - Other if you want to use other question types.
   3. Review if you are not planning to add any other question types, or are done adding questions types and updating your prototype test.

Set up your Test - Website test (codeless)

The Website test (codeless) block is where you are going to paste in the URL for the website that you would like your participants to test.

1. Select the Website test (codeless) block, if not already there.
2. Update the Title.
   1. The title should be your question or task that you want the participant to complete during this step.
3. Recommended: Update the Description.
   1. The description is used to provide as much helpful information and direction as possible that will be useful in completing the task.
4. Add your website URL.
   1. If the website supports being placed in an iframe, the website will be presented in the same tab as the rest of the study.

      

   2. If the website does not support being placed in an iframe, the website will be opened in a new tab. An alert will be presented to let participants know to share their entire screen.

      

5. Add another Website test (codeless) block as needed for additional steps and tasks.
6. Alternativley, you can use the ⋯ menu to duplicate your block and update the details as needed.
7. Optional: Click on the ⁝⁝ drag and drop icon to rearragne your blocks.
8. Move on to...
   1. Set up your Test - Prototype test if you want to keep the protype test block as the next step in your test.
   2. Set up your Test - Other if you want to use other question types in your test.
   3. Review if you are not planning to add any other question types, or are done adding questions types and updating your prototype test.

Set up your Test - Other

1. Click on + Add block.
2. Review the other options in the list and add the question type that you want to show in your test.
   1. These options are the same as the questions types that you see for screeners and surveys, minus the Info question type.

1. Update the Title.
   1. The title should be the question that you want to ask.
2. Optional: Update the Description.
   1. The description for other question types is used to provide information that could be helpful in answering the question, or information about available answer choices.
3. Optional: Toggle on the Required option if you want participants to be required to answer before proceeding to the next question or step.
4. If using a question type that requires answer choices to be filled out in the Response section, fill those out.
   1. These include: Multi Select, Linear Scale, and Single Select

1. If using any other question type, the participant will fill out the Response section.

1. Optional: Use the Preview button in the top right corner to see what the participant will see.
   1. You will need to click past the previous steps to see each added question.
2. Optional: Click on the ⁝⁝ drag and drop icon to rearragne your blocks.

1. Update your Thank you block.
   1. Optional: Update the Title.
      1. "Thank you" is the default title.
   2. Optional: Update the Description.
      1. The description can be used to provide a more detailed thank you message.

1. Move on to...
   1. Review if you are not done adding your protype and other question types.
   2. Set up your Test - Prototype test if you now want to add a protype test block as the next step in your test.
   3. Set up your Test - Website test (codeless) if you want to use website testing as the next step in your test.

Review

1. Review the details of your study. You should see all green checkmarks.
   1. If you added an incentive but did not use Money or gift card, you will not see any incentive details to review.
   2. If you added an incentive, used Money or gift card, and chose Outside of Great Question, you will not see any incentive details to review.
   3. If you added an incentive, used Money or gift card, and chose Through Great Question, you will see the amount of funds needed for the study.
2. If a step does not have a green checkmark, review the details as to why, and click on the edit icon to go back to that step's page and make the required updates.

1. Once everything is all green, review the incentives budget to confirm everything looks correct, based on the details in the Incentives Budget section.
2. Click Create or Create & Fund $$$.
   1. If you are funding your incentives through Great Question, you will be prompted to select a funding method and add funds.
3. Done! Study published! 🙌

Incentives Budget

The incentives budget is calculated by the number of participants you want to talk to and the total incentive amount per participant.

• Example: If you have a participant limit of 5, an incentive amount of $5, the budget will be $25.
  • 5 participants times the $5 incentive.

Post Publish Features

Once your study has been published, you will see a few more features to review.

Please also check out our blog post for some great information and best practices: How to set & achieve research goals without a research team.

Sections below are in the order of the menu options within the study and image below.

Overview

To make notes and recording research findings about your study, you can use the Overview tab.

• Changes are automatically saved.

Plan

Similar to the plan during the drafting phase above.

• Offer an incentive is the only option that cannot be changed once invitations have been sent to participants.
• To manage incentives before invitations are sent:
  • If you are already in the Plan, click Manage incentives under Incentives.
    • You can also click on Incentives on the left-side menu, if you are not already in the Plan.
  • Click Edit and update the incentive options as needed.
  • Click Save.
  • Review details in the popup modal and select the funding method.
  • Click Confirm.

Screener

If you need to review or edit your screener, you can make any changes in the Screener tab.

• If you decide to add a screener later, toggle on the screener option in the Plan tab.

To make edits, just start making changes as needed. All changes are saved automatically and noted by a green popup.

• Reminder: Preview your study by clicking on Preview, in the top right corner, next to Library.

See Screener Responses below to see where to find the screener data.

Test

See the three set up steps above:

• Set up your Test - Welcome and Permission
• Set up your Test - Prototype test
• Set up your Test - Other

Emails

This is where all of your study's emails live, and is where you can preview and edit them.

Updates to the study email templates do not change the templates that are saved in Email templates.

Each email has the option to be changed from Branded HTML Layout to Rich Text Format (RTF) via the Email Design dropdown.

• At this time, this must be done for each email type, per study. There is no bulk option for all emails on a study, and no bulk option to apply across all studies for the account.
• The Email Design can also be changed per email as you are getting ready to send, vs changing the study's default.

Within invitation email templates, you will see study.live_stream_disclaimer. The disclaimer is in all default invitation email templates, but is only applied to Customer Interview, Continuous Interview, and Focus Group studies.

Preview your emails by clicking the Preview button, next to Save changes.

• If you have made any edits, save them first, and then preview. Only saved changes will show in the preview.
• Send myself a test email will send a preview email that will say [Preview] in the subject line.
  • These emails do not contain active links for the CTA, and are for reviewing purposes only.
  • The text "This email is intended for:..." is not included in the real emails that are sent to your participants.
• View in browser will open a preview in a new tab, and is used to review the body of the email.

Pages

You can review and edit your landing page.

• Landing page is what participants will see when being invited to the study via email, or when sent the link via the Invite via link option.

Edit the landing page by clicking the Edit button.

• Changes are saved when clicking Save changes in the top right corner of the edit view.
• At this time, the options with checkboxes cannot be edited, but can be hidden when unchecked.

Participants

This is where you will be able to add candidates to your shortlist, manage your participants, and track their progress.

• The Participants tab is your default landing space when opening a study, but you can also get back to it by clicking on Participants.
• To start, you can add candidates to your shortlist via the three options that are shown.
  • Or by using Participant Segments.
• The sub-tabs you see are based on what invitations have been sent and the status of the participants.
  • Possible options are: Shortlisted, Sent screener, Applied, Invited, Completed, Canceled, Removed, Opted out.
  • Example: Applied will show once a participant has completed a screener and has been move to the applied status.

When sending emails to multiple participants, you can choose to send emails in batches and/or send continuous invites as slots become available.

• Batch invites send a set number of emails at a set interval, and will send them all out until the batch is complete, or until the all available slots are full.
  • Example: You can choose to send 2 invites every 4 hours until the batch is complete, or the slots are full.
  • These invites will not start again as slots become available if this setting is used on its own.
• Continuous invites send out emails based on the group of participants selected, and will send until all available slots are full. Once more slots become available, emails will start going out again to the remaining participants from the original selected group.
  • Example: Invites will start going out again when slots become available due to participant limit updates.
• These options are not available for Screener Invites at this time. Only for sending Participant invites.

Screener Responses

Sub-tabs shown (once there are replies) are:

• Summary: results of participant responses
• Individual: individual participant responses (shown as participants submit screeners)

Use the Export to CSV button to export your participants' screener response data into a CSV file.

• The file will be sent to your device's downloads folder, or the folder that you have specified via your browser.
• The export includes the same data when clicked from either page.

Recruitment Requests

Review or setup new external participant requests here.

• Check out our External Participant Recruitment guide for more information on this feature and how to set it up.

Stats

Review your study's email stats and performance.

• More information on this feature in our Recruitment Email Statistics guide.

Tags

Create and manage study and global tags that apply to your study's research results.

• More on Tags in our All about managing tags guide.

Synthesis

The synthesis section allows you to add your highlights into themed groups of learnings, enabling better extraction of research insights.

• More in our Synthesis guide.

Repository

This is the study level repository. Review your study's insights, reels, highlights, and interviews that are specific to the study you are viewing.

• Each can be viewed by their respective sub-tab, or all at once in the All sub-tab.
• Use the Search, Filter, and View options to narrow down your results, and change how they are displayed and sorted.
• Click on New to create a new insight, video upload (interview room), or reel.
• All of this data can also be found in the full Repository.

  

• Success - Percentage of responses that reached the goal screen
• Incomplete - Percentage of responses that failed to reach the goal screen
• Avg clicks to goal - Average number of clicks it took to reach the goal screen
• Misclick rate - The number of clicks outside hotspots or clickable areas (e.g. buttons or links that trigger actions) as a percentage of total clicks
• Avg duration - How long it took users to reach the goal screen, on average

Automations

Review the different options that you want to automatically happen, such as marking a participant as completed and sending them their incentive (if incentives are enabled).

• As seen in the example below, these options are disabled by default, except for Create an internal calendar event for new bookings, which is the same as an "Observer event", in situations where you have not added an observer yet, but still want a separate event to share.
• At this time, there is no automated reminder email for screener invites. Screener reminders must be sent manually by checking the user's name(s), clicking Compose, and then Resend screener...

Notifications

Review the different notification options that you would like to receive via email.

• Some notifications only show depending on enabled settings, such as incentives and screeners.
• All options are enabled by default.
• If you have Slack integrated, you will see another section for these notifications as well.

Have Questions?

Please reach out to us in the chat or at [email protected]!