Table of Contents

Unmoderated Prototype Tests (Beta)

Billy Dowell Updated by Billy Dowell

Using Unmoderated Prototype Tests

Need to conduct some unmoderated research?

Let's get you started!

If you have not reviewed Great Question Study Basics, it is recommended. 😊

Study Creation

First things first, you have to draft a study and get it ready to publish.

Draft Unmoderated Prototype Study View
Create the Study
  1. Click New study + at the top of the left sidebar menu. OR click New study in the top right corner, if in the Studies page.
  2. Select Unmoderated prorotype test.
Set the Plan
  1. Name your study via the Study title.
    1. By default, you will see the title as "Untitled study type (current date)"
  2. Optional: Change the study owner if you are creating this study on behalf of another team member by clicking on the Add Collaborator icon to the right of the study title.
  3. Optional: Add a description for the Research goal.
  4. Set your Participant limit.
  5. Toggle on the Recruit external candidates BETA feature if you want to recruit participants outside your panel. If not, leave the toggle off.
    1. Toggling this feature on or off does add or remove a tab called Recruiting, at the top, and automatically enables the Incentives and Screener toggles.
    2. When Incentives are enabled, the minimum inventive amount is set to $5, which is required by Respondent.
    3. Check out our External Participant Recruitment guide for more information on this feature and how to set it up.
  6. Leave the incentive toggled on if you want to offer an incentive. If not, flip the toggle off.
    1. Choose your incentive method.
      1. By default, you will see that Money or gift card is selected.
    2. Update the value that you want EACH participant to receive, if using Money or gift card.
      1. Your total funds required will be shown on the Review page.
      2. More on that step below.
    3. Choose whether you want to fund the study Through Great Question or Outside of Great Question.
      1. We partner with Tremendous to send incentives. To see what options are available for your participants, you can review Tremendous' catalog, searching by gift type, country, or currency.
    4. If choosing something other than Money or gift card, follow the prompts that are now shown.
Incentive options
  1. Leave the Screener toggle off if no screener is necessary. If you do want a screener, flip the toggle on.
    1. Toggling the screener on or off does add or remove a tab called Screener, at the top. More on screeners below.
  2. Select your preferred Consent form option.
    1. User the Preview button to see what your participants will see, based on the selected consent form option.
Consent form selection
  1. Optional: Click on Show additional setup to see more settings, such as:
    1. Custom study attributes: More on study attributes here.
    2. Participant experience language to change the preferred language.
  2. Click Next.
Create the Screener questions
If you left Screener toggled off, please skip to the next section - Set up your test.
For more details on screeners, see our Screeners and Surveys guide.
  1. Start by deciding the type of question/answers, and typing up your first question.
    1. Example: β€œDo you like donuts?” would most likely be a Yes/No question. β€œWhat type of donuts do you like?” could be Multi Select, where answers would need to be typed out, or could be Short Text, which allows the participant to type their answer.
    2. Changing the question type will not affect your typed out question, but can affect your typed out answer choices.
  2. Then create the answers, if needed.
  3. If you want the question to be required, to prevent the participant from skipping the question, toggle on the Required option at the top right of the question.
  4. Click Attribute and select/create an attribute if you want their reply to be created as an attribute value that will get added to their profile.
    1. More on candidate attributes here.
Question attribute button
  1. To duplicate the question, click on the Duplicate icon next to Required.
  2. To add more questions, click on the + under the first/previous question.
  3. To rearrange questions, click on the ⁝⁝ button in the top left of any question and drag and drop in the desired order.
  4. Click Skip logic to apply skip logic to each question, as needed.
    1. See Skip Logic and how to use it, for more details and steps.
Question skip logic button
  1. Question templates, or previously used questions, can also be viewed and used by clicking on Library in the top right corner, just under the Review tab (depending on screen size), and selecting the respective tab in the Library slideout.
Library preview
  1. Optional: Preview your screener by clicking on Preview in the top-right corner next to Library.
    1. Testing your screener from the preview will not submit anything to your study.
Preview button
Name and Email are required and automatically collected. They do not need to be dedicated questions.
Set up your Test - Welcome and Permissions

Update the Title and Description for your Welcome and Permissions blocks.

  • The title can be an introduction, question, or anything else that you think would be fitting for the first item they see for the test.
  • The description should provide brief information highlighting what they will be doing during the test.
  1. Select the Welcome block, if not already there.
    1. Optional: Update the Title.
      1. "Welcome" is the default title.
    2. Recommended: Update the Description.
      1. The description is not required, but is recommended to provide as much helpful information and direction as possible.
    3. Optional: Use the Preview button in the top right corner to see what the participant will see.
Unmoderated welcome block and preview
  1. Select the Permissions block.
    1. Optional: Update the Title.
      1. "Permissions" is the default title.
    2. Recommended: Update the Description.
      1. The description is not required, but is recommended to provide as much helpful information and direction as possible.
    3. Optional: Use the Preview button in the top right corner to see what the participant will see.
      1. You will need to click past the welcome step.
      2. The Enable buttons in the preview are not functional and are there to give you an idea of what the participant will see.
Unmoderated permissions block and preview
  1. Move on to...
    1. Set up your Test - Prototype test if you want to keep the protype test block as the next step in your test.
    2. Set up your Test - Other if you want to use other question types before the Prototype test.
Set up your Test - Prototype test

The Prototype test block is where you are going to import your Figma prototype and set up the flow that you want your participants to follow.

  1. Select the Prototype test block, if not already there.
  2. Update the Title.
    1. The title should be your question or task that you want the participant to complete during this step.
  3. Recommended: Update the Description.
    1. The description is used to provide as much helpful information and direction as possible that will be useful in completing the task.
Prototype test block
  1. Click + Add prototype to insert your prototype link.
    1. If this is the first time, you will be prompted to connect your Figma account.
    2. Review the modal that shows in the middle of the screen and click Connect.
    3. Review the popup that shows in a new window, confirm the email address shown is correct to ensure the right account is connected, and click Allow access.
      1. If the email is not correct, click Switch accounts.
    4. A new Add prototype modal will show, allowing you to paste in the link to your prototype.
Add prototype with Figma access flow
  1. Paste in the link to your prototype and click Import.
    1. Once imported, your prototype will be shown in a new Success section.
  2. Click on the START box in the Success section.
  3. Find the starting point of your prototype in the Select start screen modal and click Set as start screen.
Prototype Success Start view
  1. Click on the END box in the Success section.
  2. Find the end point for this step/task of your prototype in the Select goal screen modal and click Set as goal screen.
    1. This end point does not need to be the end of your prototype. It can be the first step that needs to be completed, such as searching for a flight. Additional prototype test blocks can be added to continue to the next step of your prototype.
Prototype Success End view
  1. Add another Prototype test block as needed for additional steps and tasks.
  2. Once added, repeat the steps above.
Add block prototype test
  1. Alternativley, you can use the β‹― menu to duplicate your prototype test and update the details as needed.
Duplicate prototype block
  1. Optional: Click on the ⁝⁝ drag and drop icon to rearragne your blocks.
Drag and drop blocks
  1. Update your Thank you block.
    1. Optional: Update the Title.
      1. "Thank you" is the default title.
    2. Optional: Update the Description.
      1. The description can be used to provide a more detailed thank you message.
Thank you block with preview
  1. Move on to...
    1. Set up your Test - Other if you want to use other question types.
    2. Review if you are not planning to add any other question types, or are done adding questions types and updating your prototype test.
Set up your Test - Other
  1. Click on + Add block.
  2. Review the other options in the list and add the question type that you want to show in your test.
    1. These options are the same as the questions types that you see for screeners and surveys, minus the Info question type.
Add other block types
  1. Update the Title.
    1. The title should be the question that you want to ask.
  2. Optional: Update the Description.
    1. The description for other question types is used to provide information that could be helpful in answering the question, or information about available answer choices.
  3. Optional: Toggle on the Required option if you want participants to be required to answer before proceeding to the next question or step.
  4. If using a question type that requires answer choices to be filled out in the Response section, fill those out.
    1. These include: Multi Select, Linear Scale, and Single Select
Other question type added with preview
  1. If using any other question type, the participant will fill out the Response section.
Other question type added with preview
  1. Optional: Use the Preview button in the top right corner to see what the participant will see.
    1. You will need to click past the previous steps to see each added question.
  2. Optional: Click on the ⁝⁝ drag and drop icon to rearragne your blocks.
Drag and drop blocks
  1. Update your Thank you block.
    1. Optional: Update the Title.
      1. "Thank you" is the default title.
    2. Optional: Update the Description.
      1. The description can be used to provide a more detailed thank you message.
Thank you block with preview
  1. Move on to...
    1. Review if you are not done adding your protype and other question types.
    2. Set up your Test - Prototype test if you now want to update protype test block as the next step in your test.
Review
  1. Review the details of your study. You should see all green checkmarks.
    1. If you added an incentive but did not use Money or gift card, you will not see any incentive details to review.
    2. If you added an incentive, used Money or gift card, and chose Outside of Great Question, you will not see any incentive details to review.
    3. If you added an incentive, used Money or gift card, and chose Through Great Question, you will see the amount of funds needed for the study.
  2. If a step does not have a green checkmark, review the details as to why, and click on the edit icon to go back to that step's page and make the required updates.
Unfinished draft steps
  1. Once everything is all green, review the incentives budget to confirm everything looks correct, based on the details in the Incentives Budget section.
  2. Click Create or Create & Fund $$$.
    1. If you are funding your incentives through Great Question, you will be prompted to select a funding method and add funds.
  3. Done! Study published! πŸ™Œ
Incentives Budget

The incentives budget is calculated by the number of participants you want to talk to and the total incentive amount per participant.

  • Example: If you have a participant limit of 5, an incentive amount of $5, the budget will be $25.
    • 5 participants times the $5 incentive.

Post Publish Features

Some steps and images below, outside the details about the Unmoderated Test itself, may be a little inaccurate but will be updated soon! Thank you for your patience and understanding. :)

Once your study has been published, you will see a few more features to review.

Please also check out our blog post for some great information and best practices: How to set & achieve research goals without a research team.

Sections below are in the order of the menu options within the study and image below.

Post Publish Features
Overview

To make notes and recording research findings about your study, you can use the Overview tab.

  • Changes are automatically saved.
Plan

Similar to the plan during the drafting phase above.

  • Offer an incentive is the only option that cannot be changed once invitations have been sent to participants.
  • To manage incentives before invitations are sent:
    • If you are already in the Plan, click Manage incentives under Incentives.
      • You can also click on Incentives on the left-side menu, if you are not already in the Plan.
    • Click Edit and update the incentive options as needed.
    • Click Save.
    • Review details in the popup modal and select the funding method.
    • Click Confirm.
Incentives creation post publish
Screener
If you left Screener toggled off, and do not plan to use a screener, please skip to the next section - Test.πŸ“

If you need to review or edit your screener, you can make any changes in the Screener tab.

  • If you decide to add a screener later, toggle on the screener option in the Plan tab.
More on screeners in our Screeners and Surveys guide.

To make edits, just start making changes as needed. All changes are saved automatically and noted by a green popup.

  • Reminder: Preview your study by clicking on Preview, in the top right corner, next to Library.

See Screener Responses below to see where to find the screener data.

Test

See the three set up steps above:

Emails

This is where all of your study's emails live, and is where you can preview and edit them.

Unmoderated study emails

Button layout may be different depending on screen and window size

Updates to the study email templates do not change the templates that are saved in Email templates.

Each email has the option to be changed from Branded HTML Layout to Rich Text Format (RTF) via the Email Design dropdown.

  • At this time, this must be done for each email type, per study. There is no bulk option for all emails on a study, and no bulk option to apply across all studies for the account.
  • The Email Design can also be changed per email as you are getting ready to send, vs changing the study's default.
Email design choices

Within invitation email templates, you will see study.live_stream_disclaimer. The disclaimer is in all default invitation email templates, but is only applied to Customer Interview, Continuous Interview, and Focus Group studies.

Preview your emails by clicking the Preview button, next to Save changes.

  • If you have made any edits, save them first, and then preview. Only saved changes will show in the preview.
  • Send myself a test email will send a preview email that will say [Preview] in the subject line.
    • These emails do not contain active links for the CTA, and are for reviewing purposes only.
    • The text "This email is intended for:..." is not included in the real emails that are sent to your participants.
  • View in browser will open a preview in a new tab, and is used to review the body of the email.
Email preview options
To change the default sender for all emails, update your Default Email Sender in your profile, explained in our Setting Up Your Personal Profile guide.
Pages

You can review and edit your landing page.

  • Landing page is what participants will see when being invited to the study via email, or when sent the link via the Invite via link option.

Edit the landing page by clicking the Edit button.

  • Changes are saved when clicking Save changes in the top right corner of the edit view.
  • At this time, the options with checkboxes cannot be edited, but can be hidden when unchecked.
Unmoderated pages

Button layout may be different depending on screen and window size

Participants

This is where you will be able to add candidates to your shortlist, manage your participants, and track their progress.

  • The Participants tab is your default landing space when opening a study, but you can also get back to it by clicking on Participants.
  • To start, you can add candidates to your shortlist via the three options that are shown.
  • The sub-tabs you see are based on what invitations have been sent and the status of the participants.
    • Possible options are: Shortlisted, Sent screener, Applied, Invited, Completed, Canceled, Removed, Opted out.
    • Example: Applied will show once a participant has completed a screener and has been move to the applied status.
Unmoderated participants view

Button layout may be different depending on screen and window size

When sending emails to multiple participants, you can choose to send emails in batches and/or send continuous invites as slots become available.

  • Batch invites send a set number of emails at a set interval, and will send them all out until the batch is complete, or until the all available slots are full.
    • Example: You can choose to send 2 invites every 4 hours until the batch is complete, or the slots are full.
    • These invites will not start again as slots become available if this setting is used on its own.
  • Continuous invites send out emails based on the group of participants selected, and will send until all available slots are full. Once more slots become available, emails will start going out again to the remaining participants from the original selected group.
    • Example: Invites will start going out again when slots become available due to participant limit updates.
  • These options are not available for Screener Invites at this time. Only for sending Participant invites.
Participant email send options
More on managing your participants in our Participant Management for Unmoderated Studies guide!
Screener Responses
If you left Screener toggled off in the Plan step, and do not plan to use a screener, please skip to the next section - Recruitment Requests.

Sub-tabs shown (once there are replies) are:

  • Summary: results of participant responses
  • Individual: individual participant responses (shown as participants submit screeners)
Unmoderated screener responses view

Button layout may be different depending on screen and window size

Use the Export to CSV button to export your participants' screener response data into a CSV file.

  • The file will be sent to your device's downloads folder, or the folder that you have specified via your browser.
  • The export includes the same data when clicked from either page.
Recruitment Requests

Review or setup new external participant requests here.

Recruitment requests view

Button layout may be different depending on screen and window size

Stats

Review your study's email stats and performance.

Unmoderated stats view
Tags

Create and manage study and global tags that apply to your study's research results.

Unmoderated tags view
Synthesis

The synthesis section allows you to add your highlights into themed groups of learnings, enabling better extraction of research insights.

Unmoderated synthesis view
Repository

This is the study level repository. Review your study's insights, reels, highlights, and interviews that are specific to the study you are viewing.

  • Each can be viewed by their respective sub-tab, or all at once in the All sub-tab.
  • Use the Search, Filter, and View options to narrow down your results, and change how they are displayed and sorted.
  • Click on New to create a new insight, video upload (interview room), or reel.
  • All of this data can also be found in the full Repository.
Unmoderated repository view

Button layout may be different depending on screen and window size

Automations

Review the different options that you want to automatically happen, such as marking a participant as completed and sending them their incentive (if incentives are enabled).

  • As seen in the example below, these options are disabled by default, except for Create an internal calendar event for new bookings, which is the same as an "Observer event", in situations where you have not added an observer yet, but still want a separate event to share.
  • At this time, there is no automated reminder email for screener invites. Screener reminders must be sent manually by checking the user's name(s), clicking Compose, and then Resend screener...
Unmoderated automations view
Notifications

Review the different notification options that you would like to receive via email.

  • Some notifications only show depending on enabled settings, such as incentives and screeners.
  • All options are enabled by default.
  • If you have Slack integrated, you will see another section for these notifications as well.
Unmoderated notifications view

Have Questions?

Please reach out to us in the chat or at [email protected]!

How did we do?

Online Task Studies

Contact