This is the third part in a series on how to run a usability test on Dscout. This article walks you through the process of designing your usability test using the Create tab of your mission.
Contents
Create tab
Instructions
Questions
Usability question types
Usability question and recording duration limits
Thank You
Test and Launch your mission
Create tab
Use the Create tab to design your question script. Provide mission instructions and add tasks and questions. Only participants who are eligible based on your screening questions or participants added directly to the usability test will answer these questions.
Instructions
The "Instructions" section previews what scouts will see after completing the Recruit portion of—and qualifying for—your usability test. You can include custom instructions if desired.
To include custom instructions, tap Instructions, toggle on Custom message, and include your custom message text.
Questions
To add questions to your mission, move to the Questions section of the Create tab, select the Add button, and choose a question type.
You’ll have access to standard survey questions and two usability-specific questions.
- Standard Survey Questions: Typed response, Instructions, Scale, Ranking, Number, Card Sort, and Question Groups.
- Usability Questions: Task and Talk out loud questions.
After adding a question to your mission, customize the question settings and advanced programming options for that question on the right-hand side.
Advanced programming options:
- You can include skip logic in your mission to jump scouts to different questions based on their answers to a previous question.
- Attach up to 5 pieces of Question Stimuli (not available in task or screen recording questions).
- Add question groups to organize your mission and to facilitate question randomization.
- Enable answer choice randomization in the question settings.
For a full breakdown of each question type, question description, and which activity it is available in, check out Question Types in Express.
You can re-arrange questions added to your mission by dragging and changing the question order on the left-hand side or within the Questions view.
Usability question types
Usability tests on Dscout include two unique question types: Task questions and Talk out loud questions.
Task questions
Use a task question when you want the participant to complete a specific task on a live website, prototype, app, etc.
Task questions include a prompt to complete an action and have the option to include a URL or prototype link attached to each task. If a URL or prototype link is included on the task, participants will be directed to this link automatically when the task is introduced. Task questions allow you to capture usability metrics such as Time-on-task, user-reported, success, auto success (web URL and Figma screen), SEQ score, and clicks.
Learn more: How to use Task Questions in an Express Usability Test
Talk out loud questions
In a Talk out loud question, participants verbalize their thoughts, feelings, or decision-making processes. Participants will be prompted to answer a question out loud, resulting in transcript and video responses. This is a great option for having participants give their reactions to stim or answer open-ended questions verbally.
Usability question and recording duration limits
While there isn’t a limit to the number of total questions you can include in a usability mission, there are a few constraints to be aware of.
- Desktop usability tests are continuously recorded, and participants can complete up to 15 task questions.
- Mobile usability:
- When recording the entire mission, you can include up to 15 task questions with a total recording time of up to 40 minutes. After 40 minutes, the participant will no longer be recorded even if they continue to go through and answer questions in your mission.
- When recording tasks only, you can include up to 10 task questions, with each task question having a 10-minute recording limit.
An important note on participant fatigue: Participants can experience test fatigue in as little as 15 to 25 minutes, especially during unmoderated testing. Time limits are important to respecting participants' time and getting the best data. To prevent test fatigue, you should consider limiting the duration of your test. Stay focused on your goal and research hypothesis, and consider breaking a long test into shorter ones if needed.
Thank You
Tap the "Thank You" section in the left-hand panel to view what scouts see when they complete your Express Mission. Similar to the "Instructions" section, you'll see a Settings menu in the right-hand panel where you'll have the ability to write a custom thank you message for scouts.
Test and Launch your mission
Once you have finalized your test design, preview or test the mission to ensure everything is working as expected. You can then submit your mission for review or launch the mission.
Once you launch your mission, participants may begin submitting entries which will appear on your mission's Analyze tab. Entries are put on a 7-day payment hold. During this time, you may review the entry to ensure the participant appropriately responded to all mission prompts. After 7 days, the payment will be automatically released to the participant unless you or your team flags it as low quality. Note that participants you invite through a share link will not be paid by Dscout.
Read more about analyzing your usability test and Flagging and Excluding Data.
Next up: Step 4: Analyzing a Usability Test