Flagging and Excluding Data
dscout is excited to announce two new features that will allow researchers to clean their data by flagging and excluding submissions and entries from their final analysis dataset in Recruit, Express, Diary, and Live.
Now, researchers can flag and/or exclude submissions and entries that fall into these categories:
- Dishonest content
- Inappropriate content
- Low effort
- Duplicate account
- Duplicate entries
- Technical errors
- Off-topic entries
Read on or click the links below for more information!
When reviewing entries and submissions in Recruit, Express, Diary, and Live, researchers can flag low-quality, dishonest, or inappropriate content. To flag, select an individual entry, submission, or interview and then click on the flag icon in the upper right hand corner, report the reason for flagging the entry and provide a comment, and then click on the blue "Flag entry" button. Our Support team reviews all flags and takes action as needed; any context you can provide about your flag in the comment field helps ensure our team takes the appropriate action.
Below we've included some examples for each of the flag types:
- Dishonest content: inconsistent answers within a submission, inability to provide proof of ownership for missions about specific products or items.
- Inappropriate content: rude or disrespectful language + media.
- Low effort: nonsensical answers or responses that suggest minimal to no effort was given.
- Duplicate account: finding two instances of the same person in your mission.
Flag in Recruit, Express, and Diary
Flag in Live
When an entry or application is flagged, our Support team will review your flag and take action as needed. This may include following up with the scout to share feedback or corrective actions; feel free to reach out to our Support team (email@example.com) if you ever have any questions or concerns!
If researchers want to hide entries or submissions from their data set for analysis, they can use the exclude data feature. They may choose to use this feature in conjunction with the flag data feature or on its own. Excluded data will not appear in any of the Entry views (such as the Entries Grid, Close-Ended Responses page, or Open-Ended responses page) and will not appear in any exports from that Diary or Live mission or screener. To exclude an entry or submission, select an individual entry, click on the exclude data icon in the upper right hand corner (next to the flag icon) and then confirm that the entry should be excluded.
Exclude in Recruit, Express, and Diary
Exclude in Live
Excluded data will not be deleted from the platform and researchers will be able to re-include any entries that may have been excluded accidentally. To re-include an excluded entry, click on the Excluded Entry icon in the upper right hand corner on the Entries Grid page, which will navigate you to the Excluded Entries grid. There, researchers will be able to go into individual entries and click the Re-include entry icon in the upper right hand corner, which will add it back to their main dataset, meaning the entry will be included in counts, exports, and summary charts.
Re-include in Recruit, Express, and Diary
Re-include in Live
Flagging and Excluding Data
Researchers can choose to flag and exclude entries or submissions at the same time. To do so, select the "Exclude this entry from my data set" checkbox after clicking on the flag data icon.