Study Settings: Data Integrity
The Data Integrity section of Study Settings provides a centralized location for tools that help researchers monitor the quality and integrity of participant contributions. By utilizing these tools, Administrators can streamline the detection of questionable submissions created by AI, easing the review process and ensuring that decision-making is based on authentic and high-quality data.
Block Pasting
The Block Pasting settings allows Admins to restrict participants from pasting external content on Task responses and Discussion contributions. It is always possible to override the default when configuring an individual Task or Discussion Topic.
Integrity Alerts
The AI media detection toggle allows Analysts and Moderators to monitor the authenticity of participant contributions. When enabled, participant-uploaded photos and videos will be evaluated for any signals that suggest the media has been generated using AI.
AI media detection is enabled by default for new studies and can be disabled at the study level at any time. When enabled for a study, it is also enabled by default for new Multimedia tasks. Admins can turn it off for individual tasks where the check is not required.
If a response is flagged as containing AI-generated content, a notification will be sent to the selected study Administrators. Selected recipients will receive immediate notification both in-app and via email.
Detection and notifications are configured independently, allowing flexibility in how you monitor alerts. Admins can leave AI Media Detection enabled while choosing not to notify anyone by deselecting all options, keeping flagged responses available for review without actively pushing each detection to the study team.
Reviewing Integrity Alerts
In addition to triggering a notification, flagged media responses will also display a warning message indicating that AI-generated content has been detected. This allows Admins to easily spot flagged responses and consider the submission in context before deciding whether any follow-up is necessary.
If the Admin reviews the response and determines that the signal is not meaningful or does not require further attention, they can click Accept to clear the alert. Once accepted, the Integrity Alert and all associated AI detection tags will be removed from the response.
If a response requires action, Admins may consider rejecting, editing, or deleting the response.
Task Configuration
When configuring a Task, the options to Block pasting of external content and Detect AI-generated photos and videos will appear under the Task’s Advanced settings. These checkboxes reflect the Task-level study default, but Admins can override the default for that specific Task.
Discussion Topic Configuration
When configuring an individual Discussion Topic, Admins will also see a checkbox labelled Block pasting of external content beneath Topic Settings, which reflects the Discussion-level study default. As with Task responses, Admins can override this default for a specific Topic, if desired. The configuration will apply to all Replies and Comments within the Topic.
