Introduction to AI Questions

AI Questions simplifies the shift from data collection to analysis by enabling you to ask open-ended questions directly within your study data. It efficiently processes large volumes of participant responses, delivering AI-generated answers backed by verbatim quotes, ensuring reliable, unbiased insights.

With AI Questions, you reduce the chances of missing critical insights, as it identifies relevant responses to crucial research questions and prioritizes areas for deeper analysis. The feature highlights impactful findings, uncovers unique contributions for exploring unexpected trends, and ensures key participant quotes are included in your final report. This makes the research process more accessible, efficient, and comprehensive, resulting in stronger, more insightful outcomes.

• Using AI Questions
• Question History
• Important Considerations
• FAQs

Using AI Questions

As you moderate within your study, Analysts and Moderators will see a purple tab on the right-hand side of the page labeled Ask AI. Once participant responses have been received, Admins can open the tab to set the context of their question.  

💡 AI Questions includes data from all task responses in Standard and Journal activities. This includes:

• All text-based responses 
• Audio/Video/Screen recording transcripts
• Media captions and annotations

Filter Data

• Instead of asking: “What was the most common brand participants mentioned in Activity B?”
• Set the Filter to Activity B, then ask: “What was the most common brand participants mentioned?”

Use of Mentions

Generate an Answer

See How to Ask Great Questions for tips and best practices on leveraging AI Questions. 

Once the question has been submitted, AI Questions will generate an Answer, which can be formatted in several ways, including lists, tables, etc. On this tab, Admins can:

1. Provide a rating and share feedback with Recollective
2. Copy the Answer
3. Ask a follow-up question

When asking follow-up questions, the corresponding answers will be limited to the filters defined in the initial question. Users cannot change the filters within the chat. However, users can leverage @mentions, depending on the applied filters, to focus their follow-up questions on specific participants or segment groups.

Follow-up questions may pertain to previous questions/answers in the chat or be completely unrelated. However, the AI will try to use previous answers as context by default. 

Review Verbatims

By clicking on the ‘ View Verbatims’ button, admins can see all of the responses that the AI used to generate that answer. You can review the full response a verbatim was taken from by clicking ‘View Source’.

 Each verbatim is rated by its relevance to the answer, which is indicated by a score of 1 to 4. Each score is defined below:

• Highly Relevant (●●●●): The verbatim is very relevant and directly supports the answer.
• Relevant (●●●): The verbatim is relevant and contributes to the answer.
• Slightly Relevant (●●): The verbatim was considered in forming the answer, but may not be directly referenced.
• Low Relevance (●): The verbatim was used in generating the answer, but may not relate to the final answer.

While verbatims are listed individually by default, you may also choose to group verbatims sourced from the same participant's response. 

Chat History

Admins will also see options to create a New Chat or access previous questions saved in the Chat History to keep track of previous question threads. Each historical chat will be labelled by the first question asked within the chat. Upon entering a historical chat, users can continue asking questions where they left off. 

Important Notes for Using AI Questions

AI Questions is a powerful tool designed to enhance your data analysis experience. While we are constantly improving our AI to serve you better, here are some key points to keep in mind:

• Supported Activities: Currently, only Standard and Journal Activities are supported.
• Data Inclusion: Data collected before the availability of this feature may not be included in the analysis. For affected studies, the timeframe of included data will be identified within the AI Questions panel from your study.
• Verbatim References: The AI may list some verbatims that informed the response, even if they are not directly mentioned in the answer.
• Accuracy: While AI Questions aims for high accuracy, it may occasionally make errors. Your feedback is crucial in helping us refine and improve this feature.

Frequently Asked Questions

For questions surrounding Recollective AI data security, please refer to Recollective AI: Privacy & Data Security FAQ. 

• What data will be referenced by AI Questions on my site? 
  All new data collected in Standard and Journal activities will be automatically included, along with some historical data. Data from currently archived studies will not be included. AI Questions also does not ingest Discussions and Live Video Activities at this time; however, these needs are being considered for our future roadmap.
• Which Task types should I use to leverage AI Questions? 
  AI Questions will support any task type that includes text responses, transcripts, or captions. As the AI cannot currently analyze visual media, ensure that participants provide photo responses with accompanying text captions and video responses that can be transcribed. 
• Does AI Questions offer real-time analysis? 
  Yes! New responses will be included to generate answers. This will allow you to ask questions as data comes in or after the study is complete.
• Can I ask AI questions about frequencies or omissions in my data? Ex. “How many participants said…” or “Which brands weren't mentioned…”
  The AI Questions feature is less suited for direct quantitative queries like counting mentions, as it is designed primarily to assess open-ended responses. 
The AI Questions feature is unable to answer questions about missing data. We recommend focusing on what is included rather than what isn't for accurate results.
For ideas on what questions you can ask, see our article: How to Ask Great Questions.
• Can we ask it to focus on specific tasks instead of the whole study? 
  Yes, researchers can use filters to concentrate their analysis on specific activities or tasks within a study.
• Why do I see the message: “We were unable to match relevant sources to your question” after submitting my question?
  Recollective ensures that responses are provided only when sufficient relevant information is available from the study. If a question is asked and there are no sources or not enough data to support a finding, Recollective AI will notify the researcher of this shortfall. In such cases, researchers can reframe their question or choose to relax any filters being applied, such as removing filters on activity, task, or segment.
• Is there a limit to the number of questions I can ask?
  Each chat can receive up to 50 questions in total. Once you reach this limit, the chat will be disabled, and you will be prompted to start a new one. However, there is no limit to the number of chats you can initiate.
• Does AI Questions support other languages?
  Yes! AI Questions can generate answers in any of our supported languages regardless of the study’s default settings. For better language detection, ask longer, more detailed questions. Short questions with words common to multiple languages can confuse the AI and result in responses in the wrong language.
• Does AI Questions recognize participants’ names in a question?
  For privacy reasons, the AI doesn’t store or know participants’ names— the @ mentions function converts names into values the AI can associate with specific users. For example, if you type "Kevin Parker," the AI won’t know who you're referring to unless you use the @mention.