Streamline the process of analyzing responses in an Open Question block and gain insights within minutes. Harness the speed of AI while remaining in control to review and refine the output efficiently. This way only valuable insights are shared with your stakeholders in the report.
Save hours of sifting through the results and reading each response. The AI-powered tool does the heavy lifting of analyzing all responses and categorizing them into broader themes, all in a matter of minutes.
In this article:
- Find themes automatically
- Create manual themes
- Theme details
- Assign responses to a theme
- Filter
- Edit or delete themes
- Results & reporting
- Troubleshooting
Who can use this feature
- Open question follow-ups and AI themes are available on the Team and Organization plans.
- Team members can create, assign, and edit themes. Project collaborators can only view existing themes. Learn more about roles and permissions
Find themes automatically
The AI-powered analysis tool easily groups responses by themes, finds patterns, and summarizes ideas in a matter of minutes.
Here’s how you do it:
- Once you start receiving responses, open the Results dashboard for your Open Question block. Please note that themes are not yet available for other block types.
- Click Find themes with AI.
- Give the AI tool a moment to analyze the responses. Depending on the number of responses, this may take a few minutes.
- Go to your results page to see the newly generated AI themes.
Supported languages
In the results, the conversation summary and themes appear in the language of your initial question. The participants’ answers appear in their original language.
GPT-4 supports English as its primary language. It also handles other languages well, as it was trained on a variety of multilingual internet text, although its capabilities in each language may vary.
Generally, it performs best in languages with more extensive training data. For less widely spoken languages or those with less available training data, performance might not be as strong or nuanced. We recommend previewing and testing to confirm that the block performs well in your desired language.
It supports text generation and understanding in various languages, including but not limited to: Arabic, Chinese (Simplified and Traditional), Czech, Danish, Dutch, English, Finnish, French, German, Hungarian, Indonesian, Italian, Japanese, Korean, Malay, Norwegian, Polish, Portuguese (Brazilian and European), Romanian, Russian, Spanish, Swedish, Thai, Turkish, Ukrainian, and Vietnamese.
The exact number of supported languages can change as OpenAI continues to update and improve GPT-4. Future updates may enhance its capabilities in existing languages or add support for new ones.
Learn more in OpenAI’s official documentation
Create manual themes
To add a theme manually:
- Open the results dashboard for your Open Question block. Please note that themes are not yet available for other block types.
- Click Create theme.
- Add a name for the theme and a label color.
- Click Create.
The newly created theme will appear on your results page.
Theme details
Click each theme to open the theme details page.
The theme details page includes three sections:
-
Summary
AI-generated themes include an automated summary where you can document patterns and insights from each theme, and will appear in the report. You can adjust this summary as needed using the Edit button.
Manual themes don't include an AI summary, but you can manually include one by clicking + Add summary. -
Sentiment
In this section, you can measure the feelings (positive, negative, or neutral) associated with that specific theme.
-
Responses
In this section, you’ll see all responses associated with that theme.
Assign responses to a theme
You can assign one or more themes to a response.
- Open the results dashboard for your Open Question block.
- Scroll down to the Responses section.
- Under each response, click the Manage themes (
) button.
- Select one or more themes from the drop-down. If you don't see any themes yet, first follow the steps to create a theme
Filter by sentiment
To narrow down your results, use the drop-down in the Responses section and in the theme details section to filter responses by sentiment.
Edit or delete themes
To edit a theme:
- Click the ••• (more) menu.
- Select Edit from the drop-down.
- Add a new name and/or label color.
- To confirm, click Save.
To permanently delete a theme:
- Click the ••• (more) menu.
- Select Delete from the drop-down.
- To confirm, click the Delete button.
Deleting a theme doesn't delete the responses associated with it.
Results & reporting
As testers complete your maze, you'll start seeing insights in the Results dashboard. Maze also generates a report automatically.
Learn more about results & reporting for Open Question blocks
Troubleshooting
Why do I see a “Not enough responses” screen?
While looking for themes in your responses, you might run into the following screen:
"Not enough responses”
This warning appears if your maze hasn’t yet received enough responses for the AI tool to identify response patterns.
To solve this issue, collect more responses to your mazes before running the analysis again.
Learn more about sharing your maze with testers
Why do I see a “No new themes found” screen?
While looking for themes in your responses, you might run into the following screen:
No new themes found
This warning appears if the AI tool hasn’t detected new themes since the last time you ran the analysis. This can happen even if you've received additional participant responses in the meantime.
Alternatively, you can also create new themes manually.
Why do I see a “Couldn’t analyze responses” error?
While looking for themes in your responses, you may run into an error that stops responses from being analyzed or themes from being created.
In such cases, you’ll see the following error message:
Couldn’t analyze responses There was an error in analyzing your responses – try again in a few minutes.
This may happen for a few different reasons:
- There’s been an error on Maze’s side
- OpenAI, which powers Maze’s AI features, is down or unavailable (OpenAI Status)
If you come across this error, we recommend waiting a few minutes before trying to generate themes again.
If the issue persists, please reach out to our Support team so they can investigate.